-- Logs begin at Sat 2021-12-25 20:01:33 UTC, end at Sat 2021-12-25 22:38:36 UTC. -- Dec 25 20:57:54.777953 ncdv-master-1 systemd[1]: Started Devstack devstack@c-vol.service. Dec 25 20:57:58.000428 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=129749) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 25 20:57:58.001052 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=129749) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 25 20:57:58.382884 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_db.sqlalchemy.engines [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129749) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 20:57:58.687278 ncdv-master-1 cinder-volume[129749]: INFO cinder.rpc [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Dec 25 20:57:58.691397 ncdv-master-1 cinder-volume[129749]: INFO cinder.rpc [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Dec 25 20:57:58.698616 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_db.sqlalchemy.engines [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129749) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 20:57:58.760968 ncdv-master-1 cinder-volume[129749]: INFO cinder.volume.manager [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] Determined volume DB was empty at startup. Dec 25 20:57:58.761573 ncdv-master-1 cinder-volume[129749]: DEBUG cinder.volume.manager [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=129749) __init__ /opt/stack/cinder/cinder/volume/manager.py:281}} Dec 25 20:57:58.769012 ncdv-master-1 cinder-volume[129749]: INFO cinder.volume.manager [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] Service not found for updating active_backend_id, assuming default for driver init. Dec 25 20:57:58.769965 ncdv-master-1 cinder-volume[129749]: WARNING stevedore.named [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 20:57:58.770409 ncdv-master-1 cinder-volume[129749]: WARNING castellan.key_manager [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 20:57:58.771509 ncdv-master-1 cinder-volume[129749]: WARNING cinder.keymgr.conf_key_mgr [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 20:57:58.787847 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_db.sqlalchemy.engines [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129749) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 20:57:58.791870 ncdv-master-1 cinder-volume[129749]: INFO cinder.rpc [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Dec 25 20:57:58.795829 ncdv-master-1 cinder-volume[129749]: INFO cinder.rpc [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] Automatically selected cinder-volume RPC version 3.16 as minimum service version. Dec 25 20:57:58.798860 ncdv-master-1 cinder-volume[129749]: WARNING stevedore.named [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 20:57:58.798860 ncdv-master-1 cinder-volume[129749]: WARNING castellan.key_manager [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 20:57:58.799430 ncdv-master-1 cinder-volume[129749]: INFO cinder.volume.manager [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] Image-volume cache enabled for host ncdv-master-1@ceph. Dec 25 20:57:58.805093 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_db.sqlalchemy.engines [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129749) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 20:57:58.875454 ncdv-master-1 cinder-volume[129749]: INFO oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] Starting 1 workers Dec 25 20:57:58.880669 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] Started child 129926 {{(pid=129749) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Dec 25 20:57:58.882614 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] Full set of CONF: {{(pid=129749) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Dec 25 20:57:58.890922 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ******************************************************************************** {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 25 20:57:58.890922 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] Configuration options gathered from: {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 25 20:57:58.890922 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 25 20:57:58.890922 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 25 20:57:58.890922 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ================================================================================ {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 25 20:57:58.890922 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] allow_availability_zone_fallback = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.891402 ncdv-master-1 cinder-volume[129926]: INFO cinder.service [-] Starting cinder-volume node (version 19.1.0) Dec 25 20:57:58.891938 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] allow_compression_on_image_upload = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.891938 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] allowed_direct_url_schemes = [] {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.891938 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] api_rate_limit = True {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.891938 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] auth_strategy = keystone {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.891938 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] az_cache_duration = 3600 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.891938 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_availability_zone = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.891938 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_host = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.892379 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_name = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.892379 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_stats_polling_interval = 60 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.892379 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backup_api_class = cinder.backup.api.API {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.892379 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.892379 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backup_name_template = backup-%s {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.892379 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backup_use_same_host = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.893969 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backup_use_temp_snapshot = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.894630 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] chap_password = **** {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.895250 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] chap_username = {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.895884 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.896515 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] cinder_internal_tenant_project_id = f8de2c022c7e473abd53e78670253e88 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.897151 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] cinder_internal_tenant_user_id = 0f668b27e2af43fd812f309f6908199c {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.897719 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] cloned_volume_same_az = True {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.898288 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] cluster = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.898871 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] compression_format = gzip {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.899598 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] compute_api_class = cinder.compute.nova.API {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.900222 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] config_dir = [] {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.900706 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.901299 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] config_source = [] {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.901859 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.902463 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] control_exchange = openstack {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.903073 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] debug = True {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.904091 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] default_availability_zone = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.904661 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] default_group_type = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.905680 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.907027 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] default_volume_type = ceph {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.907612 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] driver_client_cert = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.908180 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] driver_client_cert_key = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.908727 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] driver_data_namespace = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.909458 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] driver_ssl_cert_path = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.910027 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] driver_ssl_cert_verify = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.910641 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] driver_use_ssl = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.911239 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] enable_force_upload = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.911723 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] enable_new_services = True {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.912368 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] enable_unsupported_driver = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.912992 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] enabled_backends = ['ceph'] {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.914041 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] enforce_multipath_for_image_xfer = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.915225 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] filter_function = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.915803 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] glance_api_insecure = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.916400 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] glance_api_servers = ['http://10.222.0.32/image'] {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.917020 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] glance_api_ssl_compression = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.917581 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] glance_ca_certificates_file = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.918193 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] glance_catalog_info = image:glance:publicURL {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.918767 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] glance_certfile = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.919626 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.920208 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] glance_keyfile = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.920787 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] glance_num_retries = 3 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.921315 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-85ef285d-e666-45f5-9d05-6d7b672fd5f7 None None] Starting volume driver RBDDriver (1.2.0) Dec 25 20:57:58.921810 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] glance_request_timeout = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.922920 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] goodness_function = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.923686 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] graceful_shutdown_timeout = 5 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.924207 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-85ef285d-e666-45f5-9d05-6d7b672fd5f7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 20:57:58.924741 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] group_api_class = cinder.group.api.API {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.925294 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] host = ncdv-master-1 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.925893 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] iet_conf = /etc/iet/ietd.conf {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.926468 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] image_compress_on_upload = True {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.927041 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] image_conversion_address_space_limit = 1 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.927594 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] image_conversion_cpu_limit = 60 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.928322 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.928921 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] image_upload_use_cinder_backend = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.929491 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] image_upload_use_internal_tenant = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.930180 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] image_volume_cache_enabled = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.930737 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] image_volume_cache_max_count = 0 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.931539 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] image_volume_cache_max_size_gb = 0 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.932136 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] init_host_max_objects_retrieval = 0 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.932849 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] instance_format = [instance: %(uuid)s] {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.933447 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.934463 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] iscsi_iotype = fileio {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.935073 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] iscsi_secondary_ip_addresses = [] {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.935657 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] iscsi_target_flags = {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.936336 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] iscsi_write_cache = on {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.936929 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] iser_helper = tgtadm {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.937811 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] iser_ip_address = 10.222.0.32 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.938667 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] iser_port = 3260 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.939325 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.940135 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] log_config_append = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.940775 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.941369 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] log_dir = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.941969 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] log_file = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.942471 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] log_options = True {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.942845 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] log_rotate_interval = 1 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.943238 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] log_rotate_interval_type = days {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.943633 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] log_rotation_type = none {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.944119 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.944816 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.945384 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.945944 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.946378 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.946898 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] max_age = 0 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.947455 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] max_logfile_count = 30 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.947999 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] max_logfile_size_mb = 200 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.948662 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] max_over_subscription_ratio = 20.0 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.949320 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] message_reap_interval = 86400 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.949827 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] message_ttl = 2592000 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.950502 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] migration_create_volume_timeout_secs = 300 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.951107 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] monkey_patch = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.951632 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] monkey_patch_modules = [] {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.955036 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] my_ip = 10.222.0.32 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.955750 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] no_snapshot_gb_quota = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.956318 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] num_iser_scan_tries = 3 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.970831 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] num_shell_tries = 3 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.971263 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] num_volume_device_scan_tries = 3 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.971689 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] nvmet_ns_id = 10 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.973413 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] nvmet_port_id = 1 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.974078 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] osapi_max_limit = 1000 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.974722 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] osapi_volume_ext_list = [] {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.975545 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.975738 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-85ef285d-e666-45f5-9d05-6d7b672fd5f7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 20:57:58.976440 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] osapi_volume_listen = 0.0.0.0 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.977073 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] osapi_volume_listen_port = 8776 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.977741 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] osapi_volume_use_ssl = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.978351 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] osapi_volume_workers = 2 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.978910 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] per_volume_size_limit = -1 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.979467 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] periodic_fuzzy_delay = 60 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.980051 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] periodic_interval = 60 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.980779 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] public_endpoint = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.981357 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] publish_errors = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.981868 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] quota_backup_gigabytes = 1000 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.983070 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] quota_backups = 10 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.983648 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] quota_consistencygroups = 10 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.984263 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.985658 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] quota_gigabytes = 1000 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.986360 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] quota_groups = 10 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.986941 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] quota_snapshots = 10 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.987397 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] quota_volumes = 10 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.987839 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] rate_limit_burst = 0 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.988299 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] rate_limit_except_level = CRITICAL {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.988711 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] rate_limit_interval = 0 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.989147 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] reinit_driver_count = 3 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.989726 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] replication_device = **** {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.990381 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] report_discard_supported = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.991209 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] report_interval = 10 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.991883 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] reservation_clean_interval = 86400 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.992807 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] reservation_expire = 86400 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.993428 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] reserved_percentage = 0 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.993915 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.994341 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.994820 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] rpc_response_timeout = 120 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.995494 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] run_external_periodic_tasks = True {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.995931 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.996683 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] scst_target_driver = iscsi {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.997257 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] scst_target_iqn_name = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.997759 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] service_down_time = 60 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.998755 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] snapshot_name_template = snapshot-%s {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:58.999318 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] snapshot_same_host = True {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:59.000054 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] split_loggers = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:59.000717 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] state_path = /opt/stack/data/cinder {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:59.001908 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] storage_availability_zone = nova {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:59.002815 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] storage_protocol = iscsi {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:59.003384 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] syslog_log_facility = LOG_USER {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:59.003979 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] target_helper = lioadm {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:59.005347 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] target_ip_address = 10.222.0.32 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:59.006212 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] target_port = 3260 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:59.006921 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:59.007425 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] target_protocol = iscsi {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:59.007859 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] trace_flags = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:59.008309 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] transfer_api_class = cinder.transfer.api.API {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:59.009011 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] transport_url = **** {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:59.011173 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] until_refresh = 0 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:59.012128 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] use_chap_auth = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:59.012714 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] use_default_quota_class = True {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:59.014046 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] use_eventlog = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:59.014521 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] use_journal = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:59.015095 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] use_json = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:59.015730 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] use_multipath_for_image_xfer = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:59.016296 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] use_stderr = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:59.016662 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-85ef285d-e666-45f5-9d05-6d7b672fd5f7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 20:57:59.017249 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] use_syslog = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:59.017858 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] verify_glance_signatures = enabled {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:59.018440 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] volume_api_class = cinder.volume.api.API {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:59.018983 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] volume_backend_name = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:59.019563 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] volume_clear = zero {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:59.020119 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] volume_clear_ionice = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:59.020668 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] volume_clear_size = 0 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:59.021287 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:59.021987 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] volume_copy_bps_limit = 0 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:59.022575 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] volume_dd_blocksize = 1M {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:59.023165 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:59.024063 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] volume_name_template = volume-%s {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:59.024664 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] volume_service_inithost_offload = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:59.025143 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] volume_usage_audit_period = month {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:59.025665 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:59.027098 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] watch_log_file = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:59.027653 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] zoning_mode = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:57:59.028353 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.028834 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.029331 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_policy.enforce_new_defaults = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.029713 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_policy.enforce_scope = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.030117 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_policy.policy_default_rule = default {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.030516 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.030909 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_policy.policy_file = policy.yaml {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.032006 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.032359 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.032709 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.033130 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.033482 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.033893 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_concurrency.disable_process_locking = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.034287 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.034705 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] keystone_authtoken.admin_password = **** {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.035066 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.035407 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] keystone_authtoken.admin_token = **** {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.035749 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] keystone_authtoken.admin_user = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.036139 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] keystone_authtoken.auth_admin_prefix = {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.036504 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.036942 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] keystone_authtoken.auth_port = 35357 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.037313 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] keystone_authtoken.auth_protocol = https {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.037725 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] keystone_authtoken.auth_section = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.038094 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] keystone_authtoken.auth_type = password {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.038467 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] keystone_authtoken.auth_uri = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.038808 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] keystone_authtoken.auth_version = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.039164 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] keystone_authtoken.cache = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.039541 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.040609 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] keystone_authtoken.certfile = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.040609 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] keystone_authtoken.delay_auth_decision = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.040820 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.041471 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] keystone_authtoken.http_connect_timeout = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.042038 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.042546 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] keystone_authtoken.identity_uri = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.043050 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] keystone_authtoken.include_service_catalog = True {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.043557 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] keystone_authtoken.insecure = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.044057 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] keystone_authtoken.interface = public {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.044610 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] keystone_authtoken.keyfile = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.045015 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.045542 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.046059 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.046417 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.046849 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.047714 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.048082 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.048439 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.048847 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.051061 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] keystone_authtoken.region_name = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.051464 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.051824 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] keystone_authtoken.service_token_roles_required = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.052317 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] keystone_authtoken.service_type = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.052778 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] keystone_authtoken.token_cache_time = 300 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.053182 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.053649 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] cache.backend = dogpile.cache.null {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.054036 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] cache.backend_argument = **** {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.054400 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] cache.config_prefix = cache.oslo {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.054784 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] cache.debug_cache_backend = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.055132 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] cache.enabled = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.055484 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] cache.expiration_time = 600 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.055851 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] cache.memcache_dead_retry = 300 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.056241 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.056587 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.057511 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] cache.memcache_pool_maxsize = 10 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.057511 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.060457 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.061184 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] cache.memcache_socket_timeout = 1.0 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.061858 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] cache.proxies = [] {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.063084 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] cache.tls_allowed_ciphers = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.063192 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] cache.tls_cafile = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.063526 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] cache.tls_certfile = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.064116 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] cache.tls_enabled = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.064494 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] cache.tls_keyfile = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.064969 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] coordination.backend_url = etcd3+http://10.222.0.32:2379 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.065588 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] database.backend = sqlalchemy {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.065760 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] database.connection = **** {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.066035 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] database.connection_debug = 0 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.066396 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] database.connection_parameters = {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.066753 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] database.connection_recycle_time = 3600 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.066854 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.driver [None req-85ef285d-e666-45f5-9d05-6d7b672fd5f7 None None] Driver hasn't implemented _init_vendor_properties() Dec 25 20:57:59.067107 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] database.connection_trace = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.067209 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.driver [None req-85ef285d-e666-45f5-9d05-6d7b672fd5f7 None None] Initialized capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:87776a25-e9df-4e62-b76f-cf87ba918901:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=129926) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:820}} Dec 25 20:57:59.067453 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] database.db_inc_retry_interval = True {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.067805 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] database.db_max_retries = 20 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.068174 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] database.db_max_retry_interval = 10 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.068526 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] database.db_retry_interval = 1 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.069136 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] database.max_overflow = 50 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.069496 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] database.max_pool_size = 5 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.069864 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] database.max_retries = 10 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.070219 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] database.mysql_enable_ndb = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.070582 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.070939 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] database.pool_timeout = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.071295 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] database.retry_interval = 10 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.071658 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] database.slave_connection = **** {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.072016 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] database.sqlite_synchronous = True {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.072365 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] database.use_db_reconnect = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.072765 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.073270 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.073646 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.074039 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.074412 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.075400 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] profiler.connection_string = messaging:// {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.075979 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] profiler.enabled = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.076358 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] profiler.es_doc_type = notification {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.076714 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] profiler.es_scroll_size = 10000 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.077325 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] profiler.es_scroll_time = 2m {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.077834 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] profiler.filter_error_trace = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.078931 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] profiler.hmac_keys = SECRET_KEY {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.079447 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] profiler.sentinel_service_name = mymaster {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.079954 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] profiler.socket_timeout = 0.1 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.080629 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] profiler.trace_sqlalchemy = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.083622 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-85ef285d-e666-45f5-9d05-6d7b672fd5f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 20:57:59.084013 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] privsep_osbrick.capabilities = [21] {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.084438 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] privsep_osbrick.group = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.086020 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] privsep_osbrick.helper_command = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.086417 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] privsep_osbrick.logger_name = oslo_privsep.daemon {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.086812 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.087203 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] privsep_osbrick.user = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.087614 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.087968 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] cinder_sys_admin.group = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.088316 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] cinder_sys_admin.helper_command = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.088982 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.089540 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.089891 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] cinder_sys_admin.user = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.090438 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] service_user.auth_section = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.092664 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] service_user.auth_type = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.093218 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] service_user.cafile = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.093757 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] service_user.certfile = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.094153 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] service_user.collect_timing = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.094514 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] service_user.insecure = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.094868 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] service_user.keyfile = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.095250 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] service_user.send_service_user_token = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.095631 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] service_user.split_loggers = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.095991 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] service_user.timeout = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.096385 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.backend_availability_zone = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.096737 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.098038 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.098237 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.chap_password = **** {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.098601 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.chap_username = {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.098963 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.099321 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.deferred_deletion_delay = 0 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.099694 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.deferred_deletion_purge_interval = 60 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.100035 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.driver_client_cert = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.100378 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.driver_client_cert_key = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.100715 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.driver_data_namespace = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.102714 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.102714 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.102714 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.driver_use_ssl = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.102956 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.enable_deferred_deletion = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.103309 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.enable_unsupported_driver = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.103683 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.105150 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.extra_capabilities = {} {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.105663 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.filter_function = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.106162 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.goodness_function = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.106534 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.iet_conf = /etc/iet/ietd.conf {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.106886 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.107240 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.107595 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.107943 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.108288 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.108728 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.iscsi_iotype = fileio {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.109145 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.iscsi_secondary_ip_addresses = [] {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.109531 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.iscsi_target_flags = {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.109890 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.iscsi_write_cache = on {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.110250 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.iser_helper = tgtadm {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.110783 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.iser_ip_address = 10.222.0.32 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.111164 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.iser_port = 3260 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.111527 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.111892 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.112258 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.112603 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.num_shell_tries = 3 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.112978 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.113333 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.113679 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.nvmet_port_id = 1 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.114038 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.rados_connect_timeout = -1 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.114377 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.rados_connection_interval = 5 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.114731 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.rados_connection_retries = 3 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.115086 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.rbd_ceph_conf = {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.115441 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.rbd_cluster_name = ceph {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.115778 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.rbd_exclusive_cinder_pool = True {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.116285 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.rbd_flatten_volume_from_snapshot = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.116646 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.rbd_max_clone_depth = 5 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.117024 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.rbd_pool = rbd {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.117599 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.rbd_secret_uuid = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.118124 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.rbd_store_chunk_size = 4 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.118895 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.rbd_user = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.118895 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.replication_connect_timeout = 5 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.119159 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.replication_device = **** {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.119495 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.report_discard_supported = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.119833 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.report_dynamic_total_capacity = True {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.120321 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.reserved_percentage = 0 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.120819 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.scst_target_driver = iscsi {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.121189 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.scst_target_iqn_name = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.121547 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.storage_protocol = iscsi {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.121890 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.122262 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.target_helper = tgtadm {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.122726 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.target_ip_address = 10.222.0.32 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.123072 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.target_port = 3260 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.123432 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.123786 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.target_protocol = iscsi {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.124123 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.trace_flags = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.124477 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.unique_fqdn_network = True {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.125361 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.use_chap_auth = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.125929 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.126409 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.volume_backend_name = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.126772 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.volume_clear = zero {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.127111 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.volume_clear_ionice = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.127454 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.volume_clear_size = 0 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.127868 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.128361 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.128910 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.129320 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.129791 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.130191 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_reports.file_event_handler = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.130709 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.131003 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_reports.log_dir = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.131313 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.backend_availability_zone = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.131657 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.backend_host = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.131999 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.backend_native_threads_pool_size = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.132338 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.backup_use_temp_snapshot = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.132684 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.chap_password = **** {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.134364 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.db.sqlalchemy.api [None req-85ef285d-e666-45f5-9d05-6d7b672fd5f7 None None] Building query based on filter {{(pid=129926) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3156}} Dec 25 20:57:59.134568 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.chap_username = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.134568 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.chiscsi_conf = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.134568 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.deferred_deletion_delay = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.135169 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.deferred_deletion_purge_interval = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.135378 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.driver_client_cert = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.135619 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.driver_client_cert_key = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.135909 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.driver_data_namespace = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.136248 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.driver_ssl_cert_path = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.137312 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.driver_ssl_cert_verify = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.137896 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.driver_use_ssl = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.138615 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.enable_deferred_deletion = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.139318 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.enable_unsupported_driver = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.139867 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.enforce_multipath_for_image_xfer = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.140452 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.extra_capabilities = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.141487 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.filter_function = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.141909 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.goodness_function = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.142326 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.iet_conf = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.142748 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.image_upload_use_cinder_backend = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.143180 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.image_upload_use_internal_tenant = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.143621 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.image_volume_cache_enabled = True {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.144039 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.image_volume_cache_max_count = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.144446 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.image_volume_cache_max_size_gb = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.144905 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.iscsi_iotype = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.145312 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.iscsi_secondary_ip_addresses = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.145769 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.iscsi_target_flags = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.146176 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.iscsi_write_cache = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.146583 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.iser_helper = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.146990 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.iser_ip_address = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.147393 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.iser_port = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.147804 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.iser_target_prefix = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.148216 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.max_over_subscription_ratio = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.148643 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.num_iser_scan_tries = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.149213 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.num_shell_tries = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.149638 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.num_volume_device_scan_tries = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.150647 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.nvmet_ns_id = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.150647 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.nvmet_port_id = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.150808 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.rados_connect_timeout = -1 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.151145 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.rados_connection_interval = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.151547 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.rados_connection_retries = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.152548 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.rbd_ceph_conf = /etc/ceph/ceph.conf {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.153156 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.rbd_cluster_name = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.153568 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.rbd_exclusive_cinder_pool = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.154023 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.rbd_flatten_volume_from_snapshot = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.154448 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.rbd_max_clone_depth = 5 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.154916 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.rbd_pool = volumes {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.155340 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.rbd_secret_uuid = a784574f-d922-4963-98f5-026decc1035b {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.155758 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.rbd_store_chunk_size = 4 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.156207 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.rbd_user = cinder {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.156607 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.replication_connect_timeout = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.157037 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.replication_device = **** {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.157435 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.report_discard_supported = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.157834 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.report_dynamic_total_capacity = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.158024 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.image_utils [None req-85ef285d-e666-45f5-9d05-6d7b672fd5f7 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=129926) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:955}} Dec 25 20:57:59.158289 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.reserved_percentage = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.158688 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.scst_target_driver = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.159096 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.scst_target_iqn_name = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.159498 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.storage_protocol = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.159889 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.suppress_requests_ssl_warnings = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.160397 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.target_helper = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.160746 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.target_ip_address = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.161116 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.target_port = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.161526 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.target_prefix = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.162293 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.target_protocol = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.162293 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.trace_flags = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.162516 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.unique_fqdn_network = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.163027 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.use_chap_auth = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.163512 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.use_multipath_for_image_xfer = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.164032 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.volume_backend_name = ceph {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.164566 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.volume_clear = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.165085 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.volume_clear_ionice = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.165574 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.volume_clear_size = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.166063 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.volume_copy_blkio_cgroup_name = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.166195 ncdv-master-1 cinder-volume[129926]: INFO cinder.keymgr.migration [None req-0870777c-e524-4f6a-8361-15a0b8de8291 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Dec 25 20:57:59.166665 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.volume_copy_bps_limit = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.167173 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.volume_dd_blocksize = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.167707 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.volume_driver = cinder.volume.drivers.rbd.RBDDriver {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.168053 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ceph.volumes_dir = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.168491 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.168866 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.172501 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.172501 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.172501 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.172501 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.172501 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.172501 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.172987 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.173172 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.173554 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.173935 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.174404 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.174764 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.175112 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.175410 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-85ef285d-e666-45f5-9d05-6d7b672fd5f7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 20:57:59.175512 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.175798 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.176139 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.176483 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.176843 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.177248 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.177640 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_messaging_rabbit.ssl = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.179931 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.179931 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.179931 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.179931 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_messaging_rabbit.ssl_version = {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.179931 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_messaging_notifications.driver = [] {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.179931 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_messaging_notifications.retry = -1 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.180348 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.180427 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] oslo_messaging_notifications.transport_url = **** {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.180727 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.181032 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] key_manager.fixed_key = **** {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.181415 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.181754 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] barbican.barbican_api_version = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.183206 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] barbican.barbican_endpoint = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.183206 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] barbican.barbican_endpoint_type = public {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.183206 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] barbican.barbican_region_name = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.183206 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] barbican.cafile = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.183475 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] barbican.certfile = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.183763 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] barbican.collect_timing = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.184101 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] barbican.insecure = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.184438 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] barbican.keyfile = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.184773 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] barbican.number_of_retries = 60 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.185140 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] barbican.retry_delay = 1 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.185477 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] barbican.send_service_user_token = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.185819 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] barbican.split_loggers = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.186148 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] barbican.timeout = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.186484 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] barbican.verify_ssl = True {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.186820 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] barbican.verify_ssl_path = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.187167 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] barbican_service_user.auth_section = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.188077 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] barbican_service_user.auth_type = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.188417 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] barbican_service_user.cafile = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.188753 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] barbican_service_user.certfile = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.189194 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] barbican_service_user.collect_timing = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.189763 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] barbican_service_user.insecure = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.190114 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] barbican_service_user.keyfile = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.190460 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] barbican_service_user.split_loggers = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.190789 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] barbican_service_user.timeout = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.192585 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] vault.approle_role_id = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.193116 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] vault.approle_secret_id = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.193641 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] vault.cafile = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.194149 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] vault.certfile = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.194680 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] vault.collect_timing = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.195182 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] vault.insecure = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.195654 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] vault.keyfile = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.196158 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] vault.kv_mountpoint = secret {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.196512 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] vault.kv_version = 2 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.196855 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] vault.namespace = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.197225 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] vault.root_token_id = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.197570 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] vault.split_loggers = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.197908 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] vault.ssl_ca_crt_file = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.198247 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] vault.timeout = None {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.198610 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] vault.use_ssl = False {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.198969 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:57:59.199256 ncdv-master-1 cinder-volume[129749]: DEBUG oslo_service.service [None req-5f4e6ca8-52df-42ff-bf64-de35cc599976 None None] ******************************************************************************** {{(pid=129749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 25 20:57:59.206611 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-85ef285d-e666-45f5-9d05-6d7b672fd5f7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 20:57:59.232249 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-85ef285d-e666-45f5-9d05-6d7b672fd5f7 None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 20:57:59.275565 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-85ef285d-e666-45f5-9d05-6d7b672fd5f7 None None] Driver initialization completed successfully. Dec 25 20:57:59.289159 ncdv-master-1 cinder-volume[129926]: INFO cinder.manager [None req-85ef285d-e666-45f5-9d05-6d7b672fd5f7 None None] Initiating service 3 cleanup Dec 25 20:57:59.297926 ncdv-master-1 cinder-volume[129926]: INFO cinder.manager [None req-85ef285d-e666-45f5-9d05-6d7b672fd5f7 None None] Service 3 cleanup completed. Dec 25 20:57:59.298597 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.service [None req-85ef285d-e666-45f5-9d05-6d7b672fd5f7 None None] Creating RPC server for service cinder-volume {{(pid=129926) start /opt/stack/cinder/cinder/service.py:231}} Dec 25 20:57:59.308166 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.service [None req-85ef285d-e666-45f5-9d05-6d7b672fd5f7 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=129926) start /opt/stack/cinder/cinder/service.py:237}} Dec 25 20:57:59.378904 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-85ef285d-e666-45f5-9d05-6d7b672fd5f7 None None] Initializing RPC dependent components of volume driver RBDDriver (1.2.0) Dec 25 20:57:59.379993 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-85ef285d-e666-45f5-9d05-6d7b672fd5f7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 20:57:59.408815 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-85ef285d-e666-45f5-9d05-6d7b672fd5f7 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 20:57:59.519035 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-85ef285d-e666-45f5-9d05-6d7b672fd5f7 None None] Driver post RPC initialization completed successfully. Dec 25 20:59:29.522711 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 20:59:29.523462 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 20:59:29.593136 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 20:59:29.618866 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:00:29.524683 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:00:29.525375 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:00:29.552728 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:00:29.659894 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:01:29.529662 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:01:29.530322 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:01:29.553695 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:01:29.674478 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:02:29.530759 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:02:29.532079 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:02:29.557963 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:02:29.584167 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:03:29.529590 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:03:29.530270 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:03:29.551609 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:03:29.578400 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:04:29.533558 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:04:29.534241 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:04:29.556250 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:04:29.578662 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:05:29.533696 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:05:29.534388 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:05:29.554580 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:05:29.577997 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:06:29.532760 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:06:29.533489 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:06:29.555245 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:06:29.578932 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:07:29.538097 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:07:29.538821 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:07:29.604584 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:07:29.643170 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:08:29.539012 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:08:29.542831 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:08:29.643139 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:08:29.735805 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:09:29.537995 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:09:29.539931 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:09:29.568216 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:09:29.640041 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:09:37.644253 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d5f0e63-e9ec-4075-ae6c-a8b052420090 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:09:37.656868 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-3d5f0e63-e9ec-4075-ae6c-a8b052420090 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:09:37.668764 ncdv-master-1 cinder-volume[129926]: INFO cinder.rpc [None req-3d5f0e63-e9ec-4075-ae6c-a8b052420090 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Automatically selected cinder-backup objects version 1.39 as minimum service version. Dec 25 21:09:37.678994 ncdv-master-1 cinder-volume[129926]: INFO cinder.rpc [None req-3d5f0e63-e9ec-4075-ae6c-a8b052420090 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Automatically selected cinder-backup RPC version 2.2 as minimum service version. Dec 25 21:09:37.682505 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-3d5f0e63-e9ec-4075-ae6c-a8b052420090 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:09:37.683095 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-3d5f0e63-e9ec-4075-ae6c-a8b052420090 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:09:37.740903 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3d5f0e63-e9ec-4075-ae6c-a8b052420090 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Flow 'volume_create_manager' (285965cd-5ee7-48a4-9974-dda0388376c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:09:37.744758 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3d5f0e63-e9ec-4075-ae6c-a8b052420090 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5334bb0-782a-4a25-81f1-a8c83a2fa5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:09:37.751531 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-3d5f0e63-e9ec-4075-ae6c-a8b052420090 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:09:37.797987 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3d5f0e63-e9ec-4075-ae6c-a8b052420090 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5334bb0-782a-4a25-81f1-a8c83a2fa5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveAutoBlockMigrationV225Test-volume-26226395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=64f56b9c-4663-4274-84df-9ac590d6eef0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='276a36e6a97d46a78b7e483daa26cc2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:09:37Z,use_quota=True,user_id='2cb2a59c7c9b4a13964c78ff0fb1a8f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:09:37.800529 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3d5f0e63-e9ec-4075-ae6c-a8b052420090 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaa8af7d-0fc5-4b30-8c09-2bc42f16b1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:09:37.802668 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3d5f0e63-e9ec-4075-ae6c-a8b052420090 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaa8af7d-0fc5-4b30-8c09-2bc42f16b1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:09:37.805720 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3d5f0e63-e9ec-4075-ae6c-a8b052420090 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (256b8823-daa5-4c4a-8256-90b7d6f09f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:09:37.808071 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3d5f0e63-e9ec-4075-ae6c-a8b052420090 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (256b8823-daa5-4c4a-8256-90b7d6f09f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64f56b9c-4663-4274-84df-9ac590d6eef0', 'volume_name': 'volume-64f56b9c-4663-4274-84df-9ac590d6eef0', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:09:37.810354 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3d5f0e63-e9ec-4075-ae6c-a8b052420090 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f3f76cb-3aa8-4e35-af48-ab802523ff3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:09:37.812461 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3d5f0e63-e9ec-4075-ae6c-a8b052420090 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f3f76cb-3aa8-4e35-af48-ab802523ff3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:09:37.814735 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3d5f0e63-e9ec-4075-ae6c-a8b052420090 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79ce3249-6b26-41f9-8495-373ab8931b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:09:37.815560 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-3d5f0e63-e9ec-4075-ae6c-a8b052420090 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Volume 64f56b9c-4663-4274-84df-9ac590d6eef0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64f56b9c-4663-4274-84df-9ac590d6eef0', 'volume_size': 1} Dec 25 21:09:37.815956 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-3d5f0e63-e9ec-4075-ae6c-a8b052420090 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] creating volume 'volume-64f56b9c-4663-4274-84df-9ac590d6eef0' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:09:37.816940 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-3d5f0e63-e9ec-4075-ae6c-a8b052420090 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:09:39.219781 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-3d5f0e63-e9ec-4075-ae6c-a8b052420090 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:09:39.220384 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-3d5f0e63-e9ec-4075-ae6c-a8b052420090 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:09:39.222330 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3d5f0e63-e9ec-4075-ae6c-a8b052420090 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79ce3249-6b26-41f9-8495-373ab8931b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64f56b9c-4663-4274-84df-9ac590d6eef0', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:09:39.228761 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3d5f0e63-e9ec-4075-ae6c-a8b052420090 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22570888-d4c2-4a60-aa61-513eb60a9f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:09:39.290230 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-3d5f0e63-e9ec-4075-ae6c-a8b052420090 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Volume volume-64f56b9c-4663-4274-84df-9ac590d6eef0 (64f56b9c-4663-4274-84df-9ac590d6eef0): created successfully Dec 25 21:09:39.292356 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3d5f0e63-e9ec-4075-ae6c-a8b052420090 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22570888-d4c2-4a60-aa61-513eb60a9f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:09:39.295588 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3d5f0e63-e9ec-4075-ae6c-a8b052420090 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Flow 'volume_create_manager' (285965cd-5ee7-48a4-9974-dda0388376c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:09:39.369283 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-3d5f0e63-e9ec-4075-ae6c-a8b052420090 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Created volume successfully. Dec 25 21:09:42.194393 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-a0c3ba6c-c952-405c-9b15-c5431a391b0c req-0e95274d-136e-4ce5-ae73-de6cd8cfdc49 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:09:43.248645 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-a0c3ba6c-c952-405c-9b15-c5431a391b0c req-0e95274d-136e-4ce5-ae73-de6cd8cfdc49 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.054s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:09:43.250512 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-a0c3ba6c-c952-405c-9b15-c5431a391b0c req-0e95274d-136e-4ce5-ae73-de6cd8cfdc49 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-64f56b9c-4663-4274-84df-9ac590d6eef0', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': '64f56b9c-4663-4274-84df-9ac590d6eef0', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 21:09:43.469751 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-a0c3ba6c-c952-405c-9b15-c5431a391b0c req-0e95274d-136e-4ce5-ae73-de6cd8cfdc49 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Connection info returned from driver {'name': 'volumes/volume-64f56b9c-4663-4274-84df-9ac590d6eef0', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '64f56b9c-4663-4274-84df-9ac590d6eef0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'e891e06f-9262-4bce-a48c-d046c22067d1'} {{(pid=129926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 25 21:09:43.657008 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-a0c3ba6c-c952-405c-9b15-c5431a391b0c req-0e95274d-136e-4ce5-ae73-de6cd8cfdc49 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] attachment_update completed successfully. Dec 25 21:09:58.104525 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-0a5615e4-e3af-4c29-8da8-5ca2bf12e605 req-fe1cca47-44ff-4541-9ebe-86ecfc9e4673 tempest-LiveAutoBlockMigrationV225Test-952394939 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:09:58.979255 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-0a5615e4-e3af-4c29-8da8-5ca2bf12e605 req-fe1cca47-44ff-4541-9ebe-86ecfc9e4673 tempest-LiveAutoBlockMigrationV225Test-952394939 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.874s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:09:58.980012 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-0a5615e4-e3af-4c29-8da8-5ca2bf12e605 req-fe1cca47-44ff-4541-9ebe-86ecfc9e4673 tempest-LiveAutoBlockMigrationV225Test-952394939 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-64f56b9c-4663-4274-84df-9ac590d6eef0', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': '64f56b9c-4663-4274-84df-9ac590d6eef0', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 21:09:59.083943 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-0a5615e4-e3af-4c29-8da8-5ca2bf12e605 req-fe1cca47-44ff-4541-9ebe-86ecfc9e4673 tempest-LiveAutoBlockMigrationV225Test-952394939 None] Connection info returned from driver {'name': 'volumes/volume-64f56b9c-4663-4274-84df-9ac590d6eef0', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '64f56b9c-4663-4274-84df-9ac590d6eef0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0cd4801f-d545-4f2c-b96e-1be1a9a1a8c8'} {{(pid=129926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 25 21:09:59.207418 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-0a5615e4-e3af-4c29-8da8-5ca2bf12e605 req-fe1cca47-44ff-4541-9ebe-86ecfc9e4673 tempest-LiveAutoBlockMigrationV225Test-952394939 None] attachment_update completed successfully. Dec 25 21:10:13.023589 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-0a5615e4-e3af-4c29-8da8-5ca2bf12e605 req-a850f412-ab6a-40cd-ab9a-5a59d48b516d tempest-LiveAutoBlockMigrationV225Test-952394939 None] Terminate volume connection completed successfully. Dec 25 21:10:13.024159 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-0a5615e4-e3af-4c29-8da8-5ca2bf12e605 req-a850f412-ab6a-40cd-ab9a-5a59d48b516d tempest-LiveAutoBlockMigrationV225Test-952394939 None] Deleting attachment e891e06f-9262-4bce-a48c-d046c22067d1. {{(pid=129926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 25 21:10:21.863343 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-777ac030-d129-4e20-923a-4a94823842e1 req-12c4b7ff-438a-4e56-b66f-1f81a6900d95 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Terminate volume connection completed successfully. Dec 25 21:10:21.863951 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-777ac030-d129-4e20-923a-4a94823842e1 req-12c4b7ff-438a-4e56-b66f-1f81a6900d95 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Deleting attachment 0cd4801f-d545-4f2c-b96e-1be1a9a1a8c8. {{(pid=129926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 25 21:10:25.291894 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:10:25.296945 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:10:25.297449 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:10:25.310269 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Flow 'volume_create_manager' (bce95a1c-2747-4a3d-b27c-cdec885625e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:10:25.313528 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (506f0bde-be17-4873-bbeb-0aae61e7f254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:10:25.320396 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:10:25.338805 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (506f0bde-be17-4873-bbeb-0aae61e7f254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-38144306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=98b6d31e-e760-499e-8962-7b22479c1e9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='276a36e6a97d46a78b7e483daa26cc2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:10:25Z,use_quota=True,user_id='2cb2a59c7c9b4a13964c78ff0fb1a8f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:10:25.341398 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3198ca2-ac46-4c0b-9ff0-797423a94335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:10:25.343540 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3198ca2-ac46-4c0b-9ff0-797423a94335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:10:25.345986 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7253523d-9401-4e06-b6b3-7ecc7182f0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:10:25.492480 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7253523d-9401-4e06-b6b3-7ecc7182f0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '98b6d31e-e760-499e-8962-7b22479c1e9a', 'volume_name': 'volume-98b6d31e-e760-499e-8962-7b22479c1e9a', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:10:25.501024 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efa63ea7-d504-4a42-b49a-50eccb997d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:10:25.503453 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efa63ea7-d504-4a42-b49a-50eccb997d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:10:25.510929 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a56bb5b6-8cfb-44ee-b17d-14657620d6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:10:25.511832 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Volume 98b6d31e-e760-499e-8962-7b22479c1e9a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-98b6d31e-e760-499e-8962-7b22479c1e9a', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 25 21:10:25.520193 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Cloning 98b6d31e-e760-499e-8962-7b22479c1e9a from image aca914d0-5f7b-465f-a024-75efa27d7291 at location (None, None). {{(pid=129926) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Dec 25 21:10:25.531856 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Lock "b'cinder-aca914d0-5f7b-465f-a024-75efa27d7291'" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:10:25.540846 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Preparing cache entry for image = aca914d0-5f7b-465f-a024-75efa27d7291 on host ncdv-master-1@ceph#ceph. {{(pid=129926) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Dec 25 21:10:25.541974 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Attempting to retrieve cache entry for image = aca914d0-5f7b-465f-a024-75efa27d7291 on host ncdv-master-1@ceph#ceph. {{(pid=129926) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Dec 25 21:10:29.534902 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:10:29.535963 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:10:29.657102 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:10:29.741279 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:10:42.403422 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.image_utils [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_aca914d0-5f7b-465f-a024-75efa27d7291_ofqzcmfwncdv-master-1@ceph, size 616.00 MB, duration 16.85 sec {{(pid=129926) fetch /opt/stack/cinder/cinder/image/image_utils.py:580}} Dec 25 21:10:42.407464 ncdv-master-1 cinder-volume[129926]: INFO cinder.image.image_utils [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Image download 616.00 MB at 36.55 MB/s Dec 25 21:10:42.453829 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_aca914d0-5f7b-465f-a024-75efa27d7291_ofqzcmfwncdv-master-1@ceph {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:10:42.553862 ncdv-master-1 sudo[140211]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_aca914d0-5f7b-465f-a024-75efa27d7291_ofqzcmfwncdv-master-1@ceph Dec 25 21:10:42.554679 ncdv-master-1 sudo[140211]: pam_unix(sudo:session): session opened for user root by (uid=0) Dec 25 21:10:43.427466 ncdv-master-1 sudo[140211]: pam_unix(sudo:session): session closed for user root Dec 25 21:10:43.430364 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_aca914d0-5f7b-465f-a024-75efa27d7291_ofqzcmfwncdv-master-1@ceph" returned: 0 in 0.976s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:10:43.437821 ncdv-master-1 cinder-volume[129926]: WARNING py.warnings [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Dec 25 21:10:43.437821 ncdv-master-1 cinder-volume[129926]: debtcollector.deprecate( Dec 25 21:10:43.437821 ncdv-master-1 cinder-volume[129926]: Dec 25 21:10:43.442844 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.image_utils [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Temporary image aca914d0-5f7b-465f-a024-75efa27d7291 is fetched for user 2cb2a59c7c9b4a13964c78ff0fb1a8f4. {{(pid=129926) fetch /opt/stack/cinder/cinder/image/image_utils.py:1088}} Dec 25 21:10:43.586172 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_aca914d0-5f7b-465f-a024-75efa27d7291_ofqzcmfwncdv-master-1@ceph {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:10:43.695355 ncdv-master-1 sudo[140217]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_aca914d0-5f7b-465f-a024-75efa27d7291_ofqzcmfwncdv-master-1@ceph Dec 25 21:10:43.696179 ncdv-master-1 sudo[140217]: pam_unix(sudo:session): session opened for user root by (uid=0) Dec 25 21:10:44.284167 ncdv-master-1 sudo[140217]: pam_unix(sudo:session): session closed for user root Dec 25 21:10:44.291258 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_aca914d0-5f7b-465f-a024-75efa27d7291_ofqzcmfwncdv-master-1@ceph" returned: 0 in 0.701s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:10:44.291258 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] creating volume 'volume-98b6d31e-e760-499e-8962-7b22479c1e9a' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:10:44.291258 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:10:45.185959 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:10:45.187167 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:10:45.345800 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.volume_utils [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Attempting download of aca914d0-5f7b-465f-a024-75efa27d7291 ((None, None)) to volume 98b6d31e-e760-499e-8962-7b22479c1e9a. {{(pid=129926) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1228}} Dec 25 21:10:45.393743 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_aca914d0-5f7b-465f-a024-75efa27d7291_7kju_pj7 {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:10:45.503805 ncdv-master-1 sudo[140237]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_aca914d0-5f7b-465f-a024-75efa27d7291_7kju_pj7 Dec 25 21:10:45.504676 ncdv-master-1 sudo[140237]: pam_unix(sudo:session): session opened for user root by (uid=0) Dec 25 21:10:46.206678 ncdv-master-1 sudo[140237]: pam_unix(sudo:session): session closed for user root Dec 25 21:10:46.209021 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_aca914d0-5f7b-465f-a024-75efa27d7291_7kju_pj7" returned: 0 in 0.815s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:10:46.210441 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_aca914d0-5f7b-465f-a024-75efa27d7291_ofqzcmfwncdv-master-1@ceph {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:10:46.409586 ncdv-master-1 sudo[140243]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_aca914d0-5f7b-465f-a024-75efa27d7291_ofqzcmfwncdv-master-1@ceph Dec 25 21:10:46.410597 ncdv-master-1 sudo[140243]: pam_unix(sudo:session): session opened for user root by (uid=0) Dec 25 21:10:47.051352 ncdv-master-1 sudo[140243]: pam_unix(sudo:session): session closed for user root Dec 25 21:10:47.053855 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_aca914d0-5f7b-465f-a024-75efa27d7291_ofqzcmfwncdv-master-1@ceph" returned: 0 in 0.843s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:10:47.054657 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.image_utils [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] aca914d0-5f7b-465f-a024-75efa27d7291 was vhdx, converting to raw {{(pid=129926) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:793}} Dec 25 21:10:47.056677 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_aca914d0-5f7b-465f-a024-75efa27d7291_ofqzcmfwncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmp09xfll_5 {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:10:47.104649 ncdv-master-1 sudo[140260]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_aca914d0-5f7b-465f-a024-75efa27d7291_ofqzcmfwncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmp09xfll_5 Dec 25 21:10:47.106161 ncdv-master-1 sudo[140260]: pam_unix(sudo:session): session opened for user root by (uid=0) Dec 25 21:10:49.162957 ncdv-master-1 sudo[140260]: pam_unix(sudo:session): session closed for user root Dec 25 21:10:49.166743 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_aca914d0-5f7b-465f-a024-75efa27d7291_ofqzcmfwncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmp09xfll_5" returned: 0 in 2.110s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:10:49.167815 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_aca914d0-5f7b-465f-a024-75efa27d7291_ofqzcmfwncdv-master-1@ceph {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:10:49.286901 ncdv-master-1 sudo[140284]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_aca914d0-5f7b-465f-a024-75efa27d7291_ofqzcmfwncdv-master-1@ceph Dec 25 21:10:49.288461 ncdv-master-1 sudo[140284]: pam_unix(sudo:session): session opened for user root by (uid=0) Dec 25 21:10:49.878634 ncdv-master-1 sudo[140284]: pam_unix(sudo:session): session closed for user root Dec 25 21:10:49.882832 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_aca914d0-5f7b-465f-a024-75efa27d7291_ofqzcmfwncdv-master-1@ceph" returned: 0 in 0.713s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:10:49.882832 ncdv-master-1 cinder-volume[129926]: WARNING py.warnings [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Dec 25 21:10:49.882832 ncdv-master-1 cinder-volume[129926]: debtcollector.deprecate( Dec 25 21:10:49.882832 ncdv-master-1 cinder-volume[129926]: Dec 25 21:10:49.882832 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.image_utils [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_aca914d0-5f7b-465f-a024-75efa27d7291_ofqzcmfwncdv-master-1@ceph, size 700.00 MB, duration 2.11 sec, destination /opt/stack/data/cinder/conversion/tmp09xfll_5 {{(pid=129926) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:412}} Dec 25 21:10:49.882832 ncdv-master-1 cinder-volume[129926]: INFO cinder.image.image_utils [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Converted 700.00 MB image at 331.55 MB/s Dec 25 21:10:49.884027 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:10:50.220533 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:10:50.235883 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Volume volume-98b6d31e-e760-499e-8962-7b22479c1e9a is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:10:50.367713 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] deleting rbd volume volume-98b6d31e-e760-499e-8962-7b22479c1e9a {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:10:55.190999 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Running cmd (subprocess): rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmp09xfll_5 volume-98b6d31e-e760-499e-8962-7b22479c1e9a --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:11:02.862022 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddf24fbb-483e-4ba5-980d-a22c94c166d7 tempest-LiveMigrationTest-920359968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:11:02.867979 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-ddf24fbb-483e-4ba5-980d-a22c94c166d7 tempest-LiveMigrationTest-920359968 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:11:02.868537 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-ddf24fbb-483e-4ba5-980d-a22c94c166d7 tempest-LiveMigrationTest-920359968 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:11:02.891313 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ddf24fbb-483e-4ba5-980d-a22c94c166d7 tempest-LiveMigrationTest-920359968 None] Flow 'volume_create_manager' (5d0a635f-ba28-4188-9f34-95ba87757d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:11:02.895733 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ddf24fbb-483e-4ba5-980d-a22c94c166d7 tempest-LiveMigrationTest-920359968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e8453ea-10c8-490c-8225-d97cdd0b724f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:11:02.904347 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-ddf24fbb-483e-4ba5-980d-a22c94c166d7 tempest-LiveMigrationTest-920359968 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:11:02.923749 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ddf24fbb-483e-4ba5-980d-a22c94c166d7 tempest-LiveMigrationTest-920359968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e8453ea-10c8-490c-8225-d97cdd0b724f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveMigrationTest-volume-153533382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ceac9d3a-b469-4d1c-92ba-9db241c60a47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc19d38e80ce426fa6d268838d133f13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:11:03Z,use_quota=True,user_id='9bf2eefd87de409785735fc802bc95ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:11:02.927683 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ddf24fbb-483e-4ba5-980d-a22c94c166d7 tempest-LiveMigrationTest-920359968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (209f00ed-b520-44a4-8c16-b7847d546b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:11:02.930286 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ddf24fbb-483e-4ba5-980d-a22c94c166d7 tempest-LiveMigrationTest-920359968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (209f00ed-b520-44a4-8c16-b7847d546b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:11:02.933241 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ddf24fbb-483e-4ba5-980d-a22c94c166d7 tempest-LiveMigrationTest-920359968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f624d0e-cd4d-47e0-89de-78ef0435719f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:11:02.936771 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ddf24fbb-483e-4ba5-980d-a22c94c166d7 tempest-LiveMigrationTest-920359968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f624d0e-cd4d-47e0-89de-78ef0435719f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ceac9d3a-b469-4d1c-92ba-9db241c60a47', 'volume_name': 'volume-ceac9d3a-b469-4d1c-92ba-9db241c60a47', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:11:02.939051 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ddf24fbb-483e-4ba5-980d-a22c94c166d7 tempest-LiveMigrationTest-920359968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30a51de2-c16f-48a6-b64f-9971c7496733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:11:02.942117 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ddf24fbb-483e-4ba5-980d-a22c94c166d7 tempest-LiveMigrationTest-920359968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30a51de2-c16f-48a6-b64f-9971c7496733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:11:02.944913 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ddf24fbb-483e-4ba5-980d-a22c94c166d7 tempest-LiveMigrationTest-920359968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eaab958-0962-48e1-ac99-f29f58272934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:11:02.946617 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-ddf24fbb-483e-4ba5-980d-a22c94c166d7 tempest-LiveMigrationTest-920359968 None] Volume ceac9d3a-b469-4d1c-92ba-9db241c60a47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ceac9d3a-b469-4d1c-92ba-9db241c60a47', 'volume_size': 1} Dec 25 21:11:02.946617 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ddf24fbb-483e-4ba5-980d-a22c94c166d7 tempest-LiveMigrationTest-920359968 None] creating volume 'volume-ceac9d3a-b469-4d1c-92ba-9db241c60a47' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:11:02.947282 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ddf24fbb-483e-4ba5-980d-a22c94c166d7 tempest-LiveMigrationTest-920359968 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:11:07.237513 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ddf24fbb-483e-4ba5-980d-a22c94c166d7 tempest-LiveMigrationTest-920359968 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:11:07.238254 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ddf24fbb-483e-4ba5-980d-a22c94c166d7 tempest-LiveMigrationTest-920359968 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:11:07.240860 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ddf24fbb-483e-4ba5-980d-a22c94c166d7 tempest-LiveMigrationTest-920359968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eaab958-0962-48e1-ac99-f29f58272934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ceac9d3a-b469-4d1c-92ba-9db241c60a47', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:11:07.243133 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ddf24fbb-483e-4ba5-980d-a22c94c166d7 tempest-LiveMigrationTest-920359968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (165baf35-acae-465b-b086-d1b88e4819d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:11:07.356188 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-ddf24fbb-483e-4ba5-980d-a22c94c166d7 tempest-LiveMigrationTest-920359968 None] Volume volume-ceac9d3a-b469-4d1c-92ba-9db241c60a47 (ceac9d3a-b469-4d1c-92ba-9db241c60a47): created successfully Dec 25 21:11:07.358189 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ddf24fbb-483e-4ba5-980d-a22c94c166d7 tempest-LiveMigrationTest-920359968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (165baf35-acae-465b-b086-d1b88e4819d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:11:07.365142 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ddf24fbb-483e-4ba5-980d-a22c94c166d7 tempest-LiveMigrationTest-920359968 None] Flow 'volume_create_manager' (5d0a635f-ba28-4188-9f34-95ba87757d51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:11:07.452701 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-ddf24fbb-483e-4ba5-980d-a22c94c166d7 tempest-LiveMigrationTest-920359968 None] Created volume successfully. Dec 25 21:11:09.211830 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-3c4d340b-2a98-40e8-b7ac-9ff74241e739 req-be7f970d-39cf-467d-8e6c-d3204a6942cd tempest-LiveMigrationTest-920359968 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:11:09.910638 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-3c4d340b-2a98-40e8-b7ac-9ff74241e739 req-be7f970d-39cf-467d-8e6c-d3204a6942cd tempest-LiveMigrationTest-920359968 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.698s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:11:09.911488 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-3c4d340b-2a98-40e8-b7ac-9ff74241e739 req-be7f970d-39cf-467d-8e6c-d3204a6942cd tempest-LiveMigrationTest-920359968 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ceac9d3a-b469-4d1c-92ba-9db241c60a47', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': 'ceac9d3a-b469-4d1c-92ba-9db241c60a47', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 21:11:10.019010 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-3c4d340b-2a98-40e8-b7ac-9ff74241e739 req-be7f970d-39cf-467d-8e6c-d3204a6942cd tempest-LiveMigrationTest-920359968 None] Connection info returned from driver {'name': 'volumes/volume-ceac9d3a-b469-4d1c-92ba-9db241c60a47', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ceac9d3a-b469-4d1c-92ba-9db241c60a47', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '22e59bea-0c26-494a-b590-23556de109ca'} {{(pid=129926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 25 21:11:10.291417 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-3c4d340b-2a98-40e8-b7ac-9ff74241e739 req-be7f970d-39cf-467d-8e6c-d3204a6942cd tempest-LiveMigrationTest-920359968 None] attachment_update completed successfully. Dec 25 21:11:19.087127 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-ee8b68c7-20d5-40ad-93af-cb444f7069c0 req-cef419ca-a8dc-44bd-8bf4-f5ce660bae68 tempest-LiveMigrationTest-1605081009 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:11:20.276683 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-ee8b68c7-20d5-40ad-93af-cb444f7069c0 req-cef419ca-a8dc-44bd-8bf4-f5ce660bae68 tempest-LiveMigrationTest-1605081009 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.189s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:11:20.277493 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-ee8b68c7-20d5-40ad-93af-cb444f7069c0 req-cef419ca-a8dc-44bd-8bf4-f5ce660bae68 tempest-LiveMigrationTest-1605081009 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ceac9d3a-b469-4d1c-92ba-9db241c60a47', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': 'ceac9d3a-b469-4d1c-92ba-9db241c60a47', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 21:11:20.453224 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-ee8b68c7-20d5-40ad-93af-cb444f7069c0 req-cef419ca-a8dc-44bd-8bf4-f5ce660bae68 tempest-LiveMigrationTest-1605081009 None] Connection info returned from driver {'name': 'volumes/volume-ceac9d3a-b469-4d1c-92ba-9db241c60a47', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ceac9d3a-b469-4d1c-92ba-9db241c60a47', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a3b7953f-6682-4617-8008-af8e5a8ae531'} {{(pid=129926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 25 21:11:20.696781 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-ee8b68c7-20d5-40ad-93af-cb444f7069c0 req-cef419ca-a8dc-44bd-8bf4-f5ce660bae68 tempest-LiveMigrationTest-1605081009 None] attachment_update completed successfully. Dec 25 21:11:29.536859 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:11:29.539750 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:11:29.566189 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:11:29.594953 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:11:37.922015 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-ee8b68c7-20d5-40ad-93af-cb444f7069c0 req-a1d81ae8-25f3-4e92-9eb0-7d5d3e19de5c tempest-LiveMigrationTest-1605081009 None] Terminate volume connection completed successfully. Dec 25 21:11:37.923452 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-ee8b68c7-20d5-40ad-93af-cb444f7069c0 req-a1d81ae8-25f3-4e92-9eb0-7d5d3e19de5c tempest-LiveMigrationTest-1605081009 None] Deleting attachment 22e59bea-0c26-494a-b590-23556de109ca. {{(pid=129926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 25 21:11:46.380015 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-7b990315-b001-4290-b312-bd994eeffdff req-9c829e29-220f-4c02-b6d0-1cae4401e93b tempest-LiveMigrationTest-920359968 None] Terminate volume connection completed successfully. Dec 25 21:11:46.380728 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-7b990315-b001-4290-b312-bd994eeffdff req-9c829e29-220f-4c02-b6d0-1cae4401e93b tempest-LiveMigrationTest-920359968 None] Deleting attachment a3b7953f-6682-4617-8008-af8e5a8ae531. {{(pid=129926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 25 21:11:48.077171 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-537bd6b0-52b6-45e4-894d-d9f038b56dea tempest-LiveMigrationTest-920359968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:11:48.081904 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-537bd6b0-52b6-45e4-894d-d9f038b56dea tempest-LiveMigrationTest-920359968 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:11:48.082396 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-537bd6b0-52b6-45e4-894d-d9f038b56dea tempest-LiveMigrationTest-920359968 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:11:48.094670 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-537bd6b0-52b6-45e4-894d-d9f038b56dea tempest-LiveMigrationTest-920359968 None] Flow 'volume_create_manager' (9480bfc1-9823-4074-bb60-05eb88411652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:11:48.098067 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-537bd6b0-52b6-45e4-894d-d9f038b56dea tempest-LiveMigrationTest-920359968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebcb5e8f-14aa-4435-afb5-9090caca5872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:11:48.104763 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-537bd6b0-52b6-45e4-894d-d9f038b56dea tempest-LiveMigrationTest-920359968 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:11:48.119649 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-537bd6b0-52b6-45e4-894d-d9f038b56dea tempest-LiveMigrationTest-920359968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebcb5e8f-14aa-4435-afb5-9090caca5872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1244108119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a4054058-9bcb-4981-a993-8da409df7a33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc19d38e80ce426fa6d268838d133f13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:11:48Z,use_quota=True,user_id='9bf2eefd87de409785735fc802bc95ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:11:48.122366 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-537bd6b0-52b6-45e4-894d-d9f038b56dea tempest-LiveMigrationTest-920359968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd2589e2-e37f-4782-86fd-15c51c1d42d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:11:48.124667 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-537bd6b0-52b6-45e4-894d-d9f038b56dea tempest-LiveMigrationTest-920359968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd2589e2-e37f-4782-86fd-15c51c1d42d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:11:48.127850 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-537bd6b0-52b6-45e4-894d-d9f038b56dea tempest-LiveMigrationTest-920359968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (229c61c4-fa7a-4696-b9d4-fb257ea8288b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:11:48.212719 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-537bd6b0-52b6-45e4-894d-d9f038b56dea tempest-LiveMigrationTest-920359968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (229c61c4-fa7a-4696-b9d4-fb257ea8288b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a4054058-9bcb-4981-a993-8da409df7a33', 'volume_name': 'volume-a4054058-9bcb-4981-a993-8da409df7a33', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:11:48.215981 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-537bd6b0-52b6-45e4-894d-d9f038b56dea tempest-LiveMigrationTest-920359968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d923c75-f714-4877-b74e-daaeb6d8029d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:11:48.218211 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-537bd6b0-52b6-45e4-894d-d9f038b56dea tempest-LiveMigrationTest-920359968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d923c75-f714-4877-b74e-daaeb6d8029d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:11:48.226534 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-537bd6b0-52b6-45e4-894d-d9f038b56dea tempest-LiveMigrationTest-920359968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1341654a-61bb-4f72-a43a-1b5ea44a9007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:11:48.226534 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-537bd6b0-52b6-45e4-894d-d9f038b56dea tempest-LiveMigrationTest-920359968 None] Volume a4054058-9bcb-4981-a993-8da409df7a33: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a4054058-9bcb-4981-a993-8da409df7a33', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 25 21:11:48.227277 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-537bd6b0-52b6-45e4-894d-d9f038b56dea tempest-LiveMigrationTest-920359968 None] Cloning a4054058-9bcb-4981-a993-8da409df7a33 from image aca914d0-5f7b-465f-a024-75efa27d7291 at location (None, None). {{(pid=129926) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Dec 25 21:11:53.801895 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] CMD "rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmp09xfll_5 volume-98b6d31e-e760-499e-8962-7b22479c1e9a --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 58.611s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:11:53.952763 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:11:55.120072 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:11:55.120643 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:11:55.120896 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.volume_utils [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Downloaded image aca914d0-5f7b-465f-a024-75efa27d7291 ((None, None)) to volume 98b6d31e-e760-499e-8962-7b22479c1e9a successfully. {{(pid=129926) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1268}} Dec 25 21:11:55.175642 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.image_utils [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Temporary image aca914d0-5f7b-465f-a024-75efa27d7291 for user 2cb2a59c7c9b4a13964c78ff0fb1a8f4 is deleted. {{(pid=129926) fetch /opt/stack/cinder/cinder/image/image_utils.py:1092}} Dec 25 21:11:55.309760 ncdv-master-1 cinder-volume[129926]: WARNING cinder.quota [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Deprecated: Default quota for resource: volumes_ceph is set by the default quota flag: quota_volumes_ceph, it is now deprecated. Please use the default quota class for default quota. Dec 25 21:11:55.310745 ncdv-master-1 cinder-volume[129926]: WARNING cinder.quota [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Deprecated: Default quota for resource: gigabytes_ceph is set by the default quota flag: quota_gigabytes_ceph, it is now deprecated. Please use the default quota class for default quota. Dec 25 21:11:55.635342 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Created reservations ['aef379ab-b1e3-484c-a475-3680428eebfb', '7dc8c038-6d2e-4576-bd97-29f8b0c9a995', 'a1b82e6e-96d0-4748-a930-3feb45d9c18d', '5b3c24b2-e5f2-43d5-ad99-ce3a13ff519b'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:11:55.646862 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Creating image volume entry: {'launched_at': None, 'created_at': datetime.datetime(2021, 12, 25, 21, 10, 24, tzinfo=datetime.timezone.utc), 'cluster_name': None, 'volume_type_id': 'f0b985cc-fdee-4ae1-b26b-c03f2f68353c', 'service_uuid': None, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'deleted_at': None, 'volume_admin_metadata': [], 'replication_status': None, 'consistencygroup_id': None, 'availability_zone': 'nova', 'deleted': False, 'group_id': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'size': 1, 'terminated_at': None, 'previous_status': None, 'scheduled_at': datetime.datetime(2021, 12, 25, 21, 10, 25, tzinfo=datetime.timezone.utc), 'provider_location': None, 'bootable': False, 'volume_metadata': [], 'display_description': None, 'ec2_id': None, 'volume_glance_metadata': [{'key': 'signature_verified', 'value': 'False'}], 'replication_driver_data': None, 'multiattach': False, 'provider_geometry': None, 'provider_auth': None, 'host': 'ncdv-master-1@ceph#ceph', 'replication_extended_status': None, 'metadata': {}, 'provider_id': None, 'display_name': 'image-aca914d0-5f7b-465f-a024-75efa27d7291', 'updated_at': datetime.datetime(2021, 12, 25, 21, 10, 25, tzinfo=datetime.timezone.utc), 'encryption_key_id': None, 'shared_targets': True, 'attach_status': 'detached', 'status': 'creating', 'source_volid': '98b6d31e-e760-499e-8962-7b22479c1e9a'}. {{(pid=129926) _clone_image_volume /opt/stack/cinder/cinder/volume/manager.py:1616}} Dec 25 21:11:56.093860 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Volume reschedule parameters: False retry: None {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:11:56.098303 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:11:56.098761 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:11:56.111928 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Flow 'volume_create_manager' (a034d247-af23-48fe-99b0-5e78899c016f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:11:56.115338 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3192bd1-c4a1-4e25-ba2a-3aa1df1e7395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:11:56.122130 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:11:56.137032 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3192bd1-c4a1-4e25-ba2a-3aa1df1e7395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='image-aca914d0-5f7b-465f-a024-75efa27d7291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=058f5fb3-51e4-40e3-9c98-542207f1fc1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8de2c022c7e473abd53e78670253e88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=98b6d31e-e760-499e-8962-7b22479c1e9a,status='creating',terminated_at=None,updated_at=2021-12-25T21:10:25Z,use_quota=True,user_id='2cb2a59c7c9b4a13964c78ff0fb1a8f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:11:56.146334 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b07ab855-74df-4e2c-8df2-0e86c871dd99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:11:56.146334 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b07ab855-74df-4e2c-8df2-0e86c871dd99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:11:56.147338 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f8dc80-b373-4f0e-b7f6-404481ed91fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:11:56.167308 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f8dc80-b373-4f0e-b7f6-404481ed91fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '058f5fb3-51e4-40e3-9c98-542207f1fc1f', 'volume_name': 'volume-058f5fb3-51e4-40e3-9c98-542207f1fc1f', 'volume_size': 1, 'source_volid': '98b6d31e-e760-499e-8962-7b22479c1e9a', 'source_volstatus': 'downloading'}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:11:56.171700 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4dfc493-d514-4e79-bb6a-a8684cee2507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:11:56.175852 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4dfc493-d514-4e79-bb6a-a8684cee2507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:11:56.180600 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33a0719f-f23b-4904-87c5-6619d5454ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:11:56.181667 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Volume 058f5fb3-51e4-40e3-9c98-542207f1fc1f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-058f5fb3-51e4-40e3-9c98-542207f1fc1f', 'volume_size': 1, 'source_volid': '98b6d31e-e760-499e-8962-7b22479c1e9a', 'source_volstatus': 'downloading'} Dec 25 21:11:56.200586 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:11:56.389293 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] creating snapshot='volume-058f5fb3-51e4-40e3-9c98-542207f1fc1f.clone_snap' {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 25 21:11:58.011736 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] cloning 'volume-98b6d31e-e760-499e-8962-7b22479c1e9a@volume-058f5fb3-51e4-40e3-9c98-542207f1fc1f.clone_snap' to 'volume-058f5fb3-51e4-40e3-9c98-542207f1fc1f' {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 25 21:11:59.132434 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Volume volume-98b6d31e-e760-499e-8962-7b22479c1e9a is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:11:59.134054 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:11:59.134598 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:11:59.518268 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] clone created successfully {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 25 21:11:59.520170 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33a0719f-f23b-4904-87c5-6619d5454ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-058f5fb3-51e4-40e3-9c98-542207f1fc1f', 'volume_size': 1, 'source_volid': '98b6d31e-e760-499e-8962-7b22479c1e9a', 'source_volstatus': 'downloading'}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:11:59.527249 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2911eb17-b338-4aa7-a3a0-4b5454638b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:11:59.606415 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Volume volume-058f5fb3-51e4-40e3-9c98-542207f1fc1f (058f5fb3-51e4-40e3-9c98-542207f1fc1f): created successfully Dec 25 21:11:59.608660 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2911eb17-b338-4aa7-a3a0-4b5454638b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:11:59.612417 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Flow 'volume_create_manager' (a034d247-af23-48fe-99b0-5e78899c016f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:11:59.785948 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Created volume successfully. Dec 25 21:11:59.978553 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Creating new image-volume cache entry for image aca914d0-5f7b-465f-a024-75efa27d7291 on ncdv-master-1@ceph#ceph {{(pid=129926) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:104}} Dec 25 21:12:00.089328 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] New image-volume cache entry created: {'id': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'volume_id': '058f5fb3-51e4-40e3-9c98-542207f1fc1f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31), 'last_used': datetime.datetime(2021, 12, 25, 21, 11, 59, 982929)}. {{(pid=129926) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:129}} Dec 25 21:12:00.098241 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Lock "b'cinder-aca914d0-5f7b-465f-a024-75efa27d7291'" released by "_prepare_image_cache_entry" :: held 94.563s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:12:00.098241 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.volume_utils [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Marking volume 98b6d31e-e760-499e-8962-7b22479c1e9a as bootable. {{(pid=129926) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 25 21:12:00.181338 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Copying metadata from image aca914d0-5f7b-465f-a024-75efa27d7291 to 98b6d31e-e760-499e-8962-7b22479c1e9a. {{(pid=129926) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Dec 25 21:12:00.184158 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Creating volume glance metadata for volume 98b6d31e-e760-499e-8962-7b22479c1e9a backed by image aca914d0-5f7b-465f-a024-75efa27d7291 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129926) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Dec 25 21:12:00.361442 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a56bb5b6-8cfb-44ee-b17d-14657620d6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98b6d31e-e760-499e-8962-7b22479c1e9a', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:12:00.363969 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f221258d-7493-4375-8554-e1912cbaf875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:12:00.540372 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Volume volume-98b6d31e-e760-499e-8962-7b22479c1e9a (98b6d31e-e760-499e-8962-7b22479c1e9a): created successfully Dec 25 21:12:00.546888 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f221258d-7493-4375-8554-e1912cbaf875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:12:00.552520 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Flow 'volume_create_manager' (bce95a1c-2747-4a3d-b27c-cdec885625e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:12:00.705684 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-e7999a31-13e9-4b43-ad0b-c142faf4e208 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Created volume successfully. Dec 25 21:12:01.110079 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-537bd6b0-52b6-45e4-894d-d9f038b56dea tempest-LiveMigrationTest-920359968 None] Lock "b'cinder-aca914d0-5f7b-465f-a024-75efa27d7291'" acquired by "_prepare_image_cache_entry" :: waited 12.886s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:12:01.206205 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-537bd6b0-52b6-45e4-894d-d9f038b56dea tempest-LiveMigrationTest-920359968 None] Found image-volume cache entry: {'id': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'volume_id': '058f5fb3-51e4-40e3-9c98-542207f1fc1f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31), 'last_used': datetime.datetime(2021, 12, 25, 21, 12, 1, 118976)}. {{(pid=129926) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 25 21:12:01.206873 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-537bd6b0-52b6-45e4-894d-d9f038b56dea tempest-LiveMigrationTest-920359968 None] Image-volume cache entry image_update_at = 2021-12-25 20:58:31+00:00, requested image updated_at = 2021-12-25 20:58:31+00:00. {{(pid=129926) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 25 21:12:01.207393 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-537bd6b0-52b6-45e4-894d-d9f038b56dea tempest-LiveMigrationTest-920359968 None] Found cache entry for image = aca914d0-5f7b-465f-a024-75efa27d7291 on host ncdv-master-1@ceph#ceph. {{(pid=129926) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Dec 25 21:12:01.216307 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-537bd6b0-52b6-45e4-894d-d9f038b56dea tempest-LiveMigrationTest-920359968 None] Lock "b'cinder-aca914d0-5f7b-465f-a024-75efa27d7291'" released by "_prepare_image_cache_entry" :: held 0.107s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:12:01.217880 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-537bd6b0-52b6-45e4-894d-d9f038b56dea tempest-LiveMigrationTest-920359968 None] Attempting to retrieve cache entry for image = aca914d0-5f7b-465f-a024-75efa27d7291 on host ncdv-master-1@ceph#ceph. {{(pid=129926) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Dec 25 21:12:01.226462 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-537bd6b0-52b6-45e4-894d-d9f038b56dea tempest-LiveMigrationTest-920359968 None] Found image-volume cache entry: {'id': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'volume_id': '058f5fb3-51e4-40e3-9c98-542207f1fc1f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31), 'last_used': datetime.datetime(2021, 12, 25, 21, 12, 1, 222845)}. {{(pid=129926) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 25 21:12:01.227204 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-537bd6b0-52b6-45e4-894d-d9f038b56dea tempest-LiveMigrationTest-920359968 None] Image-volume cache entry image_update_at = 2021-12-25 20:58:31+00:00, requested image updated_at = 2021-12-25 20:58:31+00:00. {{(pid=129926) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 25 21:12:01.227782 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-537bd6b0-52b6-45e4-894d-d9f038b56dea tempest-LiveMigrationTest-920359968 None] Creating from source image-volume 058f5fb3-51e4-40e3-9c98-542207f1fc1f {{(pid=129926) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Dec 25 21:12:01.241655 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-537bd6b0-52b6-45e4-894d-d9f038b56dea tempest-LiveMigrationTest-920359968 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:12:01.518988 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-537bd6b0-52b6-45e4-894d-d9f038b56dea tempest-LiveMigrationTest-920359968 None] creating snapshot='volume-a4054058-9bcb-4981-a993-8da409df7a33.clone_snap' {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 25 21:12:03.733413 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-537bd6b0-52b6-45e4-894d-d9f038b56dea tempest-LiveMigrationTest-920359968 None] cloning 'volume-058f5fb3-51e4-40e3-9c98-542207f1fc1f@volume-a4054058-9bcb-4981-a993-8da409df7a33.clone_snap' to 'volume-a4054058-9bcb-4981-a993-8da409df7a33' {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 25 21:12:05.027232 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-537bd6b0-52b6-45e4-894d-d9f038b56dea tempest-LiveMigrationTest-920359968 None] Volume volume-98b6d31e-e760-499e-8962-7b22479c1e9a is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:12:05.028282 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-537bd6b0-52b6-45e4-894d-d9f038b56dea tempest-LiveMigrationTest-920359968 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:12:05.028664 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-537bd6b0-52b6-45e4-894d-d9f038b56dea tempest-LiveMigrationTest-920359968 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:12:05.421934 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-537bd6b0-52b6-45e4-894d-d9f038b56dea tempest-LiveMigrationTest-920359968 None] clone created successfully {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 25 21:12:05.422620 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.volume_utils [None req-537bd6b0-52b6-45e4-894d-d9f038b56dea tempest-LiveMigrationTest-920359968 None] Marking volume a4054058-9bcb-4981-a993-8da409df7a33 as bootable. {{(pid=129926) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 25 21:12:05.521444 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-537bd6b0-52b6-45e4-894d-d9f038b56dea tempest-LiveMigrationTest-920359968 None] Copying metadata from image aca914d0-5f7b-465f-a024-75efa27d7291 to a4054058-9bcb-4981-a993-8da409df7a33. {{(pid=129926) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Dec 25 21:12:05.521766 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-537bd6b0-52b6-45e4-894d-d9f038b56dea tempest-LiveMigrationTest-920359968 None] Creating volume glance metadata for volume a4054058-9bcb-4981-a993-8da409df7a33 backed by image aca914d0-5f7b-465f-a024-75efa27d7291 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129926) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Dec 25 21:12:05.756674 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-537bd6b0-52b6-45e4-894d-d9f038b56dea tempest-LiveMigrationTest-920359968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1341654a-61bb-4f72-a43a-1b5ea44a9007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4054058-9bcb-4981-a993-8da409df7a33', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:12:05.758886 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-537bd6b0-52b6-45e4-894d-d9f038b56dea tempest-LiveMigrationTest-920359968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adcb664c-ace5-4adc-9a0a-e634bad7a1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:12:05.915062 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-537bd6b0-52b6-45e4-894d-d9f038b56dea tempest-LiveMigrationTest-920359968 None] Volume volume-a4054058-9bcb-4981-a993-8da409df7a33 (a4054058-9bcb-4981-a993-8da409df7a33): created successfully Dec 25 21:12:05.917075 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-537bd6b0-52b6-45e4-894d-d9f038b56dea tempest-LiveMigrationTest-920359968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adcb664c-ace5-4adc-9a0a-e634bad7a1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:12:05.920129 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-537bd6b0-52b6-45e4-894d-d9f038b56dea tempest-LiveMigrationTest-920359968 None] Flow 'volume_create_manager' (9480bfc1-9823-4074-bb60-05eb88411652) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:12:06.098799 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-537bd6b0-52b6-45e4-894d-d9f038b56dea tempest-LiveMigrationTest-920359968 None] Created volume successfully. Dec 25 21:12:06.549753 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-af2a4f7c-4f87-46dd-bdcc-fa2a17440517 req-18d40d56-daec-489d-977f-62733d2da443 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:12:07.409830 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-af2a4f7c-4f87-46dd-bdcc-fa2a17440517 req-18d40d56-daec-489d-977f-62733d2da443 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.860s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:12:07.411305 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-af2a4f7c-4f87-46dd-bdcc-fa2a17440517 req-18d40d56-daec-489d-977f-62733d2da443 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-98b6d31e-e760-499e-8962-7b22479c1e9a', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': '98b6d31e-e760-499e-8962-7b22479c1e9a', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 21:12:07.536748 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-af2a4f7c-4f87-46dd-bdcc-fa2a17440517 req-18d40d56-daec-489d-977f-62733d2da443 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Connection info returned from driver {'name': 'volumes/volume-98b6d31e-e760-499e-8962-7b22479c1e9a', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '98b6d31e-e760-499e-8962-7b22479c1e9a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '169db256-22ba-436c-a6f3-3aeca871c9ab'} {{(pid=129926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 25 21:12:07.650431 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-af2a4f7c-4f87-46dd-bdcc-fa2a17440517 req-18d40d56-daec-489d-977f-62733d2da443 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] attachment_update completed successfully. Dec 25 21:12:11.944526 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-e43d1935-dfc5-47c5-a094-a409d833ec97 req-11bc5099-8c7f-4bf3-bd28-841fdcc8d335 tempest-LiveMigrationTest-920359968 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:12:13.381027 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-e43d1935-dfc5-47c5-a094-a409d833ec97 req-11bc5099-8c7f-4bf3-bd28-841fdcc8d335 tempest-LiveMigrationTest-920359968 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.433s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:12:13.382609 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-e43d1935-dfc5-47c5-a094-a409d833ec97 req-11bc5099-8c7f-4bf3-bd28-841fdcc8d335 tempest-LiveMigrationTest-920359968 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a4054058-9bcb-4981-a993-8da409df7a33', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': 'a4054058-9bcb-4981-a993-8da409df7a33', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 21:12:13.524982 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-e43d1935-dfc5-47c5-a094-a409d833ec97 req-11bc5099-8c7f-4bf3-bd28-841fdcc8d335 tempest-LiveMigrationTest-920359968 None] Connection info returned from driver {'name': 'volumes/volume-a4054058-9bcb-4981-a993-8da409df7a33', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a4054058-9bcb-4981-a993-8da409df7a33', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '22e93f42-4900-4b84-8281-fd857f53ce94'} {{(pid=129926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 25 21:12:13.778523 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-e43d1935-dfc5-47c5-a094-a409d833ec97 req-11bc5099-8c7f-4bf3-bd28-841fdcc8d335 tempest-LiveMigrationTest-920359968 None] attachment_update completed successfully. Dec 25 21:12:29.541763 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:12:29.543070 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:12:29.602780 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:12:29.667579 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:12:33.202035 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-87657091-00c5-474f-a913-bd9f4b17de66 req-b83f3985-fab2-465a-8111-50dbdc47b2c1 tempest-LiveAutoBlockMigrationV225Test-952394939 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:12:33.976547 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-87657091-00c5-474f-a913-bd9f4b17de66 req-b83f3985-fab2-465a-8111-50dbdc47b2c1 tempest-LiveAutoBlockMigrationV225Test-952394939 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.774s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:12:33.977441 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-87657091-00c5-474f-a913-bd9f4b17de66 req-b83f3985-fab2-465a-8111-50dbdc47b2c1 tempest-LiveAutoBlockMigrationV225Test-952394939 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-98b6d31e-e760-499e-8962-7b22479c1e9a', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': '98b6d31e-e760-499e-8962-7b22479c1e9a', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 21:12:34.091645 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-87657091-00c5-474f-a913-bd9f4b17de66 req-b83f3985-fab2-465a-8111-50dbdc47b2c1 tempest-LiveAutoBlockMigrationV225Test-952394939 None] Connection info returned from driver {'name': 'volumes/volume-98b6d31e-e760-499e-8962-7b22479c1e9a', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '98b6d31e-e760-499e-8962-7b22479c1e9a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c4355108-c2f9-401e-beb3-9679b6d5aaae'} {{(pid=129926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 25 21:12:34.283927 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-87657091-00c5-474f-a913-bd9f4b17de66 req-b83f3985-fab2-465a-8111-50dbdc47b2c1 tempest-LiveAutoBlockMigrationV225Test-952394939 None] attachment_update completed successfully. Dec 25 21:12:40.090886 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-60e0cdc3-1da5-4eb9-a1e0-e232155ba7ad req-670933f8-f87e-4ce9-ba5b-d6d768beb777 tempest-LiveMigrationTest-1605081009 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:12:40.851323 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-60e0cdc3-1da5-4eb9-a1e0-e232155ba7ad req-670933f8-f87e-4ce9-ba5b-d6d768beb777 tempest-LiveMigrationTest-1605081009 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.760s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:12:40.852107 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-60e0cdc3-1da5-4eb9-a1e0-e232155ba7ad req-670933f8-f87e-4ce9-ba5b-d6d768beb777 tempest-LiveMigrationTest-1605081009 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a4054058-9bcb-4981-a993-8da409df7a33', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': 'a4054058-9bcb-4981-a993-8da409df7a33', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 21:12:40.934683 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-60e0cdc3-1da5-4eb9-a1e0-e232155ba7ad req-670933f8-f87e-4ce9-ba5b-d6d768beb777 tempest-LiveMigrationTest-1605081009 None] Connection info returned from driver {'name': 'volumes/volume-a4054058-9bcb-4981-a993-8da409df7a33', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a4054058-9bcb-4981-a993-8da409df7a33', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '9d387365-f08b-4a5b-9788-b449488c5615'} {{(pid=129926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 25 21:12:41.051362 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-60e0cdc3-1da5-4eb9-a1e0-e232155ba7ad req-670933f8-f87e-4ce9-ba5b-d6d768beb777 tempest-LiveMigrationTest-1605081009 None] attachment_update completed successfully. Dec 25 21:12:42.915234 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-87657091-00c5-474f-a913-bd9f4b17de66 req-101e2a88-6880-4546-94fa-68300157ef4b tempest-LiveAutoBlockMigrationV225Test-952394939 None] Terminate volume connection completed successfully. Dec 25 21:12:42.915845 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-87657091-00c5-474f-a913-bd9f4b17de66 req-101e2a88-6880-4546-94fa-68300157ef4b tempest-LiveAutoBlockMigrationV225Test-952394939 None] Deleting attachment 169db256-22ba-436c-a6f3-3aeca871c9ab. {{(pid=129926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 25 21:12:51.923433 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-60e0cdc3-1da5-4eb9-a1e0-e232155ba7ad req-bf455f88-8ac7-4eb6-92d0-49577c2663b7 tempest-LiveMigrationTest-1605081009 None] Terminate volume connection completed successfully. Dec 25 21:12:51.926412 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-60e0cdc3-1da5-4eb9-a1e0-e232155ba7ad req-bf455f88-8ac7-4eb6-92d0-49577c2663b7 tempest-LiveMigrationTest-1605081009 None] Deleting attachment 22e93f42-4900-4b84-8281-fd857f53ce94. {{(pid=129926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 25 21:12:55.587317 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-cfe14295-df88-45fd-8e14-a708056ef996 req-1802eb60-26f4-4e72-af4b-0ac067574243 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Terminate volume connection completed successfully. Dec 25 21:12:55.587978 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-cfe14295-df88-45fd-8e14-a708056ef996 req-1802eb60-26f4-4e72-af4b-0ac067574243 tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Deleting attachment c4355108-c2f9-401e-beb3-9679b6d5aaae. {{(pid=129926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 25 21:12:56.253765 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [req-cfe14295-df88-45fd-8e14-a708056ef996 req-8c992080-d3e9-41cb-bd5f-1c2b3530fa3b tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Lock "b'cinder-98b6d31e-e760-499e-8962-7b22479c1e9a-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:12:56.510593 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-cfe14295-df88-45fd-8e14-a708056ef996 req-8c992080-d3e9-41cb-bd5f-1c2b3530fa3b tempest-LiveAutoBlockMigrationV225Test-1233279863 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:12:57.049518 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-cfe14295-df88-45fd-8e14-a708056ef996 req-8c992080-d3e9-41cb-bd5f-1c2b3530fa3b tempest-LiveAutoBlockMigrationV225Test-1233279863 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:12:57.050083 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-cfe14295-df88-45fd-8e14-a708056ef996 req-8c992080-d3e9-41cb-bd5f-1c2b3530fa3b tempest-LiveAutoBlockMigrationV225Test-1233279863 None] volume has clone snapshot(s) {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1208}} Dec 25 21:12:57.052530 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-cfe14295-df88-45fd-8e14-a708056ef996 req-8c992080-d3e9-41cb-bd5f-1c2b3530fa3b tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Volume volume-98b6d31e-e760-499e-8962-7b22479c1e9a is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:12:58.472270 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-d2531aed-f138-4025-93a5-a1ad4a329c9c tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Lock "b'cinder-64f56b9c-4663-4274-84df-9ac590d6eef0-delete_volume'" acquired by "delete_volume" :: waited 0.033s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:12:58.745274 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-d2531aed-f138-4025-93a5-a1ad4a329c9c tempest-LiveAutoBlockMigrationV225Test-1233279863 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:12:59.131308 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-d2531aed-f138-4025-93a5-a1ad4a329c9c tempest-LiveAutoBlockMigrationV225Test-1233279863 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:12:59.132399 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-d2531aed-f138-4025-93a5-a1ad4a329c9c tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Volume volume-64f56b9c-4663-4274-84df-9ac590d6eef0 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:12:59.394025 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-d2531aed-f138-4025-93a5-a1ad4a329c9c tempest-LiveAutoBlockMigrationV225Test-1233279863 None] deleting rbd volume volume-64f56b9c-4663-4274-84df-9ac590d6eef0 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:13:01.008305 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [req-cfe14295-df88-45fd-8e14-a708056ef996 req-8c992080-d3e9-41cb-bd5f-1c2b3530fa3b tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Created reservations ['86cf2dee-5944-4c51-ba4f-13ba752f772f', '5dfa8e01-f087-416e-aa1c-d17860d5b0d9', '5bfa2df3-fea1-49e9-9489-a58644a48ddb', '727fb9ee-d99e-4003-895c-0816427e3a03'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:13:01.337841 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-cfe14295-df88-45fd-8e14-a708056ef996 req-8c992080-d3e9-41cb-bd5f-1c2b3530fa3b tempest-LiveAutoBlockMigrationV225Test-1233279863 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:13:01.391015 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-cfe14295-df88-45fd-8e14-a708056ef996 req-8c992080-d3e9-41cb-bd5f-1c2b3530fa3b tempest-LiveAutoBlockMigrationV225Test-1233279863 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:13:01.446458 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [req-cfe14295-df88-45fd-8e14-a708056ef996 req-8c992080-d3e9-41cb-bd5f-1c2b3530fa3b tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:13:01.452722 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-cfe14295-df88-45fd-8e14-a708056ef996 req-8c992080-d3e9-41cb-bd5f-1c2b3530fa3b tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Deleted volume successfully. Dec 25 21:13:01.561783 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [req-cfe14295-df88-45fd-8e14-a708056ef996 req-8c992080-d3e9-41cb-bd5f-1c2b3530fa3b tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Lock "b'cinder-98b6d31e-e760-499e-8962-7b22479c1e9a-delete_volume'" released by "delete_volume" :: held 5.308s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:13:07.478173 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-fd58a5a2-17a4-4782-82f3-e5401bae8382 req-bba96eaf-f9f3-4e8c-9b8e-328bc346c807 tempest-LiveMigrationTest-920359968 None] Terminate volume connection completed successfully. Dec 25 21:13:07.481218 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-fd58a5a2-17a4-4782-82f3-e5401bae8382 req-bba96eaf-f9f3-4e8c-9b8e-328bc346c807 tempest-LiveMigrationTest-920359968 None] Deleting attachment 9d387365-f08b-4a5b-9788-b449488c5615. {{(pid=129926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 25 21:13:07.700729 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-d2531aed-f138-4025-93a5-a1ad4a329c9c tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Created reservations ['e98bb819-ae42-4013-bacb-71e5dfcad7b1', '739bb100-9ad5-421b-83cb-e6f908ecd67c', '1a41ab41-32a7-40ab-bd10-edd4153dc606', '594284dc-f361-470b-9500-f8f02aa84ff7'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:13:08.034463 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-d2531aed-f138-4025-93a5-a1ad4a329c9c tempest-LiveAutoBlockMigrationV225Test-1233279863 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:13:08.111267 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-d2531aed-f138-4025-93a5-a1ad4a329c9c tempest-LiveAutoBlockMigrationV225Test-1233279863 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:13:08.173392 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-d2531aed-f138-4025-93a5-a1ad4a329c9c tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:13:08.192097 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-d2531aed-f138-4025-93a5-a1ad4a329c9c tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Deleted volume successfully. Dec 25 21:13:08.205296 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [req-fd58a5a2-17a4-4782-82f3-e5401bae8382 req-782f9473-7127-463a-b5c0-8305c38a5027 tempest-LiveMigrationTest-920359968 None] Lock "b'cinder-a4054058-9bcb-4981-a993-8da409df7a33-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:13:08.316714 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-d2531aed-f138-4025-93a5-a1ad4a329c9c tempest-LiveAutoBlockMigrationV225Test-1233279863 None] Lock "b'cinder-64f56b9c-4663-4274-84df-9ac590d6eef0-delete_volume'" released by "delete_volume" :: held 9.843s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:13:08.427161 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-fd58a5a2-17a4-4782-82f3-e5401bae8382 req-782f9473-7127-463a-b5c0-8305c38a5027 tempest-LiveMigrationTest-920359968 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:13:08.684949 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-fd58a5a2-17a4-4782-82f3-e5401bae8382 req-782f9473-7127-463a-b5c0-8305c38a5027 tempest-LiveMigrationTest-920359968 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:13:08.803462 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-fd58a5a2-17a4-4782-82f3-e5401bae8382 req-782f9473-7127-463a-b5c0-8305c38a5027 tempest-LiveMigrationTest-920359968 None] deleting rbd volume volume-a4054058-9bcb-4981-a993-8da409df7a33 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:13:09.474741 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-59d2ab10-2a54-42e1-a40c-5004d400bc75 tempest-LiveMigrationTest-920359968 None] Lock "b'cinder-ceac9d3a-b469-4d1c-92ba-9db241c60a47-delete_volume'" acquired by "delete_volume" :: waited 0.044s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:13:09.641853 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-59d2ab10-2a54-42e1-a40c-5004d400bc75 tempest-LiveMigrationTest-920359968 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:13:09.996281 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-59d2ab10-2a54-42e1-a40c-5004d400bc75 tempest-LiveMigrationTest-920359968 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:13:09.997536 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-59d2ab10-2a54-42e1-a40c-5004d400bc75 tempest-LiveMigrationTest-920359968 None] Volume volume-ceac9d3a-b469-4d1c-92ba-9db241c60a47 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:13:10.234498 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-59d2ab10-2a54-42e1-a40c-5004d400bc75 tempest-LiveMigrationTest-920359968 None] deleting rbd volume volume-ceac9d3a-b469-4d1c-92ba-9db241c60a47 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:13:17.131333 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-fd58a5a2-17a4-4782-82f3-e5401bae8382 req-782f9473-7127-463a-b5c0-8305c38a5027 tempest-LiveMigrationTest-920359968 None] volume is a clone so cleaning references {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 25 21:13:17.482620 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-fd58a5a2-17a4-4782-82f3-e5401bae8382 req-782f9473-7127-463a-b5c0-8305c38a5027 tempest-LiveMigrationTest-920359968 None] deleting parent snapshot volume-a4054058-9bcb-4981-a993-8da409df7a33.clone_snap {{(pid=129926) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 25 21:13:21.536254 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [req-fd58a5a2-17a4-4782-82f3-e5401bae8382 req-782f9473-7127-463a-b5c0-8305c38a5027 tempest-LiveMigrationTest-920359968 None] Created reservations ['136f3cb2-a78a-4078-bf9a-6651f7f0eae8', '20919b95-0ed3-4b73-87b0-cc7e6e2207df', 'e5518c1d-a064-4239-bfe1-15bd25efe172', '1d730fa1-2f62-4e4a-9ce8-6919656f56bd'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:13:21.631228 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-59d2ab10-2a54-42e1-a40c-5004d400bc75 tempest-LiveMigrationTest-920359968 None] Created reservations ['e9a812b0-9211-4b26-9483-456312d20e7b', '0ea87db6-c99c-40b4-ac71-58f1c631ddcb', '259d6441-cc12-4bbe-90e0-a3f2708d61e5', '71b1a00e-7375-4f35-ba0b-c2e885ca82cd'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:13:21.876041 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-fd58a5a2-17a4-4782-82f3-e5401bae8382 req-782f9473-7127-463a-b5c0-8305c38a5027 tempest-LiveMigrationTest-920359968 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:13:21.956115 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-fd58a5a2-17a4-4782-82f3-e5401bae8382 req-782f9473-7127-463a-b5c0-8305c38a5027 tempest-LiveMigrationTest-920359968 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:13:22.041572 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [req-fd58a5a2-17a4-4782-82f3-e5401bae8382 req-782f9473-7127-463a-b5c0-8305c38a5027 tempest-LiveMigrationTest-920359968 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:13:22.049602 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-fd58a5a2-17a4-4782-82f3-e5401bae8382 req-782f9473-7127-463a-b5c0-8305c38a5027 tempest-LiveMigrationTest-920359968 None] Deleted volume successfully. Dec 25 21:13:22.153145 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-59d2ab10-2a54-42e1-a40c-5004d400bc75 tempest-LiveMigrationTest-920359968 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:13:22.225009 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-59d2ab10-2a54-42e1-a40c-5004d400bc75 tempest-LiveMigrationTest-920359968 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:13:22.287569 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-59d2ab10-2a54-42e1-a40c-5004d400bc75 tempest-LiveMigrationTest-920359968 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:13:22.293353 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [req-fd58a5a2-17a4-4782-82f3-e5401bae8382 req-782f9473-7127-463a-b5c0-8305c38a5027 tempest-LiveMigrationTest-920359968 None] Lock "b'cinder-a4054058-9bcb-4981-a993-8da409df7a33-delete_volume'" released by "delete_volume" :: held 14.088s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:13:22.303764 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-59d2ab10-2a54-42e1-a40c-5004d400bc75 tempest-LiveMigrationTest-920359968 None] Deleted volume successfully. Dec 25 21:13:22.449748 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-59d2ab10-2a54-42e1-a40c-5004d400bc75 tempest-LiveMigrationTest-920359968 None] Lock "b'cinder-ceac9d3a-b469-4d1c-92ba-9db241c60a47-delete_volume'" released by "delete_volume" :: held 12.974s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:13:29.547153 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:13:29.548555 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:13:29.621151 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:13:29.719718 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:14:29.546577 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:14:29.547440 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:14:29.600417 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:14:29.658714 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:14:56.022032 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b5fa42e-6775-4096-9335-3acd9af5c35e tempest-AttachSCSIVolumeTestJSON-995789853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:14:56.027032 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-6b5fa42e-6775-4096-9335-3acd9af5c35e tempest-AttachSCSIVolumeTestJSON-995789853 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:14:56.027511 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-6b5fa42e-6775-4096-9335-3acd9af5c35e tempest-AttachSCSIVolumeTestJSON-995789853 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:14:56.059434 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6b5fa42e-6775-4096-9335-3acd9af5c35e tempest-AttachSCSIVolumeTestJSON-995789853 None] Flow 'volume_create_manager' (185166d7-f024-4d43-a10d-ce6b9f819c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:14:56.066533 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6b5fa42e-6775-4096-9335-3acd9af5c35e tempest-AttachSCSIVolumeTestJSON-995789853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b6ee612-9576-41b4-ae81-b8050a00eaf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:14:56.080120 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-6b5fa42e-6775-4096-9335-3acd9af5c35e tempest-AttachSCSIVolumeTestJSON-995789853 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:14:56.097276 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6b5fa42e-6775-4096-9335-3acd9af5c35e tempest-AttachSCSIVolumeTestJSON-995789853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b6ee612-9576-41b4-ae81-b8050a00eaf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:14:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-377395799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8168ed2c-3f3a-433f-bf62-dd30cfb188b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53cc391e03de44dbb245531288da2872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:14:56Z,use_quota=True,user_id='e3cb179749ef4bc786cc3059f72734f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:14:56.100256 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6b5fa42e-6775-4096-9335-3acd9af5c35e tempest-AttachSCSIVolumeTestJSON-995789853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1b6f8f2-5733-4a5c-a177-22adb2d234a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:14:56.102496 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6b5fa42e-6775-4096-9335-3acd9af5c35e tempest-AttachSCSIVolumeTestJSON-995789853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1b6f8f2-5733-4a5c-a177-22adb2d234a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:14:56.107398 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6b5fa42e-6775-4096-9335-3acd9af5c35e tempest-AttachSCSIVolumeTestJSON-995789853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58190bff-35de-4e30-adc8-ce36c8199ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:14:56.111128 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6b5fa42e-6775-4096-9335-3acd9af5c35e tempest-AttachSCSIVolumeTestJSON-995789853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58190bff-35de-4e30-adc8-ce36c8199ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8168ed2c-3f3a-433f-bf62-dd30cfb188b4', 'volume_name': 'volume-8168ed2c-3f3a-433f-bf62-dd30cfb188b4', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:14:56.114411 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6b5fa42e-6775-4096-9335-3acd9af5c35e tempest-AttachSCSIVolumeTestJSON-995789853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fabc54e-6bcc-4677-b129-fd88d83ac37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:14:56.116678 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6b5fa42e-6775-4096-9335-3acd9af5c35e tempest-AttachSCSIVolumeTestJSON-995789853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fabc54e-6bcc-4677-b129-fd88d83ac37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:14:56.120314 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6b5fa42e-6775-4096-9335-3acd9af5c35e tempest-AttachSCSIVolumeTestJSON-995789853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aa2bc93-c460-460b-97fa-e23d48603dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:14:56.121191 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-6b5fa42e-6775-4096-9335-3acd9af5c35e tempest-AttachSCSIVolumeTestJSON-995789853 None] Volume 8168ed2c-3f3a-433f-bf62-dd30cfb188b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8168ed2c-3f3a-433f-bf62-dd30cfb188b4', 'volume_size': 1} Dec 25 21:14:56.121988 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-6b5fa42e-6775-4096-9335-3acd9af5c35e tempest-AttachSCSIVolumeTestJSON-995789853 None] creating volume 'volume-8168ed2c-3f3a-433f-bf62-dd30cfb188b4' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:14:56.123083 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-6b5fa42e-6775-4096-9335-3acd9af5c35e tempest-AttachSCSIVolumeTestJSON-995789853 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:14:56.733210 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-6b5fa42e-6775-4096-9335-3acd9af5c35e tempest-AttachSCSIVolumeTestJSON-995789853 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:14:56.733864 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-6b5fa42e-6775-4096-9335-3acd9af5c35e tempest-AttachSCSIVolumeTestJSON-995789853 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:14:56.736332 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6b5fa42e-6775-4096-9335-3acd9af5c35e tempest-AttachSCSIVolumeTestJSON-995789853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aa2bc93-c460-460b-97fa-e23d48603dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8168ed2c-3f3a-433f-bf62-dd30cfb188b4', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:14:56.740080 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6b5fa42e-6775-4096-9335-3acd9af5c35e tempest-AttachSCSIVolumeTestJSON-995789853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (014af42a-5adb-4eeb-a616-e213dcccc79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:14:56.854561 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-6b5fa42e-6775-4096-9335-3acd9af5c35e tempest-AttachSCSIVolumeTestJSON-995789853 None] Volume volume-8168ed2c-3f3a-433f-bf62-dd30cfb188b4 (8168ed2c-3f3a-433f-bf62-dd30cfb188b4): created successfully Dec 25 21:14:56.856562 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6b5fa42e-6775-4096-9335-3acd9af5c35e tempest-AttachSCSIVolumeTestJSON-995789853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (014af42a-5adb-4eeb-a616-e213dcccc79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:14:56.859618 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6b5fa42e-6775-4096-9335-3acd9af5c35e tempest-AttachSCSIVolumeTestJSON-995789853 None] Flow 'volume_create_manager' (185166d7-f024-4d43-a10d-ce6b9f819c04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:14:56.999393 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-6b5fa42e-6775-4096-9335-3acd9af5c35e tempest-AttachSCSIVolumeTestJSON-995789853 None] Created volume successfully. Dec 25 21:14:59.292529 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-22905894-baaf-43e2-873c-e96e189e63c8 req-815699b0-4bd1-4a7f-adb5-c86821af4a2f tempest-AttachSCSIVolumeTestJSON-995789853 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:15:00.635888 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-22905894-baaf-43e2-873c-e96e189e63c8 req-815699b0-4bd1-4a7f-adb5-c86821af4a2f tempest-AttachSCSIVolumeTestJSON-995789853 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.344s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:15:00.638265 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-22905894-baaf-43e2-873c-e96e189e63c8 req-815699b0-4bd1-4a7f-adb5-c86821af4a2f tempest-AttachSCSIVolumeTestJSON-995789853 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-8168ed2c-3f3a-433f-bf62-dd30cfb188b4', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': '8168ed2c-3f3a-433f-bf62-dd30cfb188b4', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 21:15:00.758055 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-22905894-baaf-43e2-873c-e96e189e63c8 req-815699b0-4bd1-4a7f-adb5-c86821af4a2f tempest-AttachSCSIVolumeTestJSON-995789853 None] Connection info returned from driver {'name': 'volumes/volume-8168ed2c-3f3a-433f-bf62-dd30cfb188b4', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '8168ed2c-3f3a-433f-bf62-dd30cfb188b4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f9e81e64-f3f0-4398-a9a7-f84d55bd17ee'} {{(pid=129926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 25 21:15:00.877955 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-22905894-baaf-43e2-873c-e96e189e63c8 req-815699b0-4bd1-4a7f-adb5-c86821af4a2f tempest-AttachSCSIVolumeTestJSON-995789853 None] attachment_update completed successfully. Dec 25 21:15:04.751009 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-ee3f7291-cd00-43f7-9be5-3f299607ec1c req-03a6dabd-dd00-4922-8947-b1cc2a8d060e tempest-AttachSCSIVolumeTestJSON-995789853 None] Terminate volume connection completed successfully. Dec 25 21:15:04.751590 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-ee3f7291-cd00-43f7-9be5-3f299607ec1c req-03a6dabd-dd00-4922-8947-b1cc2a8d060e tempest-AttachSCSIVolumeTestJSON-995789853 None] Deleting attachment f9e81e64-f3f0-4398-a9a7-f84d55bd17ee. {{(pid=129926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 25 21:15:14.602421 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-cc8907fa-2a3c-42e4-8ccf-51d3e43b8e43 tempest-AttachSCSIVolumeTestJSON-995789853 None] Lock "b'cinder-8168ed2c-3f3a-433f-bf62-dd30cfb188b4-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:15:14.740081 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-cc8907fa-2a3c-42e4-8ccf-51d3e43b8e43 tempest-AttachSCSIVolumeTestJSON-995789853 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:15:14.882190 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-cc8907fa-2a3c-42e4-8ccf-51d3e43b8e43 tempest-AttachSCSIVolumeTestJSON-995789853 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:15:14.882858 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-cc8907fa-2a3c-42e4-8ccf-51d3e43b8e43 tempest-AttachSCSIVolumeTestJSON-995789853 None] Volume volume-8168ed2c-3f3a-433f-bf62-dd30cfb188b4 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:15:15.009041 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-cc8907fa-2a3c-42e4-8ccf-51d3e43b8e43 tempest-AttachSCSIVolumeTestJSON-995789853 None] deleting rbd volume volume-8168ed2c-3f3a-433f-bf62-dd30cfb188b4 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:15:18.591116 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-cc8907fa-2a3c-42e4-8ccf-51d3e43b8e43 tempest-AttachSCSIVolumeTestJSON-995789853 None] Created reservations ['4b7f8658-6889-4d01-bf4c-6645cf1c2b40', '40d2e6ca-4e25-4af2-95f2-0305cbe18dcc', '269b6895-d15b-4089-8fe9-b0bb12072344', '7672bccf-b58b-49ae-ac5e-25252d17cb02'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:15:18.806119 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-cc8907fa-2a3c-42e4-8ccf-51d3e43b8e43 tempest-AttachSCSIVolumeTestJSON-995789853 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:15:18.888594 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-cc8907fa-2a3c-42e4-8ccf-51d3e43b8e43 tempest-AttachSCSIVolumeTestJSON-995789853 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:15:18.956419 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-cc8907fa-2a3c-42e4-8ccf-51d3e43b8e43 tempest-AttachSCSIVolumeTestJSON-995789853 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:15:18.962589 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-cc8907fa-2a3c-42e4-8ccf-51d3e43b8e43 tempest-AttachSCSIVolumeTestJSON-995789853 None] Deleted volume successfully. Dec 25 21:15:19.069941 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-cc8907fa-2a3c-42e4-8ccf-51d3e43b8e43 tempest-AttachSCSIVolumeTestJSON-995789853 None] Lock "b'cinder-8168ed2c-3f3a-433f-bf62-dd30cfb188b4-delete_volume'" released by "delete_volume" :: held 4.468s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:15:29.551116 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:15:29.551821 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:15:29.587914 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:15:29.615603 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:16:29.551027 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:16:29.552579 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:16:29.604072 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:16:29.707768 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:16:46.933342 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e45853d-16e6-426a-a8f5-93e61df09814 tempest-VolumesAdminNegativeTest-1446759092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:16:46.938038 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-8e45853d-16e6-426a-a8f5-93e61df09814 tempest-VolumesAdminNegativeTest-1446759092 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:16:46.938823 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-8e45853d-16e6-426a-a8f5-93e61df09814 tempest-VolumesAdminNegativeTest-1446759092 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:16:46.970828 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8e45853d-16e6-426a-a8f5-93e61df09814 tempest-VolumesAdminNegativeTest-1446759092 None] Flow 'volume_create_manager' (d80eb88e-5bb4-4dc4-aa61-77e60a7cf92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:16:46.974889 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8e45853d-16e6-426a-a8f5-93e61df09814 tempest-VolumesAdminNegativeTest-1446759092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a5fc384-9b89-4f28-a334-6be7c86270b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:16:46.983382 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-8e45853d-16e6-426a-a8f5-93e61df09814 tempest-VolumesAdminNegativeTest-1446759092 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:16:46.996986 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8e45853d-16e6-426a-a8f5-93e61df09814 tempest-VolumesAdminNegativeTest-1446759092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a5fc384-9b89-4f28-a334-6be7c86270b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-569346332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=372213cb-a444-4b5e-a26a-0dcf9d722c47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef4a444bae614ca7b19f2e61052a4c6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:16:47Z,use_quota=True,user_id='82ec9d2698bd4b3f811022f3d8c458b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:16:47.000683 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8e45853d-16e6-426a-a8f5-93e61df09814 tempest-VolumesAdminNegativeTest-1446759092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d7dc90-0252-42fb-bd97-fc85c6889800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:16:47.003631 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8e45853d-16e6-426a-a8f5-93e61df09814 tempest-VolumesAdminNegativeTest-1446759092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d7dc90-0252-42fb-bd97-fc85c6889800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:16:47.012178 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8e45853d-16e6-426a-a8f5-93e61df09814 tempest-VolumesAdminNegativeTest-1446759092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1e5d06d-efdb-446f-a581-9a7fdcf9453e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:16:47.012178 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8e45853d-16e6-426a-a8f5-93e61df09814 tempest-VolumesAdminNegativeTest-1446759092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1e5d06d-efdb-446f-a581-9a7fdcf9453e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '372213cb-a444-4b5e-a26a-0dcf9d722c47', 'volume_name': 'volume-372213cb-a444-4b5e-a26a-0dcf9d722c47', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:16:47.013883 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8e45853d-16e6-426a-a8f5-93e61df09814 tempest-VolumesAdminNegativeTest-1446759092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28705070-118f-412e-b807-76ae88719a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:16:47.024265 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8e45853d-16e6-426a-a8f5-93e61df09814 tempest-VolumesAdminNegativeTest-1446759092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28705070-118f-412e-b807-76ae88719a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:16:47.027057 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8e45853d-16e6-426a-a8f5-93e61df09814 tempest-VolumesAdminNegativeTest-1446759092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b5d858-d048-4761-b916-197c4585985d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:16:47.028166 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-8e45853d-16e6-426a-a8f5-93e61df09814 tempest-VolumesAdminNegativeTest-1446759092 None] Volume 372213cb-a444-4b5e-a26a-0dcf9d722c47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-372213cb-a444-4b5e-a26a-0dcf9d722c47', 'volume_size': 1} Dec 25 21:16:47.028973 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-8e45853d-16e6-426a-a8f5-93e61df09814 tempest-VolumesAdminNegativeTest-1446759092 None] creating volume 'volume-372213cb-a444-4b5e-a26a-0dcf9d722c47' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:16:47.030181 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-8e45853d-16e6-426a-a8f5-93e61df09814 tempest-VolumesAdminNegativeTest-1446759092 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:16:47.581183 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-8e45853d-16e6-426a-a8f5-93e61df09814 tempest-VolumesAdminNegativeTest-1446759092 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:16:47.581880 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-8e45853d-16e6-426a-a8f5-93e61df09814 tempest-VolumesAdminNegativeTest-1446759092 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:16:47.584792 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8e45853d-16e6-426a-a8f5-93e61df09814 tempest-VolumesAdminNegativeTest-1446759092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b5d858-d048-4761-b916-197c4585985d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-372213cb-a444-4b5e-a26a-0dcf9d722c47', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:16:47.587370 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8e45853d-16e6-426a-a8f5-93e61df09814 tempest-VolumesAdminNegativeTest-1446759092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e9f69a-5281-4fe2-aa72-76e653eb4ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:16:47.674315 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-8e45853d-16e6-426a-a8f5-93e61df09814 tempest-VolumesAdminNegativeTest-1446759092 None] Volume volume-372213cb-a444-4b5e-a26a-0dcf9d722c47 (372213cb-a444-4b5e-a26a-0dcf9d722c47): created successfully Dec 25 21:16:47.684922 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8e45853d-16e6-426a-a8f5-93e61df09814 tempest-VolumesAdminNegativeTest-1446759092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e9f69a-5281-4fe2-aa72-76e653eb4ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:16:47.684922 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8e45853d-16e6-426a-a8f5-93e61df09814 tempest-VolumesAdminNegativeTest-1446759092 None] Flow 'volume_create_manager' (d80eb88e-5bb4-4dc4-aa61-77e60a7cf92a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:16:47.782159 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-8e45853d-16e6-426a-a8f5-93e61df09814 tempest-VolumesAdminNegativeTest-1446759092 None] Created volume successfully. Dec 25 21:16:50.144240 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-4374586d-ba5d-43af-b145-c7b0be188302 req-00027ecb-2655-4bb5-95a5-e217f0cd5b7f tempest-VolumesAdminNegativeTest-1446759092 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:16:51.053443 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-4374586d-ba5d-43af-b145-c7b0be188302 req-00027ecb-2655-4bb5-95a5-e217f0cd5b7f tempest-VolumesAdminNegativeTest-1446759092 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.913s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:16:51.054165 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-4374586d-ba5d-43af-b145-c7b0be188302 req-00027ecb-2655-4bb5-95a5-e217f0cd5b7f tempest-VolumesAdminNegativeTest-1446759092 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-372213cb-a444-4b5e-a26a-0dcf9d722c47', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': '372213cb-a444-4b5e-a26a-0dcf9d722c47', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 21:16:51.153731 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-4374586d-ba5d-43af-b145-c7b0be188302 req-00027ecb-2655-4bb5-95a5-e217f0cd5b7f tempest-VolumesAdminNegativeTest-1446759092 None] Connection info returned from driver {'name': 'volumes/volume-372213cb-a444-4b5e-a26a-0dcf9d722c47', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '372213cb-a444-4b5e-a26a-0dcf9d722c47', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '5971d184-75da-48f7-878d-833254fcf276'} {{(pid=129926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 25 21:16:51.395827 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-4374586d-ba5d-43af-b145-c7b0be188302 req-00027ecb-2655-4bb5-95a5-e217f0cd5b7f tempest-VolumesAdminNegativeTest-1446759092 None] attachment_update completed successfully. Dec 25 21:16:55.903400 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-05560dcd-1090-4029-8813-9a1ea89686ee req-ff7d01b0-6cb0-4188-a076-0744467fe033 tempest-VolumesAdminNegativeTest-1446759092 None] Terminate volume connection completed successfully. Dec 25 21:16:55.905171 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-05560dcd-1090-4029-8813-9a1ea89686ee req-ff7d01b0-6cb0-4188-a076-0744467fe033 tempest-VolumesAdminNegativeTest-1446759092 None] Deleting attachment 5971d184-75da-48f7-878d-833254fcf276. {{(pid=129926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 25 21:16:57.554641 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ae45683-a6a1-4471-bf20-581cf0a55f8d tempest-VolumesAdminNegativeTest-1446759092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:16:57.559224 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-4ae45683-a6a1-4471-bf20-581cf0a55f8d tempest-VolumesAdminNegativeTest-1446759092 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:16:57.559733 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-4ae45683-a6a1-4471-bf20-581cf0a55f8d tempest-VolumesAdminNegativeTest-1446759092 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:16:57.573331 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-4ae45683-a6a1-4471-bf20-581cf0a55f8d tempest-VolumesAdminNegativeTest-1446759092 None] Flow 'volume_create_manager' (ff324e9e-8636-4da4-a3e4-c8d2e97937ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:16:57.577435 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-4ae45683-a6a1-4471-bf20-581cf0a55f8d tempest-VolumesAdminNegativeTest-1446759092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9855ec4e-7f54-4c0d-a6c5-c8e68165afd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:16:57.584620 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-4ae45683-a6a1-4471-bf20-581cf0a55f8d tempest-VolumesAdminNegativeTest-1446759092 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:16:57.597691 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-4ae45683-a6a1-4471-bf20-581cf0a55f8d tempest-VolumesAdminNegativeTest-1446759092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9855ec4e-7f54-4c0d-a6c5-c8e68165afd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-999833078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f296f6a8-189b-4e64-90ca-f36c76a1e788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef4a444bae614ca7b19f2e61052a4c6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:16:57Z,use_quota=True,user_id='82ec9d2698bd4b3f811022f3d8c458b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:16:57.600344 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-4ae45683-a6a1-4471-bf20-581cf0a55f8d tempest-VolumesAdminNegativeTest-1446759092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3a501db-4ddf-4c49-a01e-5e2692ab4948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:16:57.602632 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-4ae45683-a6a1-4471-bf20-581cf0a55f8d tempest-VolumesAdminNegativeTest-1446759092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3a501db-4ddf-4c49-a01e-5e2692ab4948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:16:57.605092 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-4ae45683-a6a1-4471-bf20-581cf0a55f8d tempest-VolumesAdminNegativeTest-1446759092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1a15a2f-7bc7-4077-b8f8-76041481ef22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:16:57.607398 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-4ae45683-a6a1-4471-bf20-581cf0a55f8d tempest-VolumesAdminNegativeTest-1446759092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1a15a2f-7bc7-4077-b8f8-76041481ef22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f296f6a8-189b-4e64-90ca-f36c76a1e788', 'volume_name': 'volume-f296f6a8-189b-4e64-90ca-f36c76a1e788', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:16:57.609836 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-4ae45683-a6a1-4471-bf20-581cf0a55f8d tempest-VolumesAdminNegativeTest-1446759092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9954ce4c-3107-4a1e-a4ae-5501b1f8ecf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:16:57.612011 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-4ae45683-a6a1-4471-bf20-581cf0a55f8d tempest-VolumesAdminNegativeTest-1446759092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9954ce4c-3107-4a1e-a4ae-5501b1f8ecf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:16:57.614306 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-4ae45683-a6a1-4471-bf20-581cf0a55f8d tempest-VolumesAdminNegativeTest-1446759092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65c20535-c527-467e-8a91-6c33476a30cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:16:57.615131 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-4ae45683-a6a1-4471-bf20-581cf0a55f8d tempest-VolumesAdminNegativeTest-1446759092 None] Volume f296f6a8-189b-4e64-90ca-f36c76a1e788: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f296f6a8-189b-4e64-90ca-f36c76a1e788', 'volume_size': 1} Dec 25 21:16:57.615541 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-4ae45683-a6a1-4471-bf20-581cf0a55f8d tempest-VolumesAdminNegativeTest-1446759092 None] creating volume 'volume-f296f6a8-189b-4e64-90ca-f36c76a1e788' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:16:57.616703 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-4ae45683-a6a1-4471-bf20-581cf0a55f8d tempest-VolumesAdminNegativeTest-1446759092 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:16:58.355912 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-4ae45683-a6a1-4471-bf20-581cf0a55f8d tempest-VolumesAdminNegativeTest-1446759092 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:16:58.356729 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-4ae45683-a6a1-4471-bf20-581cf0a55f8d tempest-VolumesAdminNegativeTest-1446759092 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:16:58.359637 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-4ae45683-a6a1-4471-bf20-581cf0a55f8d tempest-VolumesAdminNegativeTest-1446759092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65c20535-c527-467e-8a91-6c33476a30cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f296f6a8-189b-4e64-90ca-f36c76a1e788', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:16:58.371815 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-4ae45683-a6a1-4471-bf20-581cf0a55f8d tempest-VolumesAdminNegativeTest-1446759092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0fea437-78a5-4323-99f1-a50b750fe0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:16:58.445200 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-4ae45683-a6a1-4471-bf20-581cf0a55f8d tempest-VolumesAdminNegativeTest-1446759092 None] Volume volume-f296f6a8-189b-4e64-90ca-f36c76a1e788 (f296f6a8-189b-4e64-90ca-f36c76a1e788): created successfully Dec 25 21:16:58.447275 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-4ae45683-a6a1-4471-bf20-581cf0a55f8d tempest-VolumesAdminNegativeTest-1446759092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0fea437-78a5-4323-99f1-a50b750fe0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:16:58.450277 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-4ae45683-a6a1-4471-bf20-581cf0a55f8d tempest-VolumesAdminNegativeTest-1446759092 None] Flow 'volume_create_manager' (ff324e9e-8636-4da4-a3e4-c8d2e97937ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:16:58.513583 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-4ae45683-a6a1-4471-bf20-581cf0a55f8d tempest-VolumesAdminNegativeTest-1446759092 None] Created volume successfully. Dec 25 21:16:59.498221 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-d83917e0-71ae-46fb-b156-f2cbc812acd8 tempest-DeleteServersTestJSON-404477660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:16:59.501797 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-d83917e0-71ae-46fb-b156-f2cbc812acd8 tempest-DeleteServersTestJSON-404477660 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:16:59.502536 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-d83917e0-71ae-46fb-b156-f2cbc812acd8 tempest-DeleteServersTestJSON-404477660 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:16:59.523951 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-d83917e0-71ae-46fb-b156-f2cbc812acd8 tempest-DeleteServersTestJSON-404477660 None] Flow 'volume_create_manager' (dd7996b6-2a76-49c4-9c8c-0cee6632f6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:16:59.523951 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-d83917e0-71ae-46fb-b156-f2cbc812acd8 tempest-DeleteServersTestJSON-404477660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (068d4998-bbca-4ba8-9cd8-7bfa2ea47796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:16:59.529861 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-d83917e0-71ae-46fb-b156-f2cbc812acd8 tempest-DeleteServersTestJSON-404477660 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:16:59.545912 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-d83917e0-71ae-46fb-b156-f2cbc812acd8 tempest-DeleteServersTestJSON-404477660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (068d4998-bbca-4ba8-9cd8-7bfa2ea47796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2140290280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=451b93e3-1579-44a1-b05d-3475df3c0e22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8154e82a58434a60b677d150202a5312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:16:59Z,use_quota=True,user_id='ed831822eb3542a88f70914466c36603',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:16:59.552166 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-d83917e0-71ae-46fb-b156-f2cbc812acd8 tempest-DeleteServersTestJSON-404477660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fbf8e0b-0e3b-4358-a3d3-71e68435ad1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:16:59.552166 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-d83917e0-71ae-46fb-b156-f2cbc812acd8 tempest-DeleteServersTestJSON-404477660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fbf8e0b-0e3b-4358-a3d3-71e68435ad1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:16:59.554175 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-d83917e0-71ae-46fb-b156-f2cbc812acd8 tempest-DeleteServersTestJSON-404477660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (880b19de-2d8a-49be-9be9-7bf693640de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:16:59.556772 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-d83917e0-71ae-46fb-b156-f2cbc812acd8 tempest-DeleteServersTestJSON-404477660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (880b19de-2d8a-49be-9be9-7bf693640de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '451b93e3-1579-44a1-b05d-3475df3c0e22', 'volume_name': 'volume-451b93e3-1579-44a1-b05d-3475df3c0e22', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:16:59.559125 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-d83917e0-71ae-46fb-b156-f2cbc812acd8 tempest-DeleteServersTestJSON-404477660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acafaa8c-3ac4-4dec-942c-a63bae030123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:16:59.561306 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-d83917e0-71ae-46fb-b156-f2cbc812acd8 tempest-DeleteServersTestJSON-404477660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acafaa8c-3ac4-4dec-942c-a63bae030123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:16:59.563469 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-d83917e0-71ae-46fb-b156-f2cbc812acd8 tempest-DeleteServersTestJSON-404477660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab0f87ea-0514-4890-bec5-ef5bfac0032b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:16:59.564279 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-d83917e0-71ae-46fb-b156-f2cbc812acd8 tempest-DeleteServersTestJSON-404477660 None] Volume 451b93e3-1579-44a1-b05d-3475df3c0e22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-451b93e3-1579-44a1-b05d-3475df3c0e22', 'volume_size': 1} Dec 25 21:16:59.564672 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-d83917e0-71ae-46fb-b156-f2cbc812acd8 tempest-DeleteServersTestJSON-404477660 None] creating volume 'volume-451b93e3-1579-44a1-b05d-3475df3c0e22' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:16:59.565706 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-d83917e0-71ae-46fb-b156-f2cbc812acd8 tempest-DeleteServersTestJSON-404477660 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:16:59.804907 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-f9f2be0a-01d1-4173-b4b6-8a59c59ce6fd tempest-VolumesAdminNegativeTest-1446759092 None] Lock "b'cinder-f296f6a8-189b-4e64-90ca-f36c76a1e788-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:16:59.901195 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f9f2be0a-01d1-4173-b4b6-8a59c59ce6fd tempest-VolumesAdminNegativeTest-1446759092 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:17:00.169285 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f9f2be0a-01d1-4173-b4b6-8a59c59ce6fd tempest-VolumesAdminNegativeTest-1446759092 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:17:00.169734 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f9f2be0a-01d1-4173-b4b6-8a59c59ce6fd tempest-VolumesAdminNegativeTest-1446759092 None] Volume volume-f296f6a8-189b-4e64-90ca-f36c76a1e788 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:17:00.450684 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f9f2be0a-01d1-4173-b4b6-8a59c59ce6fd tempest-VolumesAdminNegativeTest-1446759092 None] deleting rbd volume volume-f296f6a8-189b-4e64-90ca-f36c76a1e788 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:17:00.478815 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-d83917e0-71ae-46fb-b156-f2cbc812acd8 tempest-DeleteServersTestJSON-404477660 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:17:00.479525 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-d83917e0-71ae-46fb-b156-f2cbc812acd8 tempest-DeleteServersTestJSON-404477660 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:17:00.481920 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-d83917e0-71ae-46fb-b156-f2cbc812acd8 tempest-DeleteServersTestJSON-404477660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab0f87ea-0514-4890-bec5-ef5bfac0032b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-451b93e3-1579-44a1-b05d-3475df3c0e22', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:17:00.489105 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-d83917e0-71ae-46fb-b156-f2cbc812acd8 tempest-DeleteServersTestJSON-404477660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b83a117-4eb0-459c-92ad-855bbcb53259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:17:00.576065 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-d83917e0-71ae-46fb-b156-f2cbc812acd8 tempest-DeleteServersTestJSON-404477660 None] Volume volume-451b93e3-1579-44a1-b05d-3475df3c0e22 (451b93e3-1579-44a1-b05d-3475df3c0e22): created successfully Dec 25 21:17:00.578320 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-d83917e0-71ae-46fb-b156-f2cbc812acd8 tempest-DeleteServersTestJSON-404477660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b83a117-4eb0-459c-92ad-855bbcb53259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:17:00.582457 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-d83917e0-71ae-46fb-b156-f2cbc812acd8 tempest-DeleteServersTestJSON-404477660 None] Flow 'volume_create_manager' (dd7996b6-2a76-49c4-9c8c-0cee6632f6ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:17:00.702323 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-d83917e0-71ae-46fb-b156-f2cbc812acd8 tempest-DeleteServersTestJSON-404477660 None] Created volume successfully. Dec 25 21:17:02.607402 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-825ba3ac-f75f-4ab6-8b1e-4ff486899800 tempest-AttachVolumeTestJSON-100156046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:17:02.607402 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-825ba3ac-f75f-4ab6-8b1e-4ff486899800 tempest-AttachVolumeTestJSON-100156046 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:17:02.608332 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-825ba3ac-f75f-4ab6-8b1e-4ff486899800 tempest-AttachVolumeTestJSON-100156046 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:17:02.623421 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-825ba3ac-f75f-4ab6-8b1e-4ff486899800 tempest-AttachVolumeTestJSON-100156046 None] Flow 'volume_create_manager' (847ba476-acb1-4410-b21e-615c13f79cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:17:02.627516 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-825ba3ac-f75f-4ab6-8b1e-4ff486899800 tempest-AttachVolumeTestJSON-100156046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a2daf1f-ae75-4637-9ca9-3189f710b457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:17:02.636224 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-825ba3ac-f75f-4ab6-8b1e-4ff486899800 tempest-AttachVolumeTestJSON-100156046 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:17:02.664669 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-825ba3ac-f75f-4ab6-8b1e-4ff486899800 tempest-AttachVolumeTestJSON-100156046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a2daf1f-ae75-4637-9ca9-3189f710b457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:17:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2054293372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9ddbed29-7029-4b8d-ab16-b904195f2582,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ed80be6e633499b9d1dc61c05014afc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:17:02Z,use_quota=True,user_id='d0383b7f61484347ba9875a2636e1057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:17:02.667626 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-825ba3ac-f75f-4ab6-8b1e-4ff486899800 tempest-AttachVolumeTestJSON-100156046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d300b964-00c9-4078-8866-3f7d38b5492f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:17:02.670042 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-825ba3ac-f75f-4ab6-8b1e-4ff486899800 tempest-AttachVolumeTestJSON-100156046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d300b964-00c9-4078-8866-3f7d38b5492f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:17:02.672757 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-825ba3ac-f75f-4ab6-8b1e-4ff486899800 tempest-AttachVolumeTestJSON-100156046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd04c202-9e79-45a9-908f-1d673bb8e30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:17:02.675861 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-825ba3ac-f75f-4ab6-8b1e-4ff486899800 tempest-AttachVolumeTestJSON-100156046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd04c202-9e79-45a9-908f-1d673bb8e30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ddbed29-7029-4b8d-ab16-b904195f2582', 'volume_name': 'volume-9ddbed29-7029-4b8d-ab16-b904195f2582', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:17:02.678983 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-825ba3ac-f75f-4ab6-8b1e-4ff486899800 tempest-AttachVolumeTestJSON-100156046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef5236b8-a1ac-40d6-9404-bfd96520b961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:17:02.681648 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-825ba3ac-f75f-4ab6-8b1e-4ff486899800 tempest-AttachVolumeTestJSON-100156046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef5236b8-a1ac-40d6-9404-bfd96520b961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:17:02.684433 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-825ba3ac-f75f-4ab6-8b1e-4ff486899800 tempest-AttachVolumeTestJSON-100156046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c303f8c0-4cf5-4803-b7f4-0d2f65b81dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:17:02.685287 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-825ba3ac-f75f-4ab6-8b1e-4ff486899800 tempest-AttachVolumeTestJSON-100156046 None] Volume 9ddbed29-7029-4b8d-ab16-b904195f2582: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ddbed29-7029-4b8d-ab16-b904195f2582', 'volume_size': 1} Dec 25 21:17:02.685675 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-825ba3ac-f75f-4ab6-8b1e-4ff486899800 tempest-AttachVolumeTestJSON-100156046 None] creating volume 'volume-9ddbed29-7029-4b8d-ab16-b904195f2582' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:17:02.687208 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-825ba3ac-f75f-4ab6-8b1e-4ff486899800 tempest-AttachVolumeTestJSON-100156046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:17:02.749721 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-0906711e-e169-4710-90e7-75f368b1146a req-32b0926d-3c12-4e5d-82bd-e21a5ad9cba8 tempest-DeleteServersTestJSON-404477660 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:17:03.547553 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-0906711e-e169-4710-90e7-75f368b1146a req-32b0926d-3c12-4e5d-82bd-e21a5ad9cba8 tempest-DeleteServersTestJSON-404477660 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.798s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:17:03.549312 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-0906711e-e169-4710-90e7-75f368b1146a req-32b0926d-3c12-4e5d-82bd-e21a5ad9cba8 tempest-DeleteServersTestJSON-404477660 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-451b93e3-1579-44a1-b05d-3475df3c0e22', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': '451b93e3-1579-44a1-b05d-3475df3c0e22', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 21:17:03.579355 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-825ba3ac-f75f-4ab6-8b1e-4ff486899800 tempest-AttachVolumeTestJSON-100156046 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:17:03.579739 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-825ba3ac-f75f-4ab6-8b1e-4ff486899800 tempest-AttachVolumeTestJSON-100156046 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:17:03.584670 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-825ba3ac-f75f-4ab6-8b1e-4ff486899800 tempest-AttachVolumeTestJSON-100156046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c303f8c0-4cf5-4803-b7f4-0d2f65b81dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ddbed29-7029-4b8d-ab16-b904195f2582', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:17:03.587578 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-825ba3ac-f75f-4ab6-8b1e-4ff486899800 tempest-AttachVolumeTestJSON-100156046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5f35c64-86e6-443a-bd31-234790ed7eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:17:03.668711 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-825ba3ac-f75f-4ab6-8b1e-4ff486899800 tempest-AttachVolumeTestJSON-100156046 None] Volume volume-9ddbed29-7029-4b8d-ab16-b904195f2582 (9ddbed29-7029-4b8d-ab16-b904195f2582): created successfully Dec 25 21:17:03.670925 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-825ba3ac-f75f-4ab6-8b1e-4ff486899800 tempest-AttachVolumeTestJSON-100156046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5f35c64-86e6-443a-bd31-234790ed7eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:17:03.674623 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-825ba3ac-f75f-4ab6-8b1e-4ff486899800 tempest-AttachVolumeTestJSON-100156046 None] Flow 'volume_create_manager' (847ba476-acb1-4410-b21e-615c13f79cf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:17:03.696444 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-0906711e-e169-4710-90e7-75f368b1146a req-32b0926d-3c12-4e5d-82bd-e21a5ad9cba8 tempest-DeleteServersTestJSON-404477660 None] Connection info returned from driver {'name': 'volumes/volume-451b93e3-1579-44a1-b05d-3475df3c0e22', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '451b93e3-1579-44a1-b05d-3475df3c0e22', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c7310b61-c9a1-4532-a83a-9c50a806445d'} {{(pid=129926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 25 21:17:03.754745 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-825ba3ac-f75f-4ab6-8b1e-4ff486899800 tempest-AttachVolumeTestJSON-100156046 None] Created volume successfully. Dec 25 21:17:03.818967 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-0906711e-e169-4710-90e7-75f368b1146a req-32b0926d-3c12-4e5d-82bd-e21a5ad9cba8 tempest-DeleteServersTestJSON-404477660 None] attachment_update completed successfully. Dec 25 21:17:04.337289 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-f9f2be0a-01d1-4173-b4b6-8a59c59ce6fd tempest-VolumesAdminNegativeTest-1446759092 None] Created reservations ['7c226d06-0d55-442a-9c94-5e3f1e4b9fa8', 'b49c31ea-bb92-4adc-bf7f-59cf096cfbef', '6bb289d1-3f61-49b1-bc5d-53ae16ef689e', 'db63660a-fdcb-44ad-8743-e3ad0a238bb4'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:17:04.581342 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f9f2be0a-01d1-4173-b4b6-8a59c59ce6fd tempest-VolumesAdminNegativeTest-1446759092 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:17:04.640227 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f9f2be0a-01d1-4173-b4b6-8a59c59ce6fd tempest-VolumesAdminNegativeTest-1446759092 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:17:04.700555 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-f9f2be0a-01d1-4173-b4b6-8a59c59ce6fd tempest-VolumesAdminNegativeTest-1446759092 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:17:04.715795 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-f9f2be0a-01d1-4173-b4b6-8a59c59ce6fd tempest-VolumesAdminNegativeTest-1446759092 None] Deleted volume successfully. Dec 25 21:17:04.824097 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-f9f2be0a-01d1-4173-b4b6-8a59c59ce6fd tempest-VolumesAdminNegativeTest-1446759092 None] Lock "b'cinder-f296f6a8-189b-4e64-90ca-f36c76a1e788-delete_volume'" released by "delete_volume" :: held 5.019s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:17:05.493291 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-02f65957-3ef1-4ab5-a979-4d7e2e98e5e5 tempest-VolumesAdminNegativeTest-1446759092 None] Lock "b'cinder-372213cb-a444-4b5e-a26a-0dcf9d722c47-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:17:05.634774 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-02f65957-3ef1-4ab5-a979-4d7e2e98e5e5 tempest-VolumesAdminNegativeTest-1446759092 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:17:05.837673 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-02f65957-3ef1-4ab5-a979-4d7e2e98e5e5 tempest-VolumesAdminNegativeTest-1446759092 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:17:05.838450 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-02f65957-3ef1-4ab5-a979-4d7e2e98e5e5 tempest-VolumesAdminNegativeTest-1446759092 None] Volume volume-372213cb-a444-4b5e-a26a-0dcf9d722c47 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:17:05.982240 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-02f65957-3ef1-4ab5-a979-4d7e2e98e5e5 tempest-VolumesAdminNegativeTest-1446759092 None] deleting rbd volume volume-372213cb-a444-4b5e-a26a-0dcf9d722c47 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:17:06.023166 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-abafe202-1b8f-4939-b694-46c0a2b5b37d req-cd64d263-3684-4168-a7bf-ded95c692ef1 tempest-AttachVolumeTestJSON-100156046 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:17:06.906855 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-abafe202-1b8f-4939-b694-46c0a2b5b37d req-cd64d263-3684-4168-a7bf-ded95c692ef1 tempest-AttachVolumeTestJSON-100156046 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.883s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:17:06.907675 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-abafe202-1b8f-4939-b694-46c0a2b5b37d req-cd64d263-3684-4168-a7bf-ded95c692ef1 tempest-AttachVolumeTestJSON-100156046 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9ddbed29-7029-4b8d-ab16-b904195f2582', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': '9ddbed29-7029-4b8d-ab16-b904195f2582', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 21:17:07.005857 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-abafe202-1b8f-4939-b694-46c0a2b5b37d req-cd64d263-3684-4168-a7bf-ded95c692ef1 tempest-AttachVolumeTestJSON-100156046 None] Connection info returned from driver {'name': 'volumes/volume-9ddbed29-7029-4b8d-ab16-b904195f2582', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '9ddbed29-7029-4b8d-ab16-b904195f2582', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b4a461b0-8da3-4b54-95e1-ceb1bb76893f'} {{(pid=129926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 25 21:17:07.115305 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-abafe202-1b8f-4939-b694-46c0a2b5b37d req-cd64d263-3684-4168-a7bf-ded95c692ef1 tempest-AttachVolumeTestJSON-100156046 None] attachment_update completed successfully. Dec 25 21:17:11.114751 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-02f65957-3ef1-4ab5-a979-4d7e2e98e5e5 tempest-VolumesAdminNegativeTest-1446759092 None] Created reservations ['15cc4b07-9c54-4b87-b5d8-3d1df48940ad', '78966595-2704-47a0-83ee-c4257676575a', '9cdcabc5-2b46-4e15-8bd3-a88cc89a6814', '6b6764ab-f759-42dd-95cf-91a636719bca'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:17:11.189125 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-c30fe486-e64a-4e56-963a-7cc245466b98 req-7c3d1f89-b82c-40ad-bd7f-7b38b019929d tempest-DeleteServersTestJSON-404477660 None] Terminate volume connection completed successfully. Dec 25 21:17:11.191434 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-c30fe486-e64a-4e56-963a-7cc245466b98 req-7c3d1f89-b82c-40ad-bd7f-7b38b019929d tempest-DeleteServersTestJSON-404477660 None] Deleting attachment c7310b61-c9a1-4532-a83a-9c50a806445d. {{(pid=129926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 25 21:17:11.397340 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-02f65957-3ef1-4ab5-a979-4d7e2e98e5e5 tempest-VolumesAdminNegativeTest-1446759092 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:17:11.466877 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-02f65957-3ef1-4ab5-a979-4d7e2e98e5e5 tempest-VolumesAdminNegativeTest-1446759092 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:17:11.527042 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-02f65957-3ef1-4ab5-a979-4d7e2e98e5e5 tempest-VolumesAdminNegativeTest-1446759092 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:17:11.544213 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-02f65957-3ef1-4ab5-a979-4d7e2e98e5e5 tempest-VolumesAdminNegativeTest-1446759092 None] Deleted volume successfully. Dec 25 21:17:11.715294 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-02f65957-3ef1-4ab5-a979-4d7e2e98e5e5 tempest-VolumesAdminNegativeTest-1446759092 None] Lock "b'cinder-372213cb-a444-4b5e-a26a-0dcf9d722c47-delete_volume'" released by "delete_volume" :: held 6.222s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:17:29.554557 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:17:29.555808 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:17:29.636531 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:17:29.711641 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:18:12.889682 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-8eeff6ef-fef2-44e3-81f4-f1398892e741 req-4183296f-9117-4b96-8aa0-1263478b8d71 tempest-AttachVolumeTestJSON-100156046 None] Terminate volume connection completed successfully. Dec 25 21:18:12.892525 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-8eeff6ef-fef2-44e3-81f4-f1398892e741 req-4183296f-9117-4b96-8aa0-1263478b8d71 tempest-AttachVolumeTestJSON-100156046 None] Deleting attachment b4a461b0-8da3-4b54-95e1-ceb1bb76893f. {{(pid=129926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 25 21:18:15.164958 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-b74a97ee-4569-4b5b-a45f-46901b861292 tempest-ServersTestBootFromVolume-822926053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:18:15.169849 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-b74a97ee-4569-4b5b-a45f-46901b861292 tempest-ServersTestBootFromVolume-822926053 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:18:15.170910 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-b74a97ee-4569-4b5b-a45f-46901b861292 tempest-ServersTestBootFromVolume-822926053 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:18:15.190513 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b74a97ee-4569-4b5b-a45f-46901b861292 tempest-ServersTestBootFromVolume-822926053 None] Flow 'volume_create_manager' (6a0589bd-c125-4932-aa2a-20890a88802d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:18:15.194249 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b74a97ee-4569-4b5b-a45f-46901b861292 tempest-ServersTestBootFromVolume-822926053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9b02745-cce5-4e40-af59-7e031481b756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:18:15.200478 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-b74a97ee-4569-4b5b-a45f-46901b861292 tempest-ServersTestBootFromVolume-822926053 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:18:15.215383 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b74a97ee-4569-4b5b-a45f-46901b861292 tempest-ServersTestBootFromVolume-822926053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9b02745-cce5-4e40-af59-7e031481b756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2145552417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ed6b3e76-7317-467c-b37b-47dd7301c918,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba1ca2fcc2ce4d41b609fa6a753fc806',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:18:15Z,use_quota=True,user_id='81821563e0034d1e9743c4ec82245ed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:18:15.218300 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b74a97ee-4569-4b5b-a45f-46901b861292 tempest-ServersTestBootFromVolume-822926053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84ce179d-bc13-4dbc-98d8-980e237f8763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:18:15.220969 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b74a97ee-4569-4b5b-a45f-46901b861292 tempest-ServersTestBootFromVolume-822926053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84ce179d-bc13-4dbc-98d8-980e237f8763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:18:15.223650 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b74a97ee-4569-4b5b-a45f-46901b861292 tempest-ServersTestBootFromVolume-822926053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (608b287e-115b-468e-ad22-1d7088fe7a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:18:15.317564 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b74a97ee-4569-4b5b-a45f-46901b861292 tempest-ServersTestBootFromVolume-822926053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (608b287e-115b-468e-ad22-1d7088fe7a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ed6b3e76-7317-467c-b37b-47dd7301c918', 'volume_name': 'volume-ed6b3e76-7317-467c-b37b-47dd7301c918', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:18:15.319983 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b74a97ee-4569-4b5b-a45f-46901b861292 tempest-ServersTestBootFromVolume-822926053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d296897-3cc9-4b7e-8725-7268a5baa934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:18:15.322202 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b74a97ee-4569-4b5b-a45f-46901b861292 tempest-ServersTestBootFromVolume-822926053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d296897-3cc9-4b7e-8725-7268a5baa934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:18:15.324436 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b74a97ee-4569-4b5b-a45f-46901b861292 tempest-ServersTestBootFromVolume-822926053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c940219-c3ff-4b0d-9ed1-da047ec7ab0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:18:15.325312 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-b74a97ee-4569-4b5b-a45f-46901b861292 tempest-ServersTestBootFromVolume-822926053 None] Volume ed6b3e76-7317-467c-b37b-47dd7301c918: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ed6b3e76-7317-467c-b37b-47dd7301c918', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 25 21:18:15.325895 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-b74a97ee-4569-4b5b-a45f-46901b861292 tempest-ServersTestBootFromVolume-822926053 None] Cloning ed6b3e76-7317-467c-b37b-47dd7301c918 from image aca914d0-5f7b-465f-a024-75efa27d7291 at location (None, None). {{(pid=129926) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Dec 25 21:18:15.335630 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-b74a97ee-4569-4b5b-a45f-46901b861292 tempest-ServersTestBootFromVolume-822926053 None] Lock "b'cinder-aca914d0-5f7b-465f-a024-75efa27d7291'" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:18:15.394494 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-b74a97ee-4569-4b5b-a45f-46901b861292 tempest-ServersTestBootFromVolume-822926053 None] Found image-volume cache entry: {'id': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'volume_id': '058f5fb3-51e4-40e3-9c98-542207f1fc1f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31), 'last_used': datetime.datetime(2021, 12, 25, 21, 18, 15, 339632)}. {{(pid=129926) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 25 21:18:15.395246 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-b74a97ee-4569-4b5b-a45f-46901b861292 tempest-ServersTestBootFromVolume-822926053 None] Image-volume cache entry image_update_at = 2021-12-25 20:58:31+00:00, requested image updated_at = 2021-12-25 20:58:31+00:00. {{(pid=129926) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 25 21:18:15.395828 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-b74a97ee-4569-4b5b-a45f-46901b861292 tempest-ServersTestBootFromVolume-822926053 None] Found cache entry for image = aca914d0-5f7b-465f-a024-75efa27d7291 on host ncdv-master-1@ceph#ceph. {{(pid=129926) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Dec 25 21:18:15.400741 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-b74a97ee-4569-4b5b-a45f-46901b861292 tempest-ServersTestBootFromVolume-822926053 None] Lock "b'cinder-aca914d0-5f7b-465f-a024-75efa27d7291'" released by "_prepare_image_cache_entry" :: held 0.065s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:18:15.401900 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-b74a97ee-4569-4b5b-a45f-46901b861292 tempest-ServersTestBootFromVolume-822926053 None] Attempting to retrieve cache entry for image = aca914d0-5f7b-465f-a024-75efa27d7291 on host ncdv-master-1@ceph#ceph. {{(pid=129926) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Dec 25 21:18:15.410601 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-b74a97ee-4569-4b5b-a45f-46901b861292 tempest-ServersTestBootFromVolume-822926053 None] Found image-volume cache entry: {'id': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'volume_id': '058f5fb3-51e4-40e3-9c98-542207f1fc1f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31), 'last_used': datetime.datetime(2021, 12, 25, 21, 18, 15, 405926)}. {{(pid=129926) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 25 21:18:15.410601 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-b74a97ee-4569-4b5b-a45f-46901b861292 tempest-ServersTestBootFromVolume-822926053 None] Image-volume cache entry image_update_at = 2021-12-25 20:58:31+00:00, requested image updated_at = 2021-12-25 20:58:31+00:00. {{(pid=129926) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 25 21:18:15.410601 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-b74a97ee-4569-4b5b-a45f-46901b861292 tempest-ServersTestBootFromVolume-822926053 None] Creating from source image-volume 058f5fb3-51e4-40e3-9c98-542207f1fc1f {{(pid=129926) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Dec 25 21:18:15.421667 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b74a97ee-4569-4b5b-a45f-46901b861292 tempest-ServersTestBootFromVolume-822926053 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:18:15.620319 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b74a97ee-4569-4b5b-a45f-46901b861292 tempest-ServersTestBootFromVolume-822926053 None] creating snapshot='volume-ed6b3e76-7317-467c-b37b-47dd7301c918.clone_snap' {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 25 21:18:16.917650 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b74a97ee-4569-4b5b-a45f-46901b861292 tempest-ServersTestBootFromVolume-822926053 None] cloning 'volume-058f5fb3-51e4-40e3-9c98-542207f1fc1f@volume-ed6b3e76-7317-467c-b37b-47dd7301c918.clone_snap' to 'volume-ed6b3e76-7317-467c-b37b-47dd7301c918' {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 25 21:18:18.072734 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b74a97ee-4569-4b5b-a45f-46901b861292 tempest-ServersTestBootFromVolume-822926053 None] Volume volume-98b6d31e-e760-499e-8962-7b22479c1e9a.deleted is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:18:18.074438 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b74a97ee-4569-4b5b-a45f-46901b861292 tempest-ServersTestBootFromVolume-822926053 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:18:18.075270 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b74a97ee-4569-4b5b-a45f-46901b861292 tempest-ServersTestBootFromVolume-822926053 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:18:18.416184 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b74a97ee-4569-4b5b-a45f-46901b861292 tempest-ServersTestBootFromVolume-822926053 None] clone created successfully {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 25 21:18:18.417132 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.volume_utils [None req-b74a97ee-4569-4b5b-a45f-46901b861292 tempest-ServersTestBootFromVolume-822926053 None] Marking volume ed6b3e76-7317-467c-b37b-47dd7301c918 as bootable. {{(pid=129926) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 25 21:18:18.517286 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-b74a97ee-4569-4b5b-a45f-46901b861292 tempest-ServersTestBootFromVolume-822926053 None] Copying metadata from image aca914d0-5f7b-465f-a024-75efa27d7291 to ed6b3e76-7317-467c-b37b-47dd7301c918. {{(pid=129926) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Dec 25 21:18:18.517713 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-b74a97ee-4569-4b5b-a45f-46901b861292 tempest-ServersTestBootFromVolume-822926053 None] Creating volume glance metadata for volume ed6b3e76-7317-467c-b37b-47dd7301c918 backed by image aca914d0-5f7b-465f-a024-75efa27d7291 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129926) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Dec 25 21:18:18.712958 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b74a97ee-4569-4b5b-a45f-46901b861292 tempest-ServersTestBootFromVolume-822926053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c940219-c3ff-4b0d-9ed1-da047ec7ab0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed6b3e76-7317-467c-b37b-47dd7301c918', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:18:18.715138 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b74a97ee-4569-4b5b-a45f-46901b861292 tempest-ServersTestBootFromVolume-822926053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94d00106-8a91-4956-a53b-8cc032638233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:18:18.825690 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-b74a97ee-4569-4b5b-a45f-46901b861292 tempest-ServersTestBootFromVolume-822926053 None] Volume volume-ed6b3e76-7317-467c-b37b-47dd7301c918 (ed6b3e76-7317-467c-b37b-47dd7301c918): created successfully Dec 25 21:18:18.828078 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b74a97ee-4569-4b5b-a45f-46901b861292 tempest-ServersTestBootFromVolume-822926053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94d00106-8a91-4956-a53b-8cc032638233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:18:18.831722 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b74a97ee-4569-4b5b-a45f-46901b861292 tempest-ServersTestBootFromVolume-822926053 None] Flow 'volume_create_manager' (6a0589bd-c125-4932-aa2a-20890a88802d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:18:18.902582 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-b74a97ee-4569-4b5b-a45f-46901b861292 tempest-ServersTestBootFromVolume-822926053 None] Created volume successfully. Dec 25 21:18:24.728257 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-c3d1dbde-0c8a-4f5f-b574-8fe59a7cce73 req-e4388738-6228-4486-82dc-6450f0b5ee4f tempest-ServersTestBootFromVolume-822926053 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:18:25.476135 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-c3d1dbde-0c8a-4f5f-b574-8fe59a7cce73 req-e4388738-6228-4486-82dc-6450f0b5ee4f tempest-ServersTestBootFromVolume-822926053 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.747s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:18:25.476976 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-c3d1dbde-0c8a-4f5f-b574-8fe59a7cce73 req-e4388738-6228-4486-82dc-6450f0b5ee4f tempest-ServersTestBootFromVolume-822926053 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ed6b3e76-7317-467c-b37b-47dd7301c918', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': 'ed6b3e76-7317-467c-b37b-47dd7301c918', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 21:18:25.576631 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-c3d1dbde-0c8a-4f5f-b574-8fe59a7cce73 req-e4388738-6228-4486-82dc-6450f0b5ee4f tempest-ServersTestBootFromVolume-822926053 None] Connection info returned from driver {'name': 'volumes/volume-ed6b3e76-7317-467c-b37b-47dd7301c918', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ed6b3e76-7317-467c-b37b-47dd7301c918', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '3e16e0b5-c229-451c-9f5c-5dd0880b8d88'} {{(pid=129926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 25 21:18:25.741155 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-c3d1dbde-0c8a-4f5f-b574-8fe59a7cce73 req-e4388738-6228-4486-82dc-6450f0b5ee4f tempest-ServersTestBootFromVolume-822926053 None] attachment_update completed successfully. Dec 25 21:18:29.558178 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:18:29.566178 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:18:29.649797 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:18:29.754594 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:19:02.409399 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-5712ff40-14d4-4628-ba29-58059c6ba5ca tempest-TaggedBootDevicesTest_v242-1707178338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:19:02.417796 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-5712ff40-14d4-4628-ba29-58059c6ba5ca tempest-TaggedBootDevicesTest_v242-1707178338 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:19:02.420415 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-5712ff40-14d4-4628-ba29-58059c6ba5ca tempest-TaggedBootDevicesTest_v242-1707178338 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:19:02.446805 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5712ff40-14d4-4628-ba29-58059c6ba5ca tempest-TaggedBootDevicesTest_v242-1707178338 None] Flow 'volume_create_manager' (7c162e2a-5901-48b2-8e9b-2d9b5a1f02b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:19:02.454079 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5712ff40-14d4-4628-ba29-58059c6ba5ca tempest-TaggedBootDevicesTest_v242-1707178338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (564fe6a6-8b8a-4b6b-88c1-e849a3e14eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:19:02.463897 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-5712ff40-14d4-4628-ba29-58059c6ba5ca tempest-TaggedBootDevicesTest_v242-1707178338 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:19:02.490595 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5712ff40-14d4-4628-ba29-58059c6ba5ca tempest-TaggedBootDevicesTest_v242-1707178338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (564fe6a6-8b8a-4b6b-88c1-e849a3e14eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1448204243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a5c1ad6f-a4c5-4f08-a59c-fa1afed02065,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4571ece0fa3450b83fde221178518c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:19:02Z,use_quota=True,user_id='a85842dabc3d4a219d28c154e36c293c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:19:02.494276 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5712ff40-14d4-4628-ba29-58059c6ba5ca tempest-TaggedBootDevicesTest_v242-1707178338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8f3e962-d0b5-43ba-b818-5d0a953830b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:19:02.497495 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5712ff40-14d4-4628-ba29-58059c6ba5ca tempest-TaggedBootDevicesTest_v242-1707178338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8f3e962-d0b5-43ba-b818-5d0a953830b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:19:02.504104 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5712ff40-14d4-4628-ba29-58059c6ba5ca tempest-TaggedBootDevicesTest_v242-1707178338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f92e4020-35c6-4a5d-be64-c18bd5aacb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:19:02.618126 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5712ff40-14d4-4628-ba29-58059c6ba5ca tempest-TaggedBootDevicesTest_v242-1707178338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f92e4020-35c6-4a5d-be64-c18bd5aacb58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a5c1ad6f-a4c5-4f08-a59c-fa1afed02065', 'volume_name': 'volume-a5c1ad6f-a4c5-4f08-a59c-fa1afed02065', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:19:02.621115 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5712ff40-14d4-4628-ba29-58059c6ba5ca tempest-TaggedBootDevicesTest_v242-1707178338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77445ca9-40dc-4f21-a430-641375ffccac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:19:02.627438 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5712ff40-14d4-4628-ba29-58059c6ba5ca tempest-TaggedBootDevicesTest_v242-1707178338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77445ca9-40dc-4f21-a430-641375ffccac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:19:02.630248 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5712ff40-14d4-4628-ba29-58059c6ba5ca tempest-TaggedBootDevicesTest_v242-1707178338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b815cfd-87d1-4587-b06f-94c4ed016da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:19:02.631335 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-5712ff40-14d4-4628-ba29-58059c6ba5ca tempest-TaggedBootDevicesTest_v242-1707178338 None] Volume a5c1ad6f-a4c5-4f08-a59c-fa1afed02065: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a5c1ad6f-a4c5-4f08-a59c-fa1afed02065', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 25 21:19:02.632095 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-5712ff40-14d4-4628-ba29-58059c6ba5ca tempest-TaggedBootDevicesTest_v242-1707178338 None] Cloning a5c1ad6f-a4c5-4f08-a59c-fa1afed02065 from image aca914d0-5f7b-465f-a024-75efa27d7291 at location (None, None). {{(pid=129926) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Dec 25 21:19:02.665812 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-5712ff40-14d4-4628-ba29-58059c6ba5ca tempest-TaggedBootDevicesTest_v242-1707178338 None] Lock "b'cinder-aca914d0-5f7b-465f-a024-75efa27d7291'" acquired by "_prepare_image_cache_entry" :: waited 0.016s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:19:02.753336 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-5712ff40-14d4-4628-ba29-58059c6ba5ca tempest-TaggedBootDevicesTest_v242-1707178338 None] Found image-volume cache entry: {'id': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'volume_id': '058f5fb3-51e4-40e3-9c98-542207f1fc1f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31), 'last_used': datetime.datetime(2021, 12, 25, 21, 19, 2, 659274)}. {{(pid=129926) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 25 21:19:02.754405 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-5712ff40-14d4-4628-ba29-58059c6ba5ca tempest-TaggedBootDevicesTest_v242-1707178338 None] Image-volume cache entry image_update_at = 2021-12-25 20:58:31+00:00, requested image updated_at = 2021-12-25 20:58:31+00:00. {{(pid=129926) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 25 21:19:02.755786 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-5712ff40-14d4-4628-ba29-58059c6ba5ca tempest-TaggedBootDevicesTest_v242-1707178338 None] Found cache entry for image = aca914d0-5f7b-465f-a024-75efa27d7291 on host ncdv-master-1@ceph#ceph. {{(pid=129926) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Dec 25 21:19:02.767194 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-5712ff40-14d4-4628-ba29-58059c6ba5ca tempest-TaggedBootDevicesTest_v242-1707178338 None] Lock "b'cinder-aca914d0-5f7b-465f-a024-75efa27d7291'" released by "_prepare_image_cache_entry" :: held 0.118s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:19:02.785699 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-5712ff40-14d4-4628-ba29-58059c6ba5ca tempest-TaggedBootDevicesTest_v242-1707178338 None] Attempting to retrieve cache entry for image = aca914d0-5f7b-465f-a024-75efa27d7291 on host ncdv-master-1@ceph#ceph. {{(pid=129926) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Dec 25 21:19:02.836669 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-5712ff40-14d4-4628-ba29-58059c6ba5ca tempest-TaggedBootDevicesTest_v242-1707178338 None] Found image-volume cache entry: {'id': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'volume_id': '058f5fb3-51e4-40e3-9c98-542207f1fc1f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31), 'last_used': datetime.datetime(2021, 12, 25, 21, 19, 2, 821902)}. {{(pid=129926) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 25 21:19:02.837092 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-5712ff40-14d4-4628-ba29-58059c6ba5ca tempest-TaggedBootDevicesTest_v242-1707178338 None] Image-volume cache entry image_update_at = 2021-12-25 20:58:31+00:00, requested image updated_at = 2021-12-25 20:58:31+00:00. {{(pid=129926) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 25 21:19:02.837522 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-5712ff40-14d4-4628-ba29-58059c6ba5ca tempest-TaggedBootDevicesTest_v242-1707178338 None] Creating from source image-volume 058f5fb3-51e4-40e3-9c98-542207f1fc1f {{(pid=129926) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Dec 25 21:19:02.880997 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-5712ff40-14d4-4628-ba29-58059c6ba5ca tempest-TaggedBootDevicesTest_v242-1707178338 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:19:03.157877 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-5712ff40-14d4-4628-ba29-58059c6ba5ca tempest-TaggedBootDevicesTest_v242-1707178338 None] creating snapshot='volume-a5c1ad6f-a4c5-4f08-a59c-fa1afed02065.clone_snap' {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 25 21:19:04.336026 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-5712ff40-14d4-4628-ba29-58059c6ba5ca tempest-TaggedBootDevicesTest_v242-1707178338 None] cloning 'volume-058f5fb3-51e4-40e3-9c98-542207f1fc1f@volume-a5c1ad6f-a4c5-4f08-a59c-fa1afed02065.clone_snap' to 'volume-a5c1ad6f-a4c5-4f08-a59c-fa1afed02065' {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 25 21:19:07.367781 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-5712ff40-14d4-4628-ba29-58059c6ba5ca tempest-TaggedBootDevicesTest_v242-1707178338 None] Volume volume-98b6d31e-e760-499e-8962-7b22479c1e9a.deleted is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:19:07.368825 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-5712ff40-14d4-4628-ba29-58059c6ba5ca tempest-TaggedBootDevicesTest_v242-1707178338 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:19:07.369223 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-5712ff40-14d4-4628-ba29-58059c6ba5ca tempest-TaggedBootDevicesTest_v242-1707178338 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:19:09.145392 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-5712ff40-14d4-4628-ba29-58059c6ba5ca tempest-TaggedBootDevicesTest_v242-1707178338 None] clone created successfully {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 25 21:19:09.150444 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.volume_utils [None req-5712ff40-14d4-4628-ba29-58059c6ba5ca tempest-TaggedBootDevicesTest_v242-1707178338 None] Marking volume a5c1ad6f-a4c5-4f08-a59c-fa1afed02065 as bootable. {{(pid=129926) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 25 21:19:09.301178 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-5712ff40-14d4-4628-ba29-58059c6ba5ca tempest-TaggedBootDevicesTest_v242-1707178338 None] Copying metadata from image aca914d0-5f7b-465f-a024-75efa27d7291 to a5c1ad6f-a4c5-4f08-a59c-fa1afed02065. {{(pid=129926) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Dec 25 21:19:09.307148 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-5712ff40-14d4-4628-ba29-58059c6ba5ca tempest-TaggedBootDevicesTest_v242-1707178338 None] Creating volume glance metadata for volume a5c1ad6f-a4c5-4f08-a59c-fa1afed02065 backed by image aca914d0-5f7b-465f-a024-75efa27d7291 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129926) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Dec 25 21:19:09.557767 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5712ff40-14d4-4628-ba29-58059c6ba5ca tempest-TaggedBootDevicesTest_v242-1707178338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b815cfd-87d1-4587-b06f-94c4ed016da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5c1ad6f-a4c5-4f08-a59c-fa1afed02065', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:19:09.563696 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5712ff40-14d4-4628-ba29-58059c6ba5ca tempest-TaggedBootDevicesTest_v242-1707178338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3af75059-a773-453d-bd15-fb31a71c27c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:19:09.690458 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-5712ff40-14d4-4628-ba29-58059c6ba5ca tempest-TaggedBootDevicesTest_v242-1707178338 None] Volume volume-a5c1ad6f-a4c5-4f08-a59c-fa1afed02065 (a5c1ad6f-a4c5-4f08-a59c-fa1afed02065): created successfully Dec 25 21:19:09.693205 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5712ff40-14d4-4628-ba29-58059c6ba5ca tempest-TaggedBootDevicesTest_v242-1707178338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3af75059-a773-453d-bd15-fb31a71c27c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:19:09.696303 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5712ff40-14d4-4628-ba29-58059c6ba5ca tempest-TaggedBootDevicesTest_v242-1707178338 None] Flow 'volume_create_manager' (7c162e2a-5901-48b2-8e9b-2d9b5a1f02b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:19:09.843786 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-5712ff40-14d4-4628-ba29-58059c6ba5ca tempest-TaggedBootDevicesTest_v242-1707178338 None] Created volume successfully. Dec 25 21:19:11.907902 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2b86251-a4ed-45a2-aeb9-b74fdd6dca9a tempest-TaggedBootDevicesTest_v242-1707178338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:19:11.920103 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-a2b86251-a4ed-45a2-aeb9-b74fdd6dca9a tempest-TaggedBootDevicesTest_v242-1707178338 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:19:11.920803 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-a2b86251-a4ed-45a2-aeb9-b74fdd6dca9a tempest-TaggedBootDevicesTest_v242-1707178338 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:19:11.936673 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a2b86251-a4ed-45a2-aeb9-b74fdd6dca9a tempest-TaggedBootDevicesTest_v242-1707178338 None] Flow 'volume_create_manager' (435adcb7-a2c5-4a34-9400-bf271436e307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:19:11.940759 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a2b86251-a4ed-45a2-aeb9-b74fdd6dca9a tempest-TaggedBootDevicesTest_v242-1707178338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e75749fa-5012-48c4-89ed-8c6c244a332c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:19:11.949410 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-a2b86251-a4ed-45a2-aeb9-b74fdd6dca9a tempest-TaggedBootDevicesTest_v242-1707178338 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:19:11.973517 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a2b86251-a4ed-45a2-aeb9-b74fdd6dca9a tempest-TaggedBootDevicesTest_v242-1707178338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e75749fa-5012-48c4-89ed-8c6c244a332c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1529942650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=801c9bae-0e8c-4c69-99a2-93bfda7668af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4571ece0fa3450b83fde221178518c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:19:12Z,use_quota=True,user_id='a85842dabc3d4a219d28c154e36c293c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:19:11.978028 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a2b86251-a4ed-45a2-aeb9-b74fdd6dca9a tempest-TaggedBootDevicesTest_v242-1707178338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf100631-6cf3-419f-8ecd-022f46d01965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:19:11.980354 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a2b86251-a4ed-45a2-aeb9-b74fdd6dca9a tempest-TaggedBootDevicesTest_v242-1707178338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf100631-6cf3-419f-8ecd-022f46d01965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:19:11.982808 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a2b86251-a4ed-45a2-aeb9-b74fdd6dca9a tempest-TaggedBootDevicesTest_v242-1707178338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e75d9e01-045f-4580-8b17-e05038578bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:19:11.985409 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a2b86251-a4ed-45a2-aeb9-b74fdd6dca9a tempest-TaggedBootDevicesTest_v242-1707178338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e75d9e01-045f-4580-8b17-e05038578bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '801c9bae-0e8c-4c69-99a2-93bfda7668af', 'volume_name': 'volume-801c9bae-0e8c-4c69-99a2-93bfda7668af', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:19:11.987760 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a2b86251-a4ed-45a2-aeb9-b74fdd6dca9a tempest-TaggedBootDevicesTest_v242-1707178338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bf67283-c73b-4ba3-a6e6-0ff518b8c4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:19:11.990081 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a2b86251-a4ed-45a2-aeb9-b74fdd6dca9a tempest-TaggedBootDevicesTest_v242-1707178338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bf67283-c73b-4ba3-a6e6-0ff518b8c4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:19:11.992559 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a2b86251-a4ed-45a2-aeb9-b74fdd6dca9a tempest-TaggedBootDevicesTest_v242-1707178338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76daab9c-79c4-471c-b5ff-ac4c69c45de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:19:11.993719 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-a2b86251-a4ed-45a2-aeb9-b74fdd6dca9a tempest-TaggedBootDevicesTest_v242-1707178338 None] Volume 801c9bae-0e8c-4c69-99a2-93bfda7668af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-801c9bae-0e8c-4c69-99a2-93bfda7668af', 'volume_size': 1} Dec 25 21:19:11.994148 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a2b86251-a4ed-45a2-aeb9-b74fdd6dca9a tempest-TaggedBootDevicesTest_v242-1707178338 None] creating volume 'volume-801c9bae-0e8c-4c69-99a2-93bfda7668af' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:19:11.995130 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a2b86251-a4ed-45a2-aeb9-b74fdd6dca9a tempest-TaggedBootDevicesTest_v242-1707178338 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:19:13.514162 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a2b86251-a4ed-45a2-aeb9-b74fdd6dca9a tempest-TaggedBootDevicesTest_v242-1707178338 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:19:13.514162 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a2b86251-a4ed-45a2-aeb9-b74fdd6dca9a tempest-TaggedBootDevicesTest_v242-1707178338 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:19:13.514162 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a2b86251-a4ed-45a2-aeb9-b74fdd6dca9a tempest-TaggedBootDevicesTest_v242-1707178338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76daab9c-79c4-471c-b5ff-ac4c69c45de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-801c9bae-0e8c-4c69-99a2-93bfda7668af', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:19:13.514162 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a2b86251-a4ed-45a2-aeb9-b74fdd6dca9a tempest-TaggedBootDevicesTest_v242-1707178338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c06de2-6a60-4b82-88dc-f9b0186b2f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:19:13.620493 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-a2b86251-a4ed-45a2-aeb9-b74fdd6dca9a tempest-TaggedBootDevicesTest_v242-1707178338 None] Volume volume-801c9bae-0e8c-4c69-99a2-93bfda7668af (801c9bae-0e8c-4c69-99a2-93bfda7668af): created successfully Dec 25 21:19:13.624570 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a2b86251-a4ed-45a2-aeb9-b74fdd6dca9a tempest-TaggedBootDevicesTest_v242-1707178338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c06de2-6a60-4b82-88dc-f9b0186b2f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:19:13.625837 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a2b86251-a4ed-45a2-aeb9-b74fdd6dca9a tempest-TaggedBootDevicesTest_v242-1707178338 None] Flow 'volume_create_manager' (435adcb7-a2c5-4a34-9400-bf271436e307) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:19:13.784493 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-a2b86251-a4ed-45a2-aeb9-b74fdd6dca9a tempest-TaggedBootDevicesTest_v242-1707178338 None] Created volume successfully. Dec 25 21:19:16.044850 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-04f06799-be69-4c47-be06-0d2d63401a7b tempest-TaggedBootDevicesTest_v242-1707178338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:19:16.048028 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-04f06799-be69-4c47-be06-0d2d63401a7b tempest-TaggedBootDevicesTest_v242-1707178338 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:19:16.048468 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-04f06799-be69-4c47-be06-0d2d63401a7b tempest-TaggedBootDevicesTest_v242-1707178338 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:19:16.061103 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-04f06799-be69-4c47-be06-0d2d63401a7b tempest-TaggedBootDevicesTest_v242-1707178338 None] Flow 'volume_create_manager' (a269bbe7-ffa9-4dfd-8c19-d74a5e17dc71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:19:16.064225 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-04f06799-be69-4c47-be06-0d2d63401a7b tempest-TaggedBootDevicesTest_v242-1707178338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9a11480-67c0-4e66-b791-2456b302f751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:19:16.070338 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-04f06799-be69-4c47-be06-0d2d63401a7b tempest-TaggedBootDevicesTest_v242-1707178338 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:19:16.082482 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-04f06799-be69-4c47-be06-0d2d63401a7b tempest-TaggedBootDevicesTest_v242-1707178338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9a11480-67c0-4e66-b791-2456b302f751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1948316376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=15822ef8-a596-47a7-bea5-391cbe2651d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4571ece0fa3450b83fde221178518c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:19:16Z,use_quota=True,user_id='a85842dabc3d4a219d28c154e36c293c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:19:16.085155 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-04f06799-be69-4c47-be06-0d2d63401a7b tempest-TaggedBootDevicesTest_v242-1707178338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e2d9739-e900-42b8-905b-f846de46828d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:19:16.087566 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-04f06799-be69-4c47-be06-0d2d63401a7b tempest-TaggedBootDevicesTest_v242-1707178338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e2d9739-e900-42b8-905b-f846de46828d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:19:16.089958 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-04f06799-be69-4c47-be06-0d2d63401a7b tempest-TaggedBootDevicesTest_v242-1707178338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b6121ed-c9ee-49f8-b724-2a0b5ea8d894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:19:16.095817 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-04f06799-be69-4c47-be06-0d2d63401a7b tempest-TaggedBootDevicesTest_v242-1707178338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b6121ed-c9ee-49f8-b724-2a0b5ea8d894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15822ef8-a596-47a7-bea5-391cbe2651d7', 'volume_name': 'volume-15822ef8-a596-47a7-bea5-391cbe2651d7', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:19:16.095817 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-04f06799-be69-4c47-be06-0d2d63401a7b tempest-TaggedBootDevicesTest_v242-1707178338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2f86f2f-9d0e-490e-b247-63c4f4ddbe0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:19:16.102517 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-04f06799-be69-4c47-be06-0d2d63401a7b tempest-TaggedBootDevicesTest_v242-1707178338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2f86f2f-9d0e-490e-b247-63c4f4ddbe0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:19:16.102517 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-04f06799-be69-4c47-be06-0d2d63401a7b tempest-TaggedBootDevicesTest_v242-1707178338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c6ab4a5-55fa-4c66-a73c-5ae154d6b0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:19:16.102517 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-04f06799-be69-4c47-be06-0d2d63401a7b tempest-TaggedBootDevicesTest_v242-1707178338 None] Volume 15822ef8-a596-47a7-bea5-391cbe2651d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15822ef8-a596-47a7-bea5-391cbe2651d7', 'volume_size': 1} Dec 25 21:19:16.102517 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-04f06799-be69-4c47-be06-0d2d63401a7b tempest-TaggedBootDevicesTest_v242-1707178338 None] creating volume 'volume-15822ef8-a596-47a7-bea5-391cbe2651d7' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:19:16.102797 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-04f06799-be69-4c47-be06-0d2d63401a7b tempest-TaggedBootDevicesTest_v242-1707178338 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:19:17.731091 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-04f06799-be69-4c47-be06-0d2d63401a7b tempest-TaggedBootDevicesTest_v242-1707178338 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:19:17.732618 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-04f06799-be69-4c47-be06-0d2d63401a7b tempest-TaggedBootDevicesTest_v242-1707178338 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:19:17.737979 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-04f06799-be69-4c47-be06-0d2d63401a7b tempest-TaggedBootDevicesTest_v242-1707178338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c6ab4a5-55fa-4c66-a73c-5ae154d6b0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15822ef8-a596-47a7-bea5-391cbe2651d7', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:19:17.740989 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-04f06799-be69-4c47-be06-0d2d63401a7b tempest-TaggedBootDevicesTest_v242-1707178338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cccd265-9ec5-4c32-b9f8-4a612ef22d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:19:17.852789 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-04f06799-be69-4c47-be06-0d2d63401a7b tempest-TaggedBootDevicesTest_v242-1707178338 None] Volume volume-15822ef8-a596-47a7-bea5-391cbe2651d7 (15822ef8-a596-47a7-bea5-391cbe2651d7): created successfully Dec 25 21:19:17.860431 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-04f06799-be69-4c47-be06-0d2d63401a7b tempest-TaggedBootDevicesTest_v242-1707178338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cccd265-9ec5-4c32-b9f8-4a612ef22d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:19:17.866152 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-04f06799-be69-4c47-be06-0d2d63401a7b tempest-TaggedBootDevicesTest_v242-1707178338 None] Flow 'volume_create_manager' (a269bbe7-ffa9-4dfd-8c19-d74a5e17dc71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:19:17.962709 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-04f06799-be69-4c47-be06-0d2d63401a7b tempest-TaggedBootDevicesTest_v242-1707178338 None] Created volume successfully. Dec 25 21:19:29.560207 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:19:29.561005 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:19:29.638597 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:19:29.712332 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:19:42.726144 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-4af7ab0f-8741-4c80-8988-ff06aed62416 req-85f97da1-3a57-4f14-87e3-92d572e03576 tempest-TaggedBootDevicesTest_v242-1707178338 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:19:44.058024 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-4af7ab0f-8741-4c80-8988-ff06aed62416 req-85f97da1-3a57-4f14-87e3-92d572e03576 tempest-TaggedBootDevicesTest_v242-1707178338 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.331s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:19:44.062668 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-4af7ab0f-8741-4c80-8988-ff06aed62416 req-85f97da1-3a57-4f14-87e3-92d572e03576 tempest-TaggedBootDevicesTest_v242-1707178338 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a5c1ad6f-a4c5-4f08-a59c-fa1afed02065', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': 'a5c1ad6f-a4c5-4f08-a59c-fa1afed02065', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 21:19:44.175643 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-4af7ab0f-8741-4c80-8988-ff06aed62416 req-85f97da1-3a57-4f14-87e3-92d572e03576 tempest-TaggedBootDevicesTest_v242-1707178338 None] Connection info returned from driver {'name': 'volumes/volume-a5c1ad6f-a4c5-4f08-a59c-fa1afed02065', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a5c1ad6f-a4c5-4f08-a59c-fa1afed02065', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'af2f8811-0d29-4a13-9517-01abed54df95'} {{(pid=129926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 25 21:19:44.341208 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-4af7ab0f-8741-4c80-8988-ff06aed62416 req-85f97da1-3a57-4f14-87e3-92d572e03576 tempest-TaggedBootDevicesTest_v242-1707178338 None] attachment_update completed successfully. Dec 25 21:19:45.321086 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-4af7ab0f-8741-4c80-8988-ff06aed62416 req-187c8909-3a8d-457a-8201-526554620329 tempest-TaggedBootDevicesTest_v242-1707178338 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:19:46.135353 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-4af7ab0f-8741-4c80-8988-ff06aed62416 req-187c8909-3a8d-457a-8201-526554620329 tempest-TaggedBootDevicesTest_v242-1707178338 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.814s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:19:46.136696 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-4af7ab0f-8741-4c80-8988-ff06aed62416 req-187c8909-3a8d-457a-8201-526554620329 tempest-TaggedBootDevicesTest_v242-1707178338 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-801c9bae-0e8c-4c69-99a2-93bfda7668af', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': '801c9bae-0e8c-4c69-99a2-93bfda7668af', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 21:19:46.248184 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-4af7ab0f-8741-4c80-8988-ff06aed62416 req-187c8909-3a8d-457a-8201-526554620329 tempest-TaggedBootDevicesTest_v242-1707178338 None] Connection info returned from driver {'name': 'volumes/volume-801c9bae-0e8c-4c69-99a2-93bfda7668af', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '801c9bae-0e8c-4c69-99a2-93bfda7668af', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ec35d1c4-7e6c-4694-a1d7-5596ebe1a219'} {{(pid=129926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 25 21:19:46.455159 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-4af7ab0f-8741-4c80-8988-ff06aed62416 req-187c8909-3a8d-457a-8201-526554620329 tempest-TaggedBootDevicesTest_v242-1707178338 None] attachment_update completed successfully. Dec 25 21:19:47.275079 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-4af7ab0f-8741-4c80-8988-ff06aed62416 req-7671cb01-9755-42f5-9d08-a03ff074e52e tempest-TaggedBootDevicesTest_v242-1707178338 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:19:48.129832 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-4af7ab0f-8741-4c80-8988-ff06aed62416 req-7671cb01-9755-42f5-9d08-a03ff074e52e tempest-TaggedBootDevicesTest_v242-1707178338 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.855s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:19:48.131400 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-4af7ab0f-8741-4c80-8988-ff06aed62416 req-7671cb01-9755-42f5-9d08-a03ff074e52e tempest-TaggedBootDevicesTest_v242-1707178338 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-15822ef8-a596-47a7-bea5-391cbe2651d7', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': '15822ef8-a596-47a7-bea5-391cbe2651d7', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 21:19:48.268586 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-4af7ab0f-8741-4c80-8988-ff06aed62416 req-7671cb01-9755-42f5-9d08-a03ff074e52e tempest-TaggedBootDevicesTest_v242-1707178338 None] Connection info returned from driver {'name': 'volumes/volume-15822ef8-a596-47a7-bea5-391cbe2651d7', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '15822ef8-a596-47a7-bea5-391cbe2651d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'add0d839-bd2b-4398-a3f2-c5ae6a804f79'} {{(pid=129926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 25 21:19:48.443111 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-4af7ab0f-8741-4c80-8988-ff06aed62416 req-7671cb01-9755-42f5-9d08-a03ff074e52e tempest-TaggedBootDevicesTest_v242-1707178338 None] attachment_update completed successfully. Dec 25 21:20:29.404720 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-1be00bae-6209-4e95-a90f-6cd3d65dc045 tempest-DeleteServersTestJSON-404477660 None] Lock "b'cinder-451b93e3-1579-44a1-b05d-3475df3c0e22-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:20:29.558524 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:20:29.559470 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:20:29.667597 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:20:29.735220 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:20:29.762250 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-1be00bae-6209-4e95-a90f-6cd3d65dc045 tempest-DeleteServersTestJSON-404477660 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:20:30.108465 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-1be00bae-6209-4e95-a90f-6cd3d65dc045 tempest-DeleteServersTestJSON-404477660 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:20:30.109301 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-1be00bae-6209-4e95-a90f-6cd3d65dc045 tempest-DeleteServersTestJSON-404477660 None] Volume volume-451b93e3-1579-44a1-b05d-3475df3c0e22 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:20:30.321060 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-1be00bae-6209-4e95-a90f-6cd3d65dc045 tempest-DeleteServersTestJSON-404477660 None] deleting rbd volume volume-451b93e3-1579-44a1-b05d-3475df3c0e22 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:20:37.976711 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-1be00bae-6209-4e95-a90f-6cd3d65dc045 tempest-DeleteServersTestJSON-404477660 None] Created reservations ['ffe103f2-d6ca-4b43-bff6-4ca0de1bbcf3', '6566eb34-1f81-4b1d-962b-de1add325534', '0eb316f3-59d9-486d-b476-1f38f94cc623', '0270edb0-9ef2-4532-8e4f-b0157bb02e43'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:20:38.171716 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-1be00bae-6209-4e95-a90f-6cd3d65dc045 tempest-DeleteServersTestJSON-404477660 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:20:38.197210 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-1be00bae-6209-4e95-a90f-6cd3d65dc045 tempest-DeleteServersTestJSON-404477660 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:20:38.232735 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-1be00bae-6209-4e95-a90f-6cd3d65dc045 tempest-DeleteServersTestJSON-404477660 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:20:38.237654 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-1be00bae-6209-4e95-a90f-6cd3d65dc045 tempest-DeleteServersTestJSON-404477660 None] Deleted volume successfully. Dec 25 21:20:38.308478 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-1be00bae-6209-4e95-a90f-6cd3d65dc045 tempest-DeleteServersTestJSON-404477660 None] Lock "b'cinder-451b93e3-1579-44a1-b05d-3475df3c0e22-delete_volume'" released by "delete_volume" :: held 8.904s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:21:24.868146 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0503c03-752e-4b1d-8c9e-46eb2c868087 tempest-AttachVolumeTestJSON-100156046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:21:24.872207 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-a0503c03-752e-4b1d-8c9e-46eb2c868087 tempest-AttachVolumeTestJSON-100156046 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:21:24.881364 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-a0503c03-752e-4b1d-8c9e-46eb2c868087 tempest-AttachVolumeTestJSON-100156046 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:21:24.887860 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a0503c03-752e-4b1d-8c9e-46eb2c868087 tempest-AttachVolumeTestJSON-100156046 None] Flow 'volume_create_manager' (383e693b-fce4-4165-b235-5fb621366ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:21:24.891620 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a0503c03-752e-4b1d-8c9e-46eb2c868087 tempest-AttachVolumeTestJSON-100156046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (480936bf-86b0-4897-bf88-65f3175e5c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:21:24.898546 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-a0503c03-752e-4b1d-8c9e-46eb2c868087 tempest-AttachVolumeTestJSON-100156046 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:21:24.914117 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a0503c03-752e-4b1d-8c9e-46eb2c868087 tempest-AttachVolumeTestJSON-100156046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (480936bf-86b0-4897-bf88-65f3175e5c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2084471050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4de2a9cd-6d5d-47b9-895c-cd2b5909bc97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ed80be6e633499b9d1dc61c05014afc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:21:25Z,use_quota=True,user_id='d0383b7f61484347ba9875a2636e1057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:21:24.917490 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a0503c03-752e-4b1d-8c9e-46eb2c868087 tempest-AttachVolumeTestJSON-100156046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c58d3a38-3e74-47e3-883e-5c6847d0af45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:21:24.920026 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a0503c03-752e-4b1d-8c9e-46eb2c868087 tempest-AttachVolumeTestJSON-100156046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c58d3a38-3e74-47e3-883e-5c6847d0af45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:21:24.922865 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a0503c03-752e-4b1d-8c9e-46eb2c868087 tempest-AttachVolumeTestJSON-100156046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2f85695-2549-4f1e-86bb-db825fc72720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:21:24.925377 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a0503c03-752e-4b1d-8c9e-46eb2c868087 tempest-AttachVolumeTestJSON-100156046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2f85695-2549-4f1e-86bb-db825fc72720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4de2a9cd-6d5d-47b9-895c-cd2b5909bc97', 'volume_name': 'volume-4de2a9cd-6d5d-47b9-895c-cd2b5909bc97', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:21:24.932359 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a0503c03-752e-4b1d-8c9e-46eb2c868087 tempest-AttachVolumeTestJSON-100156046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cb2b04c-8325-408b-a058-659cc8a05267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:21:24.935596 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a0503c03-752e-4b1d-8c9e-46eb2c868087 tempest-AttachVolumeTestJSON-100156046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cb2b04c-8325-408b-a058-659cc8a05267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:21:24.945376 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a0503c03-752e-4b1d-8c9e-46eb2c868087 tempest-AttachVolumeTestJSON-100156046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feca2bea-790e-4b4d-bbd7-f3926b7d0250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:21:24.945376 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-a0503c03-752e-4b1d-8c9e-46eb2c868087 tempest-AttachVolumeTestJSON-100156046 None] Volume 4de2a9cd-6d5d-47b9-895c-cd2b5909bc97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4de2a9cd-6d5d-47b9-895c-cd2b5909bc97', 'volume_size': 1} Dec 25 21:21:24.945376 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a0503c03-752e-4b1d-8c9e-46eb2c868087 tempest-AttachVolumeTestJSON-100156046 None] creating volume 'volume-4de2a9cd-6d5d-47b9-895c-cd2b5909bc97' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:21:24.945376 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a0503c03-752e-4b1d-8c9e-46eb2c868087 tempest-AttachVolumeTestJSON-100156046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:21:26.235856 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a0503c03-752e-4b1d-8c9e-46eb2c868087 tempest-AttachVolumeTestJSON-100156046 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:21:26.237958 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a0503c03-752e-4b1d-8c9e-46eb2c868087 tempest-AttachVolumeTestJSON-100156046 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:21:26.244298 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a0503c03-752e-4b1d-8c9e-46eb2c868087 tempest-AttachVolumeTestJSON-100156046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feca2bea-790e-4b4d-bbd7-f3926b7d0250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4de2a9cd-6d5d-47b9-895c-cd2b5909bc97', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:21:26.248154 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a0503c03-752e-4b1d-8c9e-46eb2c868087 tempest-AttachVolumeTestJSON-100156046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6542a84a-10e8-491d-ba6c-3908414c6b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:21:26.349371 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-a0503c03-752e-4b1d-8c9e-46eb2c868087 tempest-AttachVolumeTestJSON-100156046 None] Volume volume-4de2a9cd-6d5d-47b9-895c-cd2b5909bc97 (4de2a9cd-6d5d-47b9-895c-cd2b5909bc97): created successfully Dec 25 21:21:26.351541 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a0503c03-752e-4b1d-8c9e-46eb2c868087 tempest-AttachVolumeTestJSON-100156046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6542a84a-10e8-491d-ba6c-3908414c6b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:21:26.359112 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a0503c03-752e-4b1d-8c9e-46eb2c868087 tempest-AttachVolumeTestJSON-100156046 None] Flow 'volume_create_manager' (383e693b-fce4-4165-b235-5fb621366ccd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:21:26.433232 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-a0503c03-752e-4b1d-8c9e-46eb2c868087 tempest-AttachVolumeTestJSON-100156046 None] Created volume successfully. Dec 25 21:21:28.404830 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-7ebfb391-8ebf-4637-ba7c-7587316a5d87 req-61f1d84d-8371-4ddb-a534-02fb1d802394 tempest-AttachVolumeTestJSON-100156046 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:21:29.078044 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-7ebfb391-8ebf-4637-ba7c-7587316a5d87 req-61f1d84d-8371-4ddb-a534-02fb1d802394 tempest-AttachVolumeTestJSON-100156046 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.673s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:21:29.078855 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-7ebfb391-8ebf-4637-ba7c-7587316a5d87 req-61f1d84d-8371-4ddb-a534-02fb1d802394 tempest-AttachVolumeTestJSON-100156046 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4de2a9cd-6d5d-47b9-895c-cd2b5909bc97', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': '4de2a9cd-6d5d-47b9-895c-cd2b5909bc97', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 21:21:29.174950 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-7ebfb391-8ebf-4637-ba7c-7587316a5d87 req-61f1d84d-8371-4ddb-a534-02fb1d802394 tempest-AttachVolumeTestJSON-100156046 None] Connection info returned from driver {'name': 'volumes/volume-4de2a9cd-6d5d-47b9-895c-cd2b5909bc97', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '4de2a9cd-6d5d-47b9-895c-cd2b5909bc97', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '95665fd5-eb6d-4f71-a2df-4754e855faed'} {{(pid=129926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 25 21:21:29.290776 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-7ebfb391-8ebf-4637-ba7c-7587316a5d87 req-61f1d84d-8371-4ddb-a534-02fb1d802394 tempest-AttachVolumeTestJSON-100156046 None] attachment_update completed successfully. Dec 25 21:21:29.562516 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:21:29.563589 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:21:29.592998 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:21:29.655507 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:21:34.375961 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-040d5121-3628-4fa6-9c9a-fb1c1464f7bb tempest-AttachVolumeTestJSON-100156046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:21:34.380375 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-040d5121-3628-4fa6-9c9a-fb1c1464f7bb tempest-AttachVolumeTestJSON-100156046 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:21:34.380896 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-040d5121-3628-4fa6-9c9a-fb1c1464f7bb tempest-AttachVolumeTestJSON-100156046 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:21:34.393446 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-040d5121-3628-4fa6-9c9a-fb1c1464f7bb tempest-AttachVolumeTestJSON-100156046 None] Flow 'volume_create_manager' (8b95c7a7-ef62-4654-928d-fe0b12bbeefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:21:34.396671 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-040d5121-3628-4fa6-9c9a-fb1c1464f7bb tempest-AttachVolumeTestJSON-100156046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb0eeea-6b89-40d4-b112-8b16c6cafb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:21:34.403867 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-040d5121-3628-4fa6-9c9a-fb1c1464f7bb tempest-AttachVolumeTestJSON-100156046 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:21:34.417636 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-040d5121-3628-4fa6-9c9a-fb1c1464f7bb tempest-AttachVolumeTestJSON-100156046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb0eeea-6b89-40d4-b112-8b16c6cafb95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1010211045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2ff193c5-1a26-432e-be9f-a6ab5fa96be0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ed80be6e633499b9d1dc61c05014afc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:21:34Z,use_quota=True,user_id='d0383b7f61484347ba9875a2636e1057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:21:34.420833 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-040d5121-3628-4fa6-9c9a-fb1c1464f7bb tempest-AttachVolumeTestJSON-100156046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (113398a1-6892-4771-a3eb-288b7fe93292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:21:34.423035 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-040d5121-3628-4fa6-9c9a-fb1c1464f7bb tempest-AttachVolumeTestJSON-100156046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (113398a1-6892-4771-a3eb-288b7fe93292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:21:34.425473 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-040d5121-3628-4fa6-9c9a-fb1c1464f7bb tempest-AttachVolumeTestJSON-100156046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0805f1f-ea17-464e-a004-23c2acd982a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:21:34.427741 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-040d5121-3628-4fa6-9c9a-fb1c1464f7bb tempest-AttachVolumeTestJSON-100156046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0805f1f-ea17-464e-a004-23c2acd982a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ff193c5-1a26-432e-be9f-a6ab5fa96be0', 'volume_name': 'volume-2ff193c5-1a26-432e-be9f-a6ab5fa96be0', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:21:34.430169 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-040d5121-3628-4fa6-9c9a-fb1c1464f7bb tempest-AttachVolumeTestJSON-100156046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c24e5df4-bf9c-4137-81bf-6594ea9f3003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:21:34.432322 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-040d5121-3628-4fa6-9c9a-fb1c1464f7bb tempest-AttachVolumeTestJSON-100156046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c24e5df4-bf9c-4137-81bf-6594ea9f3003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:21:34.434712 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-040d5121-3628-4fa6-9c9a-fb1c1464f7bb tempest-AttachVolumeTestJSON-100156046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (750a3ecd-06f3-44d9-a41a-73e51f94e50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:21:34.435559 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-040d5121-3628-4fa6-9c9a-fb1c1464f7bb tempest-AttachVolumeTestJSON-100156046 None] Volume 2ff193c5-1a26-432e-be9f-a6ab5fa96be0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ff193c5-1a26-432e-be9f-a6ab5fa96be0', 'volume_size': 1} Dec 25 21:21:34.436221 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-040d5121-3628-4fa6-9c9a-fb1c1464f7bb tempest-AttachVolumeTestJSON-100156046 None] creating volume 'volume-2ff193c5-1a26-432e-be9f-a6ab5fa96be0' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:21:34.437245 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-040d5121-3628-4fa6-9c9a-fb1c1464f7bb tempest-AttachVolumeTestJSON-100156046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:21:35.561137 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-040d5121-3628-4fa6-9c9a-fb1c1464f7bb tempest-AttachVolumeTestJSON-100156046 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:21:35.562216 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-040d5121-3628-4fa6-9c9a-fb1c1464f7bb tempest-AttachVolumeTestJSON-100156046 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:21:35.564408 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-040d5121-3628-4fa6-9c9a-fb1c1464f7bb tempest-AttachVolumeTestJSON-100156046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (750a3ecd-06f3-44d9-a41a-73e51f94e50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ff193c5-1a26-432e-be9f-a6ab5fa96be0', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:21:35.570817 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-040d5121-3628-4fa6-9c9a-fb1c1464f7bb tempest-AttachVolumeTestJSON-100156046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff46f08d-2a88-42da-9360-457229808336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:21:35.666310 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-040d5121-3628-4fa6-9c9a-fb1c1464f7bb tempest-AttachVolumeTestJSON-100156046 None] Volume volume-2ff193c5-1a26-432e-be9f-a6ab5fa96be0 (2ff193c5-1a26-432e-be9f-a6ab5fa96be0): created successfully Dec 25 21:21:35.669026 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-040d5121-3628-4fa6-9c9a-fb1c1464f7bb tempest-AttachVolumeTestJSON-100156046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff46f08d-2a88-42da-9360-457229808336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:21:35.672931 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-040d5121-3628-4fa6-9c9a-fb1c1464f7bb tempest-AttachVolumeTestJSON-100156046 None] Flow 'volume_create_manager' (8b95c7a7-ef62-4654-928d-fe0b12bbeefa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:21:35.745999 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-040d5121-3628-4fa6-9c9a-fb1c1464f7bb tempest-AttachVolumeTestJSON-100156046 None] Created volume successfully. Dec 25 21:21:37.559077 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-1100f1e4-49aa-494d-89ed-122fe539f2e3 req-be336786-0099-4129-9e65-a91d1881d904 tempest-AttachVolumeTestJSON-100156046 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:21:38.652341 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-1100f1e4-49aa-494d-89ed-122fe539f2e3 req-be336786-0099-4129-9e65-a91d1881d904 tempest-AttachVolumeTestJSON-100156046 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.095s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:21:38.655321 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-1100f1e4-49aa-494d-89ed-122fe539f2e3 req-be336786-0099-4129-9e65-a91d1881d904 tempest-AttachVolumeTestJSON-100156046 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2ff193c5-1a26-432e-be9f-a6ab5fa96be0', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': '2ff193c5-1a26-432e-be9f-a6ab5fa96be0', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 21:21:38.802934 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-1100f1e4-49aa-494d-89ed-122fe539f2e3 req-be336786-0099-4129-9e65-a91d1881d904 tempest-AttachVolumeTestJSON-100156046 None] Connection info returned from driver {'name': 'volumes/volume-2ff193c5-1a26-432e-be9f-a6ab5fa96be0', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2ff193c5-1a26-432e-be9f-a6ab5fa96be0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'd3a4c3b3-94df-428c-9f4f-6446d60e8a7d'} {{(pid=129926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 25 21:21:38.931666 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-1100f1e4-49aa-494d-89ed-122fe539f2e3 req-be336786-0099-4129-9e65-a91d1881d904 tempest-AttachVolumeTestJSON-100156046 None] attachment_update completed successfully. Dec 25 21:21:38.974437 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2bc7bc2-3972-44fd-bb6f-e61fce59506e tempest-AttachVolumeNegativeTest-2126197630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:21:38.981933 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-d2bc7bc2-3972-44fd-bb6f-e61fce59506e tempest-AttachVolumeNegativeTest-2126197630 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:21:38.981933 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-d2bc7bc2-3972-44fd-bb6f-e61fce59506e tempest-AttachVolumeNegativeTest-2126197630 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:21:38.998347 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-d2bc7bc2-3972-44fd-bb6f-e61fce59506e tempest-AttachVolumeNegativeTest-2126197630 None] Flow 'volume_create_manager' (3a4555ae-fe8b-4af4-8642-5c8b6a78b270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:21:39.009359 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-d2bc7bc2-3972-44fd-bb6f-e61fce59506e tempest-AttachVolumeNegativeTest-2126197630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7405f17-238c-496b-ad30-89741dd56416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:21:39.017173 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-d2bc7bc2-3972-44fd-bb6f-e61fce59506e tempest-AttachVolumeNegativeTest-2126197630 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:21:39.041769 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-d2bc7bc2-3972-44fd-bb6f-e61fce59506e tempest-AttachVolumeNegativeTest-2126197630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7405f17-238c-496b-ad30-89741dd56416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2019908353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=aa359d7e-7889-4e7a-9d7d-20b3a5bd215b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dcf2517f61849cb9650682caf0c5712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:21:39Z,use_quota=True,user_id='d7df5c79b8ea4c6ea7cf84b381b29765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:21:39.050016 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-d2bc7bc2-3972-44fd-bb6f-e61fce59506e tempest-AttachVolumeNegativeTest-2126197630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b62bb521-55db-4a85-afd9-5bb5dd67e5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:21:39.050016 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-d2bc7bc2-3972-44fd-bb6f-e61fce59506e tempest-AttachVolumeNegativeTest-2126197630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b62bb521-55db-4a85-afd9-5bb5dd67e5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:21:39.051986 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-d2bc7bc2-3972-44fd-bb6f-e61fce59506e tempest-AttachVolumeNegativeTest-2126197630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc9fa855-c1cd-45d5-a997-adcd16fe6256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:21:39.055704 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-d2bc7bc2-3972-44fd-bb6f-e61fce59506e tempest-AttachVolumeNegativeTest-2126197630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc9fa855-c1cd-45d5-a997-adcd16fe6256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa359d7e-7889-4e7a-9d7d-20b3a5bd215b', 'volume_name': 'volume-aa359d7e-7889-4e7a-9d7d-20b3a5bd215b', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:21:39.058490 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-d2bc7bc2-3972-44fd-bb6f-e61fce59506e tempest-AttachVolumeNegativeTest-2126197630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (223ff240-fab2-49fd-9d5d-d0ed501f04d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:21:39.061339 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-d2bc7bc2-3972-44fd-bb6f-e61fce59506e tempest-AttachVolumeNegativeTest-2126197630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (223ff240-fab2-49fd-9d5d-d0ed501f04d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:21:39.064635 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-d2bc7bc2-3972-44fd-bb6f-e61fce59506e tempest-AttachVolumeNegativeTest-2126197630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85a58f00-ac71-4742-8ff8-77cc4c2a90b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:21:39.066002 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-d2bc7bc2-3972-44fd-bb6f-e61fce59506e tempest-AttachVolumeNegativeTest-2126197630 None] Volume aa359d7e-7889-4e7a-9d7d-20b3a5bd215b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa359d7e-7889-4e7a-9d7d-20b3a5bd215b', 'volume_size': 1} Dec 25 21:21:39.066681 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-d2bc7bc2-3972-44fd-bb6f-e61fce59506e tempest-AttachVolumeNegativeTest-2126197630 None] creating volume 'volume-aa359d7e-7889-4e7a-9d7d-20b3a5bd215b' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:21:39.068943 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-d2bc7bc2-3972-44fd-bb6f-e61fce59506e tempest-AttachVolumeNegativeTest-2126197630 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:21:40.247899 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-d2bc7bc2-3972-44fd-bb6f-e61fce59506e tempest-AttachVolumeNegativeTest-2126197630 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:21:40.254764 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-d2bc7bc2-3972-44fd-bb6f-e61fce59506e tempest-AttachVolumeNegativeTest-2126197630 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:21:40.254764 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-d2bc7bc2-3972-44fd-bb6f-e61fce59506e tempest-AttachVolumeNegativeTest-2126197630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85a58f00-ac71-4742-8ff8-77cc4c2a90b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa359d7e-7889-4e7a-9d7d-20b3a5bd215b', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:21:40.254764 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-d2bc7bc2-3972-44fd-bb6f-e61fce59506e tempest-AttachVolumeNegativeTest-2126197630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a99b1332-cb2b-4dc8-88ad-9cd2a59c7a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:21:40.325086 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-d2bc7bc2-3972-44fd-bb6f-e61fce59506e tempest-AttachVolumeNegativeTest-2126197630 None] Volume volume-aa359d7e-7889-4e7a-9d7d-20b3a5bd215b (aa359d7e-7889-4e7a-9d7d-20b3a5bd215b): created successfully Dec 25 21:21:40.325086 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-d2bc7bc2-3972-44fd-bb6f-e61fce59506e tempest-AttachVolumeNegativeTest-2126197630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a99b1332-cb2b-4dc8-88ad-9cd2a59c7a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:21:40.329158 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-d2bc7bc2-3972-44fd-bb6f-e61fce59506e tempest-AttachVolumeNegativeTest-2126197630 None] Flow 'volume_create_manager' (3a4555ae-fe8b-4af4-8642-5c8b6a78b270) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:21:40.396392 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-d2bc7bc2-3972-44fd-bb6f-e61fce59506e tempest-AttachVolumeNegativeTest-2126197630 None] Created volume successfully. Dec 25 21:21:42.871222 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-4e975190-a5f1-447a-a8e9-19e3d4b822e4 req-bef65c6f-0c6c-41e6-a28f-479eb8dcca73 tempest-AttachVolumeNegativeTest-2126197630 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:21:44.152355 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-4e975190-a5f1-447a-a8e9-19e3d4b822e4 req-bef65c6f-0c6c-41e6-a28f-479eb8dcca73 tempest-AttachVolumeNegativeTest-2126197630 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.280s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:21:44.152847 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-4e975190-a5f1-447a-a8e9-19e3d4b822e4 req-bef65c6f-0c6c-41e6-a28f-479eb8dcca73 tempest-AttachVolumeNegativeTest-2126197630 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-aa359d7e-7889-4e7a-9d7d-20b3a5bd215b', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': 'aa359d7e-7889-4e7a-9d7d-20b3a5bd215b', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 21:21:44.264926 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-4e975190-a5f1-447a-a8e9-19e3d4b822e4 req-bef65c6f-0c6c-41e6-a28f-479eb8dcca73 tempest-AttachVolumeNegativeTest-2126197630 None] Connection info returned from driver {'name': 'volumes/volume-aa359d7e-7889-4e7a-9d7d-20b3a5bd215b', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'aa359d7e-7889-4e7a-9d7d-20b3a5bd215b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a51d88d0-c3b4-4b44-b990-7825a189b214'} {{(pid=129926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 25 21:21:44.435130 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-4e975190-a5f1-447a-a8e9-19e3d4b822e4 req-bef65c6f-0c6c-41e6-a28f-479eb8dcca73 tempest-AttachVolumeNegativeTest-2126197630 None] attachment_update completed successfully. Dec 25 21:21:45.215038 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-daa27059-9ddd-4119-9ffd-36f151405ef0 req-12a55622-db20-445f-983c-12ae2d1ca923 tempest-AttachVolumeTestJSON-100156046 None] Terminate volume connection completed successfully. Dec 25 21:21:45.215657 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-daa27059-9ddd-4119-9ffd-36f151405ef0 req-12a55622-db20-445f-983c-12ae2d1ca923 tempest-AttachVolumeTestJSON-100156046 None] Deleting attachment 95665fd5-eb6d-4f71-a2df-4754e855faed. {{(pid=129926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 25 21:21:46.733327 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-1e4ef324-a8ad-446e-8cfb-cedc89ab5f49 req-2a2eb842-e8c2-426b-8df2-43717a9a3f0c tempest-AttachVolumeTestJSON-100156046 None] Terminate volume connection completed successfully. Dec 25 21:21:46.733974 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-1e4ef324-a8ad-446e-8cfb-cedc89ab5f49 req-2a2eb842-e8c2-426b-8df2-43717a9a3f0c tempest-AttachVolumeTestJSON-100156046 None] Deleting attachment d3a4c3b3-94df-428c-9f4f-6446d60e8a7d. {{(pid=129926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 25 21:21:57.659951 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-b523342c-cedd-4dae-88a5-48b39e9d8b5e tempest-AttachVolumeTestJSON-100156046 None] Lock "b'cinder-2ff193c5-1a26-432e-be9f-a6ab5fa96be0-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:21:57.786147 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b523342c-cedd-4dae-88a5-48b39e9d8b5e tempest-AttachVolumeTestJSON-100156046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:21:57.963076 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b523342c-cedd-4dae-88a5-48b39e9d8b5e tempest-AttachVolumeTestJSON-100156046 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:21:57.963896 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b523342c-cedd-4dae-88a5-48b39e9d8b5e tempest-AttachVolumeTestJSON-100156046 None] Volume volume-2ff193c5-1a26-432e-be9f-a6ab5fa96be0 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:21:58.240923 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b523342c-cedd-4dae-88a5-48b39e9d8b5e tempest-AttachVolumeTestJSON-100156046 None] deleting rbd volume volume-2ff193c5-1a26-432e-be9f-a6ab5fa96be0 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:22:03.639425 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-9468674c-8bbf-45a4-a859-998bdd4bc428 tempest-ServersNegativeTestJSON-1875920152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:22:03.643204 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-9468674c-8bbf-45a4-a859-998bdd4bc428 tempest-ServersNegativeTestJSON-1875920152 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:22:03.643687 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-9468674c-8bbf-45a4-a859-998bdd4bc428 tempest-ServersNegativeTestJSON-1875920152 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:22:03.657234 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-9468674c-8bbf-45a4-a859-998bdd4bc428 tempest-ServersNegativeTestJSON-1875920152 None] Flow 'volume_create_manager' (fbf8afbb-44f5-459b-9b72-51c864ff30e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:22:03.660591 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-9468674c-8bbf-45a4-a859-998bdd4bc428 tempest-ServersNegativeTestJSON-1875920152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edf4046b-55c4-4579-8119-e32d0109e22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:03.667600 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-9468674c-8bbf-45a4-a859-998bdd4bc428 tempest-ServersNegativeTestJSON-1875920152 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:22:03.680051 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-9468674c-8bbf-45a4-a859-998bdd4bc428 tempest-ServersNegativeTestJSON-1875920152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edf4046b-55c4-4579-8119-e32d0109e22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-665556359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4fbcf4fb-0878-421e-9c0a-fee002967afc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66319858228140b3841ef6c7c8cd5c14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:22:03Z,use_quota=True,user_id='257eeccacdc24f00a418cbb27204cf4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:03.682700 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-9468674c-8bbf-45a4-a859-998bdd4bc428 tempest-ServersNegativeTestJSON-1875920152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f8cbe4a-a5b4-46f1-aedf-63009482e656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:03.686855 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-9468674c-8bbf-45a4-a859-998bdd4bc428 tempest-ServersNegativeTestJSON-1875920152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f8cbe4a-a5b4-46f1-aedf-63009482e656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:03.687251 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-9468674c-8bbf-45a4-a859-998bdd4bc428 tempest-ServersNegativeTestJSON-1875920152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adb7f6ee-ae15-4bc0-b846-f3e9b6b31a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:03.689494 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-9468674c-8bbf-45a4-a859-998bdd4bc428 tempest-ServersNegativeTestJSON-1875920152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adb7f6ee-ae15-4bc0-b846-f3e9b6b31a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fbcf4fb-0878-421e-9c0a-fee002967afc', 'volume_name': 'volume-4fbcf4fb-0878-421e-9c0a-fee002967afc', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:03.691760 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-9468674c-8bbf-45a4-a859-998bdd4bc428 tempest-ServersNegativeTestJSON-1875920152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c97c659b-2fe5-4c82-9c4c-7857e8913ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:03.693880 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-9468674c-8bbf-45a4-a859-998bdd4bc428 tempest-ServersNegativeTestJSON-1875920152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c97c659b-2fe5-4c82-9c4c-7857e8913ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:03.696438 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-9468674c-8bbf-45a4-a859-998bdd4bc428 tempest-ServersNegativeTestJSON-1875920152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc060443-7a16-4122-92bb-a54ee38008d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:03.697252 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-9468674c-8bbf-45a4-a859-998bdd4bc428 tempest-ServersNegativeTestJSON-1875920152 None] Volume 4fbcf4fb-0878-421e-9c0a-fee002967afc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fbcf4fb-0878-421e-9c0a-fee002967afc', 'volume_size': 1} Dec 25 21:22:03.697654 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-9468674c-8bbf-45a4-a859-998bdd4bc428 tempest-ServersNegativeTestJSON-1875920152 None] creating volume 'volume-4fbcf4fb-0878-421e-9c0a-fee002967afc' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:22:03.698620 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-9468674c-8bbf-45a4-a859-998bdd4bc428 tempest-ServersNegativeTestJSON-1875920152 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:22:04.811264 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-9468674c-8bbf-45a4-a859-998bdd4bc428 tempest-ServersNegativeTestJSON-1875920152 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:22:04.811990 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-9468674c-8bbf-45a4-a859-998bdd4bc428 tempest-ServersNegativeTestJSON-1875920152 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:22:04.813671 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-9468674c-8bbf-45a4-a859-998bdd4bc428 tempest-ServersNegativeTestJSON-1875920152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc060443-7a16-4122-92bb-a54ee38008d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fbcf4fb-0878-421e-9c0a-fee002967afc', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:04.815856 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-9468674c-8bbf-45a4-a859-998bdd4bc428 tempest-ServersNegativeTestJSON-1875920152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f312460-3b37-4114-81cf-1a7ebf0bc3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:04.922308 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-9468674c-8bbf-45a4-a859-998bdd4bc428 tempest-ServersNegativeTestJSON-1875920152 None] Volume volume-4fbcf4fb-0878-421e-9c0a-fee002967afc (4fbcf4fb-0878-421e-9c0a-fee002967afc): created successfully Dec 25 21:22:04.924340 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-9468674c-8bbf-45a4-a859-998bdd4bc428 tempest-ServersNegativeTestJSON-1875920152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f312460-3b37-4114-81cf-1a7ebf0bc3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:04.927544 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-9468674c-8bbf-45a4-a859-998bdd4bc428 tempest-ServersNegativeTestJSON-1875920152 None] Flow 'volume_create_manager' (fbf8afbb-44f5-459b-9b72-51c864ff30e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:22:05.013381 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-9468674c-8bbf-45a4-a859-998bdd4bc428 tempest-ServersNegativeTestJSON-1875920152 None] Created volume successfully. Dec 25 21:22:05.866447 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-b523342c-cedd-4dae-88a5-48b39e9d8b5e tempest-AttachVolumeTestJSON-100156046 None] Created reservations ['f9aa4ab0-153d-4a62-88ee-e24510eb0c81', '3981cddb-b308-4a4a-b72d-3b39ed964e92', '24574117-0783-4c5a-8fe0-c5d31f5b287b', '10ee0385-6dc7-464f-944f-3477655a895f'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:22:06.058123 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b523342c-cedd-4dae-88a5-48b39e9d8b5e tempest-AttachVolumeTestJSON-100156046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:22:06.109277 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b523342c-cedd-4dae-88a5-48b39e9d8b5e tempest-AttachVolumeTestJSON-100156046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:22:06.154318 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-b523342c-cedd-4dae-88a5-48b39e9d8b5e tempest-AttachVolumeTestJSON-100156046 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:22:06.158843 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-b523342c-cedd-4dae-88a5-48b39e9d8b5e tempest-AttachVolumeTestJSON-100156046 None] Deleted volume successfully. Dec 25 21:22:06.271788 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-b523342c-cedd-4dae-88a5-48b39e9d8b5e tempest-AttachVolumeTestJSON-100156046 None] Lock "b'cinder-2ff193c5-1a26-432e-be9f-a6ab5fa96be0-delete_volume'" released by "delete_volume" :: held 8.613s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:22:06.379403 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-35f295ec-65f6-4640-bcb4-8313c4e16d05 tempest-AttachVolumeTestJSON-100156046 None] Lock "b'cinder-4de2a9cd-6d5d-47b9-895c-cd2b5909bc97-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:22:06.492247 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-35f295ec-65f6-4640-bcb4-8313c4e16d05 tempest-AttachVolumeTestJSON-100156046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:22:06.824985 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-35f295ec-65f6-4640-bcb4-8313c4e16d05 tempest-AttachVolumeTestJSON-100156046 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:22:06.830962 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-35f295ec-65f6-4640-bcb4-8313c4e16d05 tempest-AttachVolumeTestJSON-100156046 None] Volume volume-4de2a9cd-6d5d-47b9-895c-cd2b5909bc97 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:22:07.062734 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-35f295ec-65f6-4640-bcb4-8313c4e16d05 tempest-AttachVolumeTestJSON-100156046 None] deleting rbd volume volume-4de2a9cd-6d5d-47b9-895c-cd2b5909bc97 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:22:07.139936 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-e66c6bb7-849e-417e-9c33-4158f162f1e6 tempest-ServersNegativeTestJSON-1875920152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:22:07.143416 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-e66c6bb7-849e-417e-9c33-4158f162f1e6 tempest-ServersNegativeTestJSON-1875920152 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:22:07.143939 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-e66c6bb7-849e-417e-9c33-4158f162f1e6 tempest-ServersNegativeTestJSON-1875920152 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:22:07.161204 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e66c6bb7-849e-417e-9c33-4158f162f1e6 tempest-ServersNegativeTestJSON-1875920152 None] Flow 'volume_create_manager' (df027bf0-49de-449a-8b78-275c6004e6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:22:07.164703 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e66c6bb7-849e-417e-9c33-4158f162f1e6 tempest-ServersNegativeTestJSON-1875920152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53217d47-01d1-4a04-9116-178be3c9cff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:07.171235 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-e66c6bb7-849e-417e-9c33-4158f162f1e6 tempest-ServersNegativeTestJSON-1875920152 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:22:07.183930 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e66c6bb7-849e-417e-9c33-4158f162f1e6 tempest-ServersNegativeTestJSON-1875920152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53217d47-01d1-4a04-9116-178be3c9cff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1357806154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c7f962ef-3f30-4f92-a684-1bdaf2635c0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66319858228140b3841ef6c7c8cd5c14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:22:07Z,use_quota=True,user_id='257eeccacdc24f00a418cbb27204cf4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:07.186804 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e66c6bb7-849e-417e-9c33-4158f162f1e6 tempest-ServersNegativeTestJSON-1875920152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffc0c074-340a-45e6-96ec-bf3255248259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:07.188959 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e66c6bb7-849e-417e-9c33-4158f162f1e6 tempest-ServersNegativeTestJSON-1875920152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffc0c074-340a-45e6-96ec-bf3255248259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:07.191431 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e66c6bb7-849e-417e-9c33-4158f162f1e6 tempest-ServersNegativeTestJSON-1875920152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c858bb1-f941-4c20-854b-e4c20b3aa4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:07.194760 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e66c6bb7-849e-417e-9c33-4158f162f1e6 tempest-ServersNegativeTestJSON-1875920152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c858bb1-f941-4c20-854b-e4c20b3aa4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7f962ef-3f30-4f92-a684-1bdaf2635c0b', 'volume_name': 'volume-c7f962ef-3f30-4f92-a684-1bdaf2635c0b', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:07.197693 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e66c6bb7-849e-417e-9c33-4158f162f1e6 tempest-ServersNegativeTestJSON-1875920152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdf31158-14f7-4add-bad6-1cc17b9bb664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:07.201638 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e66c6bb7-849e-417e-9c33-4158f162f1e6 tempest-ServersNegativeTestJSON-1875920152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdf31158-14f7-4add-bad6-1cc17b9bb664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:07.204837 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e66c6bb7-849e-417e-9c33-4158f162f1e6 tempest-ServersNegativeTestJSON-1875920152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80b5280a-41b7-498b-861d-217968163f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:07.205690 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-e66c6bb7-849e-417e-9c33-4158f162f1e6 tempest-ServersNegativeTestJSON-1875920152 None] Volume c7f962ef-3f30-4f92-a684-1bdaf2635c0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7f962ef-3f30-4f92-a684-1bdaf2635c0b', 'volume_size': 1} Dec 25 21:22:07.206135 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e66c6bb7-849e-417e-9c33-4158f162f1e6 tempest-ServersNegativeTestJSON-1875920152 None] creating volume 'volume-c7f962ef-3f30-4f92-a684-1bdaf2635c0b' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:22:07.207150 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e66c6bb7-849e-417e-9c33-4158f162f1e6 tempest-ServersNegativeTestJSON-1875920152 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:22:07.802844 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-ec1c77c5-0fdc-49ea-b97d-e95548098b26 req-23a5c754-8198-4849-959d-93a30283d966 tempest-AttachVolumeNegativeTest-2126197630 None] Terminate volume connection completed successfully. Dec 25 21:22:07.803263 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-ec1c77c5-0fdc-49ea-b97d-e95548098b26 req-23a5c754-8198-4849-959d-93a30283d966 tempest-AttachVolumeNegativeTest-2126197630 None] Deleting attachment a51d88d0-c3b4-4b44-b990-7825a189b214. {{(pid=129926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 25 21:22:08.260001 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e66c6bb7-849e-417e-9c33-4158f162f1e6 tempest-ServersNegativeTestJSON-1875920152 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:22:08.260632 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e66c6bb7-849e-417e-9c33-4158f162f1e6 tempest-ServersNegativeTestJSON-1875920152 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:22:08.262501 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e66c6bb7-849e-417e-9c33-4158f162f1e6 tempest-ServersNegativeTestJSON-1875920152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80b5280a-41b7-498b-861d-217968163f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7f962ef-3f30-4f92-a684-1bdaf2635c0b', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:08.264705 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e66c6bb7-849e-417e-9c33-4158f162f1e6 tempest-ServersNegativeTestJSON-1875920152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2056f25e-ebe0-4e51-83f3-f5c47693bd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:08.360079 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-e66c6bb7-849e-417e-9c33-4158f162f1e6 tempest-ServersNegativeTestJSON-1875920152 None] Volume volume-c7f962ef-3f30-4f92-a684-1bdaf2635c0b (c7f962ef-3f30-4f92-a684-1bdaf2635c0b): created successfully Dec 25 21:22:08.362103 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e66c6bb7-849e-417e-9c33-4158f162f1e6 tempest-ServersNegativeTestJSON-1875920152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2056f25e-ebe0-4e51-83f3-f5c47693bd74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:08.365116 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e66c6bb7-849e-417e-9c33-4158f162f1e6 tempest-ServersNegativeTestJSON-1875920152 None] Flow 'volume_create_manager' (df027bf0-49de-449a-8b78-275c6004e6b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:22:08.440381 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-e66c6bb7-849e-417e-9c33-4158f162f1e6 tempest-ServersNegativeTestJSON-1875920152 None] Created volume successfully. Dec 25 21:22:15.217670 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-35f295ec-65f6-4640-bcb4-8313c4e16d05 tempest-AttachVolumeTestJSON-100156046 None] Created reservations ['53889187-55ad-41a5-b0a8-ed666560fe6c', '1655a64b-4e1b-41c6-8368-63b1377c2284', '11c604b5-0cb4-41eb-ac09-9485dbdc0711', '837c3ee5-ed4c-45fa-a31d-0e4993dc05c4'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:22:15.516443 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-35f295ec-65f6-4640-bcb4-8313c4e16d05 tempest-AttachVolumeTestJSON-100156046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:22:15.540399 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-35f295ec-65f6-4640-bcb4-8313c4e16d05 tempest-AttachVolumeTestJSON-100156046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:22:15.565749 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-35f295ec-65f6-4640-bcb4-8313c4e16d05 tempest-AttachVolumeTestJSON-100156046 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:22:15.570739 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-35f295ec-65f6-4640-bcb4-8313c4e16d05 tempest-AttachVolumeTestJSON-100156046 None] Deleted volume successfully. Dec 25 21:22:15.634890 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-35f295ec-65f6-4640-bcb4-8313c4e16d05 tempest-AttachVolumeTestJSON-100156046 None] Lock "b'cinder-4de2a9cd-6d5d-47b9-895c-cd2b5909bc97-delete_volume'" released by "delete_volume" :: held 9.255s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:22:16.315340 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-240f3ac3-f585-4b3e-87b9-5bbd098aacd0 tempest-AttachVolumeTestJSON-100156046 None] Lock "b'cinder-9ddbed29-7029-4b8d-ab16-b904195f2582-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:22:16.419885 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-240f3ac3-f585-4b3e-87b9-5bbd098aacd0 tempest-AttachVolumeTestJSON-100156046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:22:16.668202 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-240f3ac3-f585-4b3e-87b9-5bbd098aacd0 tempest-AttachVolumeTestJSON-100156046 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:22:16.668202 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-240f3ac3-f585-4b3e-87b9-5bbd098aacd0 tempest-AttachVolumeTestJSON-100156046 None] Volume volume-9ddbed29-7029-4b8d-ab16-b904195f2582 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:22:16.969570 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-240f3ac3-f585-4b3e-87b9-5bbd098aacd0 tempest-AttachVolumeTestJSON-100156046 None] deleting rbd volume volume-9ddbed29-7029-4b8d-ab16-b904195f2582 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:22:24.493417 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-240f3ac3-f585-4b3e-87b9-5bbd098aacd0 tempest-AttachVolumeTestJSON-100156046 None] Created reservations ['e6794256-b8a4-4b63-8a41-cd9d9466028c', '0077f91c-e4b2-47bd-8d06-8696c47fb723', '2e950f44-1fbf-42aa-8ad2-c1b61a08b9ad', '9be46ab0-54e5-4ae6-9bce-3719633c914a'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:22:24.681261 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-240f3ac3-f585-4b3e-87b9-5bbd098aacd0 tempest-AttachVolumeTestJSON-100156046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:22:24.706124 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-240f3ac3-f585-4b3e-87b9-5bbd098aacd0 tempest-AttachVolumeTestJSON-100156046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:22:24.804821 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-240f3ac3-f585-4b3e-87b9-5bbd098aacd0 tempest-AttachVolumeTestJSON-100156046 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:22:24.813040 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-240f3ac3-f585-4b3e-87b9-5bbd098aacd0 tempest-AttachVolumeTestJSON-100156046 None] Deleted volume successfully. Dec 25 21:22:24.905237 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-240f3ac3-f585-4b3e-87b9-5bbd098aacd0 tempest-AttachVolumeTestJSON-100156046 None] Lock "b'cinder-9ddbed29-7029-4b8d-ab16-b904195f2582-delete_volume'" released by "delete_volume" :: held 8.590s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:22:25.384287 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-39b35891-b4fe-48ee-b972-20e279dc7d72 tempest-AttachVolumeNegativeTest-2126197630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:22:25.388078 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-39b35891-b4fe-48ee-b972-20e279dc7d72 tempest-AttachVolumeNegativeTest-2126197630 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:22:25.388804 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-39b35891-b4fe-48ee-b972-20e279dc7d72 tempest-AttachVolumeNegativeTest-2126197630 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:22:25.403166 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-39b35891-b4fe-48ee-b972-20e279dc7d72 tempest-AttachVolumeNegativeTest-2126197630 None] Flow 'volume_create_manager' (ec672189-7a03-4f65-8fda-100fb6e84f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:22:25.413375 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-39b35891-b4fe-48ee-b972-20e279dc7d72 tempest-AttachVolumeNegativeTest-2126197630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5efa00d5-e5cd-4219-8e98-b8876c329246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:25.416326 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-39b35891-b4fe-48ee-b972-20e279dc7d72 tempest-AttachVolumeNegativeTest-2126197630 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:22:25.433418 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-39b35891-b4fe-48ee-b972-20e279dc7d72 tempest-AttachVolumeNegativeTest-2126197630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5efa00d5-e5cd-4219-8e98-b8876c329246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1232580472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0eac0146-d3ac-44c5-8076-4c22e019600b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dcf2517f61849cb9650682caf0c5712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:22:25Z,use_quota=True,user_id='d7df5c79b8ea4c6ea7cf84b381b29765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:25.436227 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-39b35891-b4fe-48ee-b972-20e279dc7d72 tempest-AttachVolumeNegativeTest-2126197630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61de897f-cf65-4d9e-8c05-ae4250c89055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:25.438770 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-39b35891-b4fe-48ee-b972-20e279dc7d72 tempest-AttachVolumeNegativeTest-2126197630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61de897f-cf65-4d9e-8c05-ae4250c89055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:25.441634 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-39b35891-b4fe-48ee-b972-20e279dc7d72 tempest-AttachVolumeNegativeTest-2126197630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c525520-49c3-4deb-b84f-9f3edbd3a879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:25.444122 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-39b35891-b4fe-48ee-b972-20e279dc7d72 tempest-AttachVolumeNegativeTest-2126197630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c525520-49c3-4deb-b84f-9f3edbd3a879) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0eac0146-d3ac-44c5-8076-4c22e019600b', 'volume_name': 'volume-0eac0146-d3ac-44c5-8076-4c22e019600b', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:25.447213 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-39b35891-b4fe-48ee-b972-20e279dc7d72 tempest-AttachVolumeNegativeTest-2126197630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93ab1c93-9501-45d3-a944-f92105d01d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:25.449591 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-39b35891-b4fe-48ee-b972-20e279dc7d72 tempest-AttachVolumeNegativeTest-2126197630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93ab1c93-9501-45d3-a944-f92105d01d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:25.456999 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-39b35891-b4fe-48ee-b972-20e279dc7d72 tempest-AttachVolumeNegativeTest-2126197630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (037a3a43-9546-43a4-9090-515be8b6f0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:25.456999 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-39b35891-b4fe-48ee-b972-20e279dc7d72 tempest-AttachVolumeNegativeTest-2126197630 None] Volume 0eac0146-d3ac-44c5-8076-4c22e019600b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0eac0146-d3ac-44c5-8076-4c22e019600b', 'volume_size': 1} Dec 25 21:22:25.456999 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-39b35891-b4fe-48ee-b972-20e279dc7d72 tempest-AttachVolumeNegativeTest-2126197630 None] creating volume 'volume-0eac0146-d3ac-44c5-8076-4c22e019600b' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:22:25.456999 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-39b35891-b4fe-48ee-b972-20e279dc7d72 tempest-AttachVolumeNegativeTest-2126197630 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:22:26.757141 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-39b35891-b4fe-48ee-b972-20e279dc7d72 tempest-AttachVolumeNegativeTest-2126197630 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:22:26.759223 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-39b35891-b4fe-48ee-b972-20e279dc7d72 tempest-AttachVolumeNegativeTest-2126197630 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:22:26.761469 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-39b35891-b4fe-48ee-b972-20e279dc7d72 tempest-AttachVolumeNegativeTest-2126197630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (037a3a43-9546-43a4-9090-515be8b6f0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0eac0146-d3ac-44c5-8076-4c22e019600b', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:26.764005 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-39b35891-b4fe-48ee-b972-20e279dc7d72 tempest-AttachVolumeNegativeTest-2126197630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f798ac4-981c-42ae-ab98-2c08e3a4fc4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:26.824617 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-39b35891-b4fe-48ee-b972-20e279dc7d72 tempest-AttachVolumeNegativeTest-2126197630 None] Volume volume-0eac0146-d3ac-44c5-8076-4c22e019600b (0eac0146-d3ac-44c5-8076-4c22e019600b): created successfully Dec 25 21:22:26.826870 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-39b35891-b4fe-48ee-b972-20e279dc7d72 tempest-AttachVolumeNegativeTest-2126197630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f798ac4-981c-42ae-ab98-2c08e3a4fc4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:26.830283 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-39b35891-b4fe-48ee-b972-20e279dc7d72 tempest-AttachVolumeNegativeTest-2126197630 None] Flow 'volume_create_manager' (ec672189-7a03-4f65-8fda-100fb6e84f6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:22:26.876557 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-39b35891-b4fe-48ee-b972-20e279dc7d72 tempest-AttachVolumeNegativeTest-2126197630 None] Created volume successfully. Dec 25 21:22:28.415188 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-c71c2634-6dfe-490c-a99f-099d81a743c6 req-812e5b09-2636-4ede-8818-0d22e487548d tempest-AttachVolumeNegativeTest-2126197630 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:22:29.165779 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-c71c2634-6dfe-490c-a99f-099d81a743c6 req-812e5b09-2636-4ede-8818-0d22e487548d tempest-AttachVolumeNegativeTest-2126197630 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.750s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:22:29.166637 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-c71c2634-6dfe-490c-a99f-099d81a743c6 req-812e5b09-2636-4ede-8818-0d22e487548d tempest-AttachVolumeNegativeTest-2126197630 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0eac0146-d3ac-44c5-8076-4c22e019600b', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': '0eac0146-d3ac-44c5-8076-4c22e019600b', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 21:22:29.274899 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-c71c2634-6dfe-490c-a99f-099d81a743c6 req-812e5b09-2636-4ede-8818-0d22e487548d tempest-AttachVolumeNegativeTest-2126197630 None] Connection info returned from driver {'name': 'volumes/volume-0eac0146-d3ac-44c5-8076-4c22e019600b', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0eac0146-d3ac-44c5-8076-4c22e019600b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f9ed51b6-b7e9-4700-8c73-d5997fe65f47'} {{(pid=129926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 25 21:22:29.403060 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-c71c2634-6dfe-490c-a99f-099d81a743c6 req-812e5b09-2636-4ede-8818-0d22e487548d tempest-AttachVolumeNegativeTest-2126197630 None] attachment_update completed successfully. Dec 25 21:22:29.565351 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:22:29.566585 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:22:29.596243 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:22:29.624708 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:22:32.186031 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-210cd86e-368f-4f40-9216-fa12f022801c tempest-VolumesTestJSON-2514202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:22:32.189998 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-210cd86e-368f-4f40-9216-fa12f022801c tempest-VolumesTestJSON-2514202 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:22:32.190378 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-210cd86e-368f-4f40-9216-fa12f022801c tempest-VolumesTestJSON-2514202 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:22:32.203615 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-210cd86e-368f-4f40-9216-fa12f022801c tempest-VolumesTestJSON-2514202 None] Flow 'volume_create_manager' (db5abdf0-2edd-468d-ab83-9ba228f505d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:22:32.206999 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-210cd86e-368f-4f40-9216-fa12f022801c tempest-VolumesTestJSON-2514202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (593a4286-c5af-4b83-8ca9-ccc602df767b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:32.213419 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-210cd86e-368f-4f40-9216-fa12f022801c tempest-VolumesTestJSON-2514202 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:22:32.225488 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-210cd86e-368f-4f40-9216-fa12f022801c tempest-VolumesTestJSON-2514202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (593a4286-c5af-4b83-8ca9-ccc602df767b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1917950801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7447ea85-fe46-4732-9563-e70cf2a4aa37,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7f1423219da34180ab8a3017e5041b4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:22:32Z,use_quota=True,user_id='f16e390fe6994af089c97b03c59ec61e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:32.231037 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-210cd86e-368f-4f40-9216-fa12f022801c tempest-VolumesTestJSON-2514202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3129c9c-0ea3-4a43-8177-e545aae42397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:32.231037 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-210cd86e-368f-4f40-9216-fa12f022801c tempest-VolumesTestJSON-2514202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3129c9c-0ea3-4a43-8177-e545aae42397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:32.233309 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-210cd86e-368f-4f40-9216-fa12f022801c tempest-VolumesTestJSON-2514202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18999a48-0a39-4d0e-8d09-83953b8d7ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:32.235540 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-210cd86e-368f-4f40-9216-fa12f022801c tempest-VolumesTestJSON-2514202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18999a48-0a39-4d0e-8d09-83953b8d7ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7447ea85-fe46-4732-9563-e70cf2a4aa37', 'volume_name': 'volume-7447ea85-fe46-4732-9563-e70cf2a4aa37', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:32.237854 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-210cd86e-368f-4f40-9216-fa12f022801c tempest-VolumesTestJSON-2514202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d93b688-922d-4216-81f5-2608a8d4b3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:32.239986 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-210cd86e-368f-4f40-9216-fa12f022801c tempest-VolumesTestJSON-2514202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d93b688-922d-4216-81f5-2608a8d4b3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:32.242205 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-210cd86e-368f-4f40-9216-fa12f022801c tempest-VolumesTestJSON-2514202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42b72267-47d3-4a77-bb4b-4cc84d68226e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:32.243035 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-210cd86e-368f-4f40-9216-fa12f022801c tempest-VolumesTestJSON-2514202 None] Volume 7447ea85-fe46-4732-9563-e70cf2a4aa37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7447ea85-fe46-4732-9563-e70cf2a4aa37', 'volume_size': 1} Dec 25 21:22:32.243438 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-210cd86e-368f-4f40-9216-fa12f022801c tempest-VolumesTestJSON-2514202 None] creating volume 'volume-7447ea85-fe46-4732-9563-e70cf2a4aa37' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:22:32.244397 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-210cd86e-368f-4f40-9216-fa12f022801c tempest-VolumesTestJSON-2514202 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:22:33.300193 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-210cd86e-368f-4f40-9216-fa12f022801c tempest-VolumesTestJSON-2514202 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:22:33.306415 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-210cd86e-368f-4f40-9216-fa12f022801c tempest-VolumesTestJSON-2514202 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:22:33.306415 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-210cd86e-368f-4f40-9216-fa12f022801c tempest-VolumesTestJSON-2514202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42b72267-47d3-4a77-bb4b-4cc84d68226e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7447ea85-fe46-4732-9563-e70cf2a4aa37', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:33.306415 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-210cd86e-368f-4f40-9216-fa12f022801c tempest-VolumesTestJSON-2514202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91ada4bf-4d5c-425f-96b0-0bf3aad44655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:33.377060 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-210cd86e-368f-4f40-9216-fa12f022801c tempest-VolumesTestJSON-2514202 None] Volume volume-7447ea85-fe46-4732-9563-e70cf2a4aa37 (7447ea85-fe46-4732-9563-e70cf2a4aa37): created successfully Dec 25 21:22:33.379188 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-210cd86e-368f-4f40-9216-fa12f022801c tempest-VolumesTestJSON-2514202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91ada4bf-4d5c-425f-96b0-0bf3aad44655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:33.382354 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-210cd86e-368f-4f40-9216-fa12f022801c tempest-VolumesTestJSON-2514202 None] Flow 'volume_create_manager' (db5abdf0-2edd-468d-ab83-9ba228f505d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:22:33.462319 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-210cd86e-368f-4f40-9216-fa12f022801c tempest-VolumesTestJSON-2514202 None] Created volume successfully. Dec 25 21:22:33.871052 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-15fad9de-5ac3-45a3-9a20-2aa4e4fd8454 req-b3f8037c-a5b6-4eb9-9313-e501e83f1417 tempest-AttachVolumeNegativeTest-2126197630 None] Terminate volume connection completed successfully. Dec 25 21:22:33.871473 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-15fad9de-5ac3-45a3-9a20-2aa4e4fd8454 req-b3f8037c-a5b6-4eb9-9313-e501e83f1417 tempest-AttachVolumeNegativeTest-2126197630 None] Deleting attachment f9ed51b6-b7e9-4700-8c73-d5997fe65f47. {{(pid=129926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 25 21:22:34.988209 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-5970656a-ec58-41e3-a9d2-1455b0f5ed0e tempest-VolumesTestJSON-2514202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:22:34.989750 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-5970656a-ec58-41e3-a9d2-1455b0f5ed0e tempest-VolumesTestJSON-2514202 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:22:34.990189 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-5970656a-ec58-41e3-a9d2-1455b0f5ed0e tempest-VolumesTestJSON-2514202 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:22:35.002826 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5970656a-ec58-41e3-a9d2-1455b0f5ed0e tempest-VolumesTestJSON-2514202 None] Flow 'volume_create_manager' (b8d7f812-0077-44f0-a1a1-4a59e5fa11c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:22:35.006890 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5970656a-ec58-41e3-a9d2-1455b0f5ed0e tempest-VolumesTestJSON-2514202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f94b45b-3fa3-470b-bdd1-620b9042b859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:35.015473 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-5970656a-ec58-41e3-a9d2-1455b0f5ed0e tempest-VolumesTestJSON-2514202 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:22:35.028061 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5970656a-ec58-41e3-a9d2-1455b0f5ed0e tempest-VolumesTestJSON-2514202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f94b45b-3fa3-470b-bdd1-620b9042b859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-136370191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9eaf456e-3e7a-41b0-9b13-14c25e81275e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7f1423219da34180ab8a3017e5041b4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:22:35Z,use_quota=True,user_id='f16e390fe6994af089c97b03c59ec61e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:35.032783 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5970656a-ec58-41e3-a9d2-1455b0f5ed0e tempest-VolumesTestJSON-2514202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d524e1e-b4f1-4a2d-874b-af2fe6e6df3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:35.035003 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5970656a-ec58-41e3-a9d2-1455b0f5ed0e tempest-VolumesTestJSON-2514202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d524e1e-b4f1-4a2d-874b-af2fe6e6df3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:35.037448 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5970656a-ec58-41e3-a9d2-1455b0f5ed0e tempest-VolumesTestJSON-2514202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (322acfab-6eb2-477b-a82f-75ce59c7d0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:35.040233 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5970656a-ec58-41e3-a9d2-1455b0f5ed0e tempest-VolumesTestJSON-2514202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (322acfab-6eb2-477b-a82f-75ce59c7d0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eaf456e-3e7a-41b0-9b13-14c25e81275e', 'volume_name': 'volume-9eaf456e-3e7a-41b0-9b13-14c25e81275e', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:35.042886 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5970656a-ec58-41e3-a9d2-1455b0f5ed0e tempest-VolumesTestJSON-2514202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f70bceea-9edd-4941-bea3-cf4fb875cded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:35.045022 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5970656a-ec58-41e3-a9d2-1455b0f5ed0e tempest-VolumesTestJSON-2514202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f70bceea-9edd-4941-bea3-cf4fb875cded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:35.047211 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5970656a-ec58-41e3-a9d2-1455b0f5ed0e tempest-VolumesTestJSON-2514202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6316e9f3-8a53-4436-9978-c9d40a4887e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:35.048009 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-5970656a-ec58-41e3-a9d2-1455b0f5ed0e tempest-VolumesTestJSON-2514202 None] Volume 9eaf456e-3e7a-41b0-9b13-14c25e81275e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eaf456e-3e7a-41b0-9b13-14c25e81275e', 'volume_size': 1} Dec 25 21:22:35.048404 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-5970656a-ec58-41e3-a9d2-1455b0f5ed0e tempest-VolumesTestJSON-2514202 None] creating volume 'volume-9eaf456e-3e7a-41b0-9b13-14c25e81275e' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:22:35.049391 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-5970656a-ec58-41e3-a9d2-1455b0f5ed0e tempest-VolumesTestJSON-2514202 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:22:36.203406 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-5970656a-ec58-41e3-a9d2-1455b0f5ed0e tempest-VolumesTestJSON-2514202 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:22:36.204058 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-5970656a-ec58-41e3-a9d2-1455b0f5ed0e tempest-VolumesTestJSON-2514202 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:22:36.207140 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5970656a-ec58-41e3-a9d2-1455b0f5ed0e tempest-VolumesTestJSON-2514202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6316e9f3-8a53-4436-9978-c9d40a4887e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eaf456e-3e7a-41b0-9b13-14c25e81275e', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:36.209320 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5970656a-ec58-41e3-a9d2-1455b0f5ed0e tempest-VolumesTestJSON-2514202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4526c3fe-7830-42c4-b571-e774624cb33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:36.315531 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-5970656a-ec58-41e3-a9d2-1455b0f5ed0e tempest-VolumesTestJSON-2514202 None] Volume volume-9eaf456e-3e7a-41b0-9b13-14c25e81275e (9eaf456e-3e7a-41b0-9b13-14c25e81275e): created successfully Dec 25 21:22:36.317581 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5970656a-ec58-41e3-a9d2-1455b0f5ed0e tempest-VolumesTestJSON-2514202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4526c3fe-7830-42c4-b571-e774624cb33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:36.321111 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5970656a-ec58-41e3-a9d2-1455b0f5ed0e tempest-VolumesTestJSON-2514202 None] Flow 'volume_create_manager' (b8d7f812-0077-44f0-a1a1-4a59e5fa11c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:22:36.395139 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-5970656a-ec58-41e3-a9d2-1455b0f5ed0e tempest-VolumesTestJSON-2514202 None] Created volume successfully. Dec 25 21:22:37.829173 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-8736b147-fc00-4679-a116-e12855844e31 tempest-VolumesTestJSON-2514202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:22:37.832589 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-8736b147-fc00-4679-a116-e12855844e31 tempest-VolumesTestJSON-2514202 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:22:37.833099 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-8736b147-fc00-4679-a116-e12855844e31 tempest-VolumesTestJSON-2514202 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:22:37.845415 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8736b147-fc00-4679-a116-e12855844e31 tempest-VolumesTestJSON-2514202 None] Flow 'volume_create_manager' (196c6bf3-18cf-4290-9eda-8fb5ee29a2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:22:37.848559 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8736b147-fc00-4679-a116-e12855844e31 tempest-VolumesTestJSON-2514202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fdfc626-33f2-4d79-958b-cc1a5fb1d348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:37.860542 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-8736b147-fc00-4679-a116-e12855844e31 tempest-VolumesTestJSON-2514202 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:22:37.874296 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8736b147-fc00-4679-a116-e12855844e31 tempest-VolumesTestJSON-2514202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fdfc626-33f2-4d79-958b-cc1a5fb1d348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1195225047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=410a1fee-501b-4b5b-a50b-78d4eee23dec,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7f1423219da34180ab8a3017e5041b4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:22:38Z,use_quota=True,user_id='f16e390fe6994af089c97b03c59ec61e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:37.876905 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8736b147-fc00-4679-a116-e12855844e31 tempest-VolumesTestJSON-2514202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fba84585-934b-465b-9df5-aae8e029963e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:37.879151 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8736b147-fc00-4679-a116-e12855844e31 tempest-VolumesTestJSON-2514202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fba84585-934b-465b-9df5-aae8e029963e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:37.881575 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8736b147-fc00-4679-a116-e12855844e31 tempest-VolumesTestJSON-2514202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a8b4eff-84c7-4d29-853a-d0778299a1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:37.883907 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8736b147-fc00-4679-a116-e12855844e31 tempest-VolumesTestJSON-2514202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a8b4eff-84c7-4d29-853a-d0778299a1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '410a1fee-501b-4b5b-a50b-78d4eee23dec', 'volume_name': 'volume-410a1fee-501b-4b5b-a50b-78d4eee23dec', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:37.886236 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8736b147-fc00-4679-a116-e12855844e31 tempest-VolumesTestJSON-2514202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d10ce79-4833-45ae-bfba-c466f6abaf32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:37.888346 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8736b147-fc00-4679-a116-e12855844e31 tempest-VolumesTestJSON-2514202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d10ce79-4833-45ae-bfba-c466f6abaf32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:37.890641 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8736b147-fc00-4679-a116-e12855844e31 tempest-VolumesTestJSON-2514202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c863d1cf-f83b-452f-92eb-b58536d69ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:37.894881 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-8736b147-fc00-4679-a116-e12855844e31 tempest-VolumesTestJSON-2514202 None] Volume 410a1fee-501b-4b5b-a50b-78d4eee23dec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-410a1fee-501b-4b5b-a50b-78d4eee23dec', 'volume_size': 1} Dec 25 21:22:37.894881 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-8736b147-fc00-4679-a116-e12855844e31 tempest-VolumesTestJSON-2514202 None] creating volume 'volume-410a1fee-501b-4b5b-a50b-78d4eee23dec' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:22:37.894881 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-8736b147-fc00-4679-a116-e12855844e31 tempest-VolumesTestJSON-2514202 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:22:39.162485 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-8736b147-fc00-4679-a116-e12855844e31 tempest-VolumesTestJSON-2514202 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:22:39.164319 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-8736b147-fc00-4679-a116-e12855844e31 tempest-VolumesTestJSON-2514202 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:22:39.166903 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8736b147-fc00-4679-a116-e12855844e31 tempest-VolumesTestJSON-2514202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c863d1cf-f83b-452f-92eb-b58536d69ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-410a1fee-501b-4b5b-a50b-78d4eee23dec', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:39.169111 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8736b147-fc00-4679-a116-e12855844e31 tempest-VolumesTestJSON-2514202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (630e4f3b-da47-402e-b2e7-21861b3d37fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:39.278362 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-8736b147-fc00-4679-a116-e12855844e31 tempest-VolumesTestJSON-2514202 None] Volume volume-410a1fee-501b-4b5b-a50b-78d4eee23dec (410a1fee-501b-4b5b-a50b-78d4eee23dec): created successfully Dec 25 21:22:39.280424 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8736b147-fc00-4679-a116-e12855844e31 tempest-VolumesTestJSON-2514202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (630e4f3b-da47-402e-b2e7-21861b3d37fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:39.283425 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8736b147-fc00-4679-a116-e12855844e31 tempest-VolumesTestJSON-2514202 None] Flow 'volume_create_manager' (196c6bf3-18cf-4290-9eda-8fb5ee29a2f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:22:39.423722 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-8736b147-fc00-4679-a116-e12855844e31 tempest-VolumesTestJSON-2514202 None] Created volume successfully. Dec 25 21:22:40.290003 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4712887-f6ed-4048-9aa3-5478aa47725d tempest-ServerRescueNegativeTestJSON-1185237855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:22:40.300837 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-e4712887-f6ed-4048-9aa3-5478aa47725d tempest-ServerRescueNegativeTestJSON-1185237855 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:22:40.302503 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-e4712887-f6ed-4048-9aa3-5478aa47725d tempest-ServerRescueNegativeTestJSON-1185237855 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:22:40.314508 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e4712887-f6ed-4048-9aa3-5478aa47725d tempest-ServerRescueNegativeTestJSON-1185237855 None] Flow 'volume_create_manager' (18f6f2f4-478e-44a5-ac50-3f0971249b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:22:40.317724 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e4712887-f6ed-4048-9aa3-5478aa47725d tempest-ServerRescueNegativeTestJSON-1185237855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1baa0ba-d10d-4416-8693-dd77085ed9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:40.326367 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-e4712887-f6ed-4048-9aa3-5478aa47725d tempest-ServerRescueNegativeTestJSON-1185237855 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:22:40.348014 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e4712887-f6ed-4048-9aa3-5478aa47725d tempest-ServerRescueNegativeTestJSON-1185237855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1baa0ba-d10d-4416-8693-dd77085ed9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2051911356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=dc7c39fd-b000-49c4-9c3e-a1b1f848e64b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af127d2683f84f0682595fe8297db6b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:22:40Z,use_quota=True,user_id='97abfab761214f10bb25fbf8ba958822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:40.350837 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e4712887-f6ed-4048-9aa3-5478aa47725d tempest-ServerRescueNegativeTestJSON-1185237855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cf214ef-a6b8-46a7-a73e-39467d4cf8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:40.354777 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e4712887-f6ed-4048-9aa3-5478aa47725d tempest-ServerRescueNegativeTestJSON-1185237855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cf214ef-a6b8-46a7-a73e-39467d4cf8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:40.357560 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e4712887-f6ed-4048-9aa3-5478aa47725d tempest-ServerRescueNegativeTestJSON-1185237855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deeb866d-0001-45e0-af1c-f99eb7b8ee21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:40.363097 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e4712887-f6ed-4048-9aa3-5478aa47725d tempest-ServerRescueNegativeTestJSON-1185237855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deeb866d-0001-45e0-af1c-f99eb7b8ee21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc7c39fd-b000-49c4-9c3e-a1b1f848e64b', 'volume_name': 'volume-dc7c39fd-b000-49c4-9c3e-a1b1f848e64b', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:40.367712 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e4712887-f6ed-4048-9aa3-5478aa47725d tempest-ServerRescueNegativeTestJSON-1185237855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce3f3e48-6f61-491b-aabd-7e4776c81eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:40.371306 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e4712887-f6ed-4048-9aa3-5478aa47725d tempest-ServerRescueNegativeTestJSON-1185237855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce3f3e48-6f61-491b-aabd-7e4776c81eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:40.374440 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e4712887-f6ed-4048-9aa3-5478aa47725d tempest-ServerRescueNegativeTestJSON-1185237855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5584d8fe-4a47-4324-84c3-fd4fd40c32fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:40.375437 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-e4712887-f6ed-4048-9aa3-5478aa47725d tempest-ServerRescueNegativeTestJSON-1185237855 None] Volume dc7c39fd-b000-49c4-9c3e-a1b1f848e64b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc7c39fd-b000-49c4-9c3e-a1b1f848e64b', 'volume_size': 1} Dec 25 21:22:40.376018 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e4712887-f6ed-4048-9aa3-5478aa47725d tempest-ServerRescueNegativeTestJSON-1185237855 None] creating volume 'volume-dc7c39fd-b000-49c4-9c3e-a1b1f848e64b' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:22:40.377265 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e4712887-f6ed-4048-9aa3-5478aa47725d tempest-ServerRescueNegativeTestJSON-1185237855 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:22:41.136465 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-61b10331-541c-4e82-bbde-87711db85da1 tempest-VolumesTestJSON-2514202 None] Lock "b'cinder-410a1fee-501b-4b5b-a50b-78d4eee23dec-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:22:41.220956 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-61b10331-541c-4e82-bbde-87711db85da1 tempest-VolumesTestJSON-2514202 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:22:41.538438 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-61b10331-541c-4e82-bbde-87711db85da1 tempest-VolumesTestJSON-2514202 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:22:41.539158 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-61b10331-541c-4e82-bbde-87711db85da1 tempest-VolumesTestJSON-2514202 None] Volume volume-410a1fee-501b-4b5b-a50b-78d4eee23dec is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:22:41.887136 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-61b10331-541c-4e82-bbde-87711db85da1 tempest-VolumesTestJSON-2514202 None] deleting rbd volume volume-410a1fee-501b-4b5b-a50b-78d4eee23dec {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:22:41.905963 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e4712887-f6ed-4048-9aa3-5478aa47725d tempest-ServerRescueNegativeTestJSON-1185237855 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:22:41.906606 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e4712887-f6ed-4048-9aa3-5478aa47725d tempest-ServerRescueNegativeTestJSON-1185237855 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:22:41.908790 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e4712887-f6ed-4048-9aa3-5478aa47725d tempest-ServerRescueNegativeTestJSON-1185237855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5584d8fe-4a47-4324-84c3-fd4fd40c32fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc7c39fd-b000-49c4-9c3e-a1b1f848e64b', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:41.911350 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e4712887-f6ed-4048-9aa3-5478aa47725d tempest-ServerRescueNegativeTestJSON-1185237855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (289c7dca-92db-4f4b-8eef-0adcf80052d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:42.002701 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-e4712887-f6ed-4048-9aa3-5478aa47725d tempest-ServerRescueNegativeTestJSON-1185237855 None] Volume volume-dc7c39fd-b000-49c4-9c3e-a1b1f848e64b (dc7c39fd-b000-49c4-9c3e-a1b1f848e64b): created successfully Dec 25 21:22:42.004679 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e4712887-f6ed-4048-9aa3-5478aa47725d tempest-ServerRescueNegativeTestJSON-1185237855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (289c7dca-92db-4f4b-8eef-0adcf80052d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:42.008301 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e4712887-f6ed-4048-9aa3-5478aa47725d tempest-ServerRescueNegativeTestJSON-1185237855 None] Flow 'volume_create_manager' (18f6f2f4-478e-44a5-ac50-3f0971249b3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:22:42.090546 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-e4712887-f6ed-4048-9aa3-5478aa47725d tempest-ServerRescueNegativeTestJSON-1185237855 None] Created volume successfully. Dec 25 21:22:50.509948 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-61b10331-541c-4e82-bbde-87711db85da1 tempest-VolumesTestJSON-2514202 None] Created reservations ['993eb49d-6376-4b7a-a089-9367074cd674', '6e4c8196-3aee-4162-94de-c2b64155c830', '0d040f25-9e5e-477e-8dcb-143b0d3f50fd', '780b0aa3-d63e-4923-8ece-b25e5fbb67ef'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:22:50.755463 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-61b10331-541c-4e82-bbde-87711db85da1 tempest-VolumesTestJSON-2514202 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:22:50.777832 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-61b10331-541c-4e82-bbde-87711db85da1 tempest-VolumesTestJSON-2514202 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:22:50.809322 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-61b10331-541c-4e82-bbde-87711db85da1 tempest-VolumesTestJSON-2514202 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:22:50.813576 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-61b10331-541c-4e82-bbde-87711db85da1 tempest-VolumesTestJSON-2514202 None] Deleted volume successfully. Dec 25 21:22:50.955593 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-a32a1a73-9945-496e-bb29-0be6ed14ed20 tempest-VolumesTestJSON-2514202 None] Lock "b'cinder-9eaf456e-3e7a-41b0-9b13-14c25e81275e-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:22:50.980246 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-61b10331-541c-4e82-bbde-87711db85da1 tempest-VolumesTestJSON-2514202 None] Lock "b'cinder-410a1fee-501b-4b5b-a50b-78d4eee23dec-delete_volume'" released by "delete_volume" :: held 9.844s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:22:51.107322 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a32a1a73-9945-496e-bb29-0be6ed14ed20 tempest-VolumesTestJSON-2514202 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:22:51.433131 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a32a1a73-9945-496e-bb29-0be6ed14ed20 tempest-VolumesTestJSON-2514202 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:22:51.433582 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a32a1a73-9945-496e-bb29-0be6ed14ed20 tempest-VolumesTestJSON-2514202 None] Volume volume-9eaf456e-3e7a-41b0-9b13-14c25e81275e is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:22:51.965037 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a32a1a73-9945-496e-bb29-0be6ed14ed20 tempest-VolumesTestJSON-2514202 None] deleting rbd volume volume-9eaf456e-3e7a-41b0-9b13-14c25e81275e {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:22:52.528270 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ddc82c7-7ef3-4d83-8b4c-32311a17baef tempest-AttachVolumeNegativeTest-2126197630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:22:52.532082 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-4ddc82c7-7ef3-4d83-8b4c-32311a17baef tempest-AttachVolumeNegativeTest-2126197630 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:22:52.533457 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-4ddc82c7-7ef3-4d83-8b4c-32311a17baef tempest-AttachVolumeNegativeTest-2126197630 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:22:52.567117 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-4ddc82c7-7ef3-4d83-8b4c-32311a17baef tempest-AttachVolumeNegativeTest-2126197630 None] Flow 'volume_create_manager' (bc4a5db9-1100-4b77-b1e7-27ee13e00cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:22:52.570650 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-4ddc82c7-7ef3-4d83-8b4c-32311a17baef tempest-AttachVolumeNegativeTest-2126197630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08f2a08a-d6fd-44bc-bd37-3e6e3f34cfc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:52.582459 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-4ddc82c7-7ef3-4d83-8b4c-32311a17baef tempest-AttachVolumeNegativeTest-2126197630 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:22:52.596137 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-4ddc82c7-7ef3-4d83-8b4c-32311a17baef tempest-AttachVolumeNegativeTest-2126197630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08f2a08a-d6fd-44bc-bd37-3e6e3f34cfc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1789215857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=115961e3-4417-4431-86e4-91e13094bf9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dcf2517f61849cb9650682caf0c5712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:22:52Z,use_quota=True,user_id='d7df5c79b8ea4c6ea7cf84b381b29765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:52.599279 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-4ddc82c7-7ef3-4d83-8b4c-32311a17baef tempest-AttachVolumeNegativeTest-2126197630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a5bec2f-fd4c-45e9-b7ef-ae42f80f476d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:52.602291 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-4ddc82c7-7ef3-4d83-8b4c-32311a17baef tempest-AttachVolumeNegativeTest-2126197630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a5bec2f-fd4c-45e9-b7ef-ae42f80f476d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:52.604852 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-4ddc82c7-7ef3-4d83-8b4c-32311a17baef tempest-AttachVolumeNegativeTest-2126197630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6a29733-b365-4f07-b5f0-1ab1d01dc126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:52.609778 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-4ddc82c7-7ef3-4d83-8b4c-32311a17baef tempest-AttachVolumeNegativeTest-2126197630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6a29733-b365-4f07-b5f0-1ab1d01dc126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '115961e3-4417-4431-86e4-91e13094bf9d', 'volume_name': 'volume-115961e3-4417-4431-86e4-91e13094bf9d', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:52.612388 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-4ddc82c7-7ef3-4d83-8b4c-32311a17baef tempest-AttachVolumeNegativeTest-2126197630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59a373e2-ddd8-48e9-93ab-b7ce349a27c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:52.614693 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-4ddc82c7-7ef3-4d83-8b4c-32311a17baef tempest-AttachVolumeNegativeTest-2126197630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59a373e2-ddd8-48e9-93ab-b7ce349a27c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:52.617652 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-4ddc82c7-7ef3-4d83-8b4c-32311a17baef tempest-AttachVolumeNegativeTest-2126197630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3116138b-cf56-4b11-8783-8533df636b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:52.619193 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-4ddc82c7-7ef3-4d83-8b4c-32311a17baef tempest-AttachVolumeNegativeTest-2126197630 None] Volume 115961e3-4417-4431-86e4-91e13094bf9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-115961e3-4417-4431-86e4-91e13094bf9d', 'volume_size': 1} Dec 25 21:22:52.619749 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-4ddc82c7-7ef3-4d83-8b4c-32311a17baef tempest-AttachVolumeNegativeTest-2126197630 None] creating volume 'volume-115961e3-4417-4431-86e4-91e13094bf9d' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:22:52.620913 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-4ddc82c7-7ef3-4d83-8b4c-32311a17baef tempest-AttachVolumeNegativeTest-2126197630 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:22:53.636688 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-4ddc82c7-7ef3-4d83-8b4c-32311a17baef tempest-AttachVolumeNegativeTest-2126197630 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:22:53.639290 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-4ddc82c7-7ef3-4d83-8b4c-32311a17baef tempest-AttachVolumeNegativeTest-2126197630 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:22:53.643800 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-4ddc82c7-7ef3-4d83-8b4c-32311a17baef tempest-AttachVolumeNegativeTest-2126197630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3116138b-cf56-4b11-8783-8533df636b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-115961e3-4417-4431-86e4-91e13094bf9d', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:53.654627 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-4ddc82c7-7ef3-4d83-8b4c-32311a17baef tempest-AttachVolumeNegativeTest-2126197630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dd4e525-3d8d-48e4-a529-f7d8199a50a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:22:53.746467 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-4ddc82c7-7ef3-4d83-8b4c-32311a17baef tempest-AttachVolumeNegativeTest-2126197630 None] Volume volume-115961e3-4417-4431-86e4-91e13094bf9d (115961e3-4417-4431-86e4-91e13094bf9d): created successfully Dec 25 21:22:53.748497 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-4ddc82c7-7ef3-4d83-8b4c-32311a17baef tempest-AttachVolumeNegativeTest-2126197630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dd4e525-3d8d-48e4-a529-f7d8199a50a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:22:53.752349 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-4ddc82c7-7ef3-4d83-8b4c-32311a17baef tempest-AttachVolumeNegativeTest-2126197630 None] Flow 'volume_create_manager' (bc4a5db9-1100-4b77-b1e7-27ee13e00cac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:22:53.838723 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-4ddc82c7-7ef3-4d83-8b4c-32311a17baef tempest-AttachVolumeNegativeTest-2126197630 None] Created volume successfully. Dec 25 21:22:55.456102 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-081b69f1-5e66-4195-9395-727fc4c8b467 req-961a49f3-2358-463d-837b-5d0be7c812c2 tempest-AttachVolumeNegativeTest-2126197630 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:22:56.288599 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-081b69f1-5e66-4195-9395-727fc4c8b467 req-961a49f3-2358-463d-837b-5d0be7c812c2 tempest-AttachVolumeNegativeTest-2126197630 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.832s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:22:56.296083 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-081b69f1-5e66-4195-9395-727fc4c8b467 req-961a49f3-2358-463d-837b-5d0be7c812c2 tempest-AttachVolumeNegativeTest-2126197630 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-115961e3-4417-4431-86e4-91e13094bf9d', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': '115961e3-4417-4431-86e4-91e13094bf9d', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 21:22:56.404565 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-081b69f1-5e66-4195-9395-727fc4c8b467 req-961a49f3-2358-463d-837b-5d0be7c812c2 tempest-AttachVolumeNegativeTest-2126197630 None] Connection info returned from driver {'name': 'volumes/volume-115961e3-4417-4431-86e4-91e13094bf9d', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '115961e3-4417-4431-86e4-91e13094bf9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '660e0dbd-07b9-4b78-a1b7-aeb7c97859d0'} {{(pid=129926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 25 21:22:56.527450 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-081b69f1-5e66-4195-9395-727fc4c8b467 req-961a49f3-2358-463d-837b-5d0be7c812c2 tempest-AttachVolumeNegativeTest-2126197630 None] attachment_update completed successfully. Dec 25 21:23:01.506222 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-a32a1a73-9945-496e-bb29-0be6ed14ed20 tempest-VolumesTestJSON-2514202 None] Created reservations ['ad084369-0877-4998-9c28-63977d770399', '3ded8c22-d3f3-4697-8dfb-d851ceb6eb2f', '3439eec7-635b-4298-a664-25e73562f503', '30ff1032-9286-4d1a-9411-1696e8723219'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:23:01.753036 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a32a1a73-9945-496e-bb29-0be6ed14ed20 tempest-VolumesTestJSON-2514202 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:23:01.801108 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a32a1a73-9945-496e-bb29-0be6ed14ed20 tempest-VolumesTestJSON-2514202 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:23:01.863797 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a32a1a73-9945-496e-bb29-0be6ed14ed20 tempest-VolumesTestJSON-2514202 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:23:01.869427 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-a32a1a73-9945-496e-bb29-0be6ed14ed20 tempest-VolumesTestJSON-2514202 None] Deleted volume successfully. Dec 25 21:23:01.984805 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-a32a1a73-9945-496e-bb29-0be6ed14ed20 tempest-VolumesTestJSON-2514202 None] Lock "b'cinder-9eaf456e-3e7a-41b0-9b13-14c25e81275e-delete_volume'" released by "delete_volume" :: held 11.074s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:23:02.196949 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-a39b1a99-f0e6-4537-b901-6ae27bc26fe7 req-dfbe3b5e-653c-4786-a020-0d2820d8aacb tempest-AttachVolumeNegativeTest-2126197630 None] Terminate volume connection completed successfully. Dec 25 21:23:02.196949 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-a39b1a99-f0e6-4537-b901-6ae27bc26fe7 req-dfbe3b5e-653c-4786-a020-0d2820d8aacb tempest-AttachVolumeNegativeTest-2126197630 None] Deleting attachment 660e0dbd-07b9-4b78-a1b7-aeb7c97859d0. {{(pid=129926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 25 21:23:02.812184 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-fb18ad9f-e286-4999-b6ef-726847b96317 tempest-AttachVolumeNegativeTest-2126197630 None] Lock "b'cinder-115961e3-4417-4431-86e4-91e13094bf9d-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:23:02.908462 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-6b4a24ce-4f90-4229-a131-31ac7dd145e4 tempest-VolumesTestJSON-2514202 None] Lock "b'cinder-7447ea85-fe46-4732-9563-e70cf2a4aa37-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:23:02.937074 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-fb18ad9f-e286-4999-b6ef-726847b96317 tempest-AttachVolumeNegativeTest-2126197630 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:23:03.188793 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-fb18ad9f-e286-4999-b6ef-726847b96317 tempest-AttachVolumeNegativeTest-2126197630 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:23:03.189269 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-fb18ad9f-e286-4999-b6ef-726847b96317 tempest-AttachVolumeNegativeTest-2126197630 None] Volume volume-115961e3-4417-4431-86e4-91e13094bf9d is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:23:03.507275 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-fb18ad9f-e286-4999-b6ef-726847b96317 tempest-AttachVolumeNegativeTest-2126197630 None] deleting rbd volume volume-115961e3-4417-4431-86e4-91e13094bf9d {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:23:03.533523 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-6b4a24ce-4f90-4229-a131-31ac7dd145e4 tempest-VolumesTestJSON-2514202 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:23:03.816931 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-6b4a24ce-4f90-4229-a131-31ac7dd145e4 tempest-VolumesTestJSON-2514202 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:23:03.817588 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-6b4a24ce-4f90-4229-a131-31ac7dd145e4 tempest-VolumesTestJSON-2514202 None] Volume volume-7447ea85-fe46-4732-9563-e70cf2a4aa37 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:23:04.095169 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-6b4a24ce-4f90-4229-a131-31ac7dd145e4 tempest-VolumesTestJSON-2514202 None] deleting rbd volume volume-7447ea85-fe46-4732-9563-e70cf2a4aa37 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:23:04.201629 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-f90e847e-dc4c-41f0-ad6e-37358bd38b64 tempest-ServerRescueNegativeTestJSON-1185237855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:23:04.205584 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-f90e847e-dc4c-41f0-ad6e-37358bd38b64 tempest-ServerRescueNegativeTestJSON-1185237855 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:23:04.206089 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-f90e847e-dc4c-41f0-ad6e-37358bd38b64 tempest-ServerRescueNegativeTestJSON-1185237855 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:23:04.218377 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f90e847e-dc4c-41f0-ad6e-37358bd38b64 tempest-ServerRescueNegativeTestJSON-1185237855 None] Flow 'volume_create_manager' (1bca4fc6-9529-46c3-a4df-a9e1615cc76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:23:04.222001 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f90e847e-dc4c-41f0-ad6e-37358bd38b64 tempest-ServerRescueNegativeTestJSON-1185237855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e21881d1-a595-490d-ac3e-f93e633d7afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:23:04.228492 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-f90e847e-dc4c-41f0-ad6e-37358bd38b64 tempest-ServerRescueNegativeTestJSON-1185237855 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:23:04.241071 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f90e847e-dc4c-41f0-ad6e-37358bd38b64 tempest-ServerRescueNegativeTestJSON-1185237855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e21881d1-a595-490d-ac3e-f93e633d7afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1157792616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=240601d5-5803-4db4-ad87-ded28e2eb84d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af127d2683f84f0682595fe8297db6b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:23:04Z,use_quota=True,user_id='97abfab761214f10bb25fbf8ba958822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:23:04.245003 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f90e847e-dc4c-41f0-ad6e-37358bd38b64 tempest-ServerRescueNegativeTestJSON-1185237855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d5a7f79-93c0-48ce-80c6-9eedeac40c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:23:04.246538 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f90e847e-dc4c-41f0-ad6e-37358bd38b64 tempest-ServerRescueNegativeTestJSON-1185237855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d5a7f79-93c0-48ce-80c6-9eedeac40c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:23:04.249268 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f90e847e-dc4c-41f0-ad6e-37358bd38b64 tempest-ServerRescueNegativeTestJSON-1185237855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7e7fef3-dd65-4b06-8ff0-6efd2a78ee0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:23:04.251520 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f90e847e-dc4c-41f0-ad6e-37358bd38b64 tempest-ServerRescueNegativeTestJSON-1185237855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7e7fef3-dd65-4b06-8ff0-6efd2a78ee0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '240601d5-5803-4db4-ad87-ded28e2eb84d', 'volume_name': 'volume-240601d5-5803-4db4-ad87-ded28e2eb84d', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:23:04.253930 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f90e847e-dc4c-41f0-ad6e-37358bd38b64 tempest-ServerRescueNegativeTestJSON-1185237855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f5858bb-8e8e-4f07-8106-7c02fcf4db81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:23:04.256037 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f90e847e-dc4c-41f0-ad6e-37358bd38b64 tempest-ServerRescueNegativeTestJSON-1185237855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f5858bb-8e8e-4f07-8106-7c02fcf4db81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:23:04.258269 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f90e847e-dc4c-41f0-ad6e-37358bd38b64 tempest-ServerRescueNegativeTestJSON-1185237855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (732533cb-fac2-4ec4-b49a-73ad67c47f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:23:04.263079 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-f90e847e-dc4c-41f0-ad6e-37358bd38b64 tempest-ServerRescueNegativeTestJSON-1185237855 None] Volume 240601d5-5803-4db4-ad87-ded28e2eb84d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-240601d5-5803-4db4-ad87-ded28e2eb84d', 'volume_size': 1} Dec 25 21:23:04.263079 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f90e847e-dc4c-41f0-ad6e-37358bd38b64 tempest-ServerRescueNegativeTestJSON-1185237855 None] creating volume 'volume-240601d5-5803-4db4-ad87-ded28e2eb84d' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:23:04.263079 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f90e847e-dc4c-41f0-ad6e-37358bd38b64 tempest-ServerRescueNegativeTestJSON-1185237855 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:23:05.280238 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f90e847e-dc4c-41f0-ad6e-37358bd38b64 tempest-ServerRescueNegativeTestJSON-1185237855 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:23:05.280801 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f90e847e-dc4c-41f0-ad6e-37358bd38b64 tempest-ServerRescueNegativeTestJSON-1185237855 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:23:05.282679 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f90e847e-dc4c-41f0-ad6e-37358bd38b64 tempest-ServerRescueNegativeTestJSON-1185237855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (732533cb-fac2-4ec4-b49a-73ad67c47f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-240601d5-5803-4db4-ad87-ded28e2eb84d', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:23:05.284928 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f90e847e-dc4c-41f0-ad6e-37358bd38b64 tempest-ServerRescueNegativeTestJSON-1185237855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecd87eda-ec31-48a4-bd3c-a7d9705ca65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:23:05.371568 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-f90e847e-dc4c-41f0-ad6e-37358bd38b64 tempest-ServerRescueNegativeTestJSON-1185237855 None] Volume volume-240601d5-5803-4db4-ad87-ded28e2eb84d (240601d5-5803-4db4-ad87-ded28e2eb84d): created successfully Dec 25 21:23:05.373660 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f90e847e-dc4c-41f0-ad6e-37358bd38b64 tempest-ServerRescueNegativeTestJSON-1185237855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecd87eda-ec31-48a4-bd3c-a7d9705ca65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:23:05.376700 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f90e847e-dc4c-41f0-ad6e-37358bd38b64 tempest-ServerRescueNegativeTestJSON-1185237855 None] Flow 'volume_create_manager' (1bca4fc6-9529-46c3-a4df-a9e1615cc76d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:23:05.460778 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-f90e847e-dc4c-41f0-ad6e-37358bd38b64 tempest-ServerRescueNegativeTestJSON-1185237855 None] Created volume successfully. Dec 25 21:23:07.094273 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-55a62957-62b5-4b07-8d17-840b2de10ccc req-6119f416-7db0-4ffe-89ca-910b270ccbe8 tempest-ServerRescueNegativeTestJSON-1185237855 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:23:07.755590 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-55a62957-62b5-4b07-8d17-840b2de10ccc req-6119f416-7db0-4ffe-89ca-910b270ccbe8 tempest-ServerRescueNegativeTestJSON-1185237855 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.661s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:23:07.756294 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-55a62957-62b5-4b07-8d17-840b2de10ccc req-6119f416-7db0-4ffe-89ca-910b270ccbe8 tempest-ServerRescueNegativeTestJSON-1185237855 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-240601d5-5803-4db4-ad87-ded28e2eb84d', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': '240601d5-5803-4db4-ad87-ded28e2eb84d', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 21:23:07.929615 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-55a62957-62b5-4b07-8d17-840b2de10ccc req-6119f416-7db0-4ffe-89ca-910b270ccbe8 tempest-ServerRescueNegativeTestJSON-1185237855 None] Connection info returned from driver {'name': 'volumes/volume-240601d5-5803-4db4-ad87-ded28e2eb84d', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '240601d5-5803-4db4-ad87-ded28e2eb84d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '90c5b4d7-ba95-4dc5-9005-4c34fc3741c1'} {{(pid=129926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 25 21:23:08.039569 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-55a62957-62b5-4b07-8d17-840b2de10ccc req-6119f416-7db0-4ffe-89ca-910b270ccbe8 tempest-ServerRescueNegativeTestJSON-1185237855 None] attachment_update completed successfully. Dec 25 21:23:12.457287 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-fb18ad9f-e286-4999-b6ef-726847b96317 tempest-AttachVolumeNegativeTest-2126197630 None] Created reservations ['90f56ac5-83dc-4bd9-b4d8-9d2129f8e9b7', 'ce305942-2f8f-42d3-a996-e8b49c5fa517', 'f1356cf0-2f43-4587-940f-adf924bbb851', '1e9eb136-b857-4145-9299-3f1aa8c95b1c'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:23:12.471692 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-6b4a24ce-4f90-4229-a131-31ac7dd145e4 tempest-VolumesTestJSON-2514202 None] Created reservations ['bb147788-1051-4362-9acd-5e91f088ebd5', '5dab75dd-46a2-4a9d-a8f0-fed2b6d84247', 'e1717674-fa7b-4e06-9c58-9a56f639660d', '1ab7287e-12ec-4dd0-a704-8a1f966a9c9e'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:23:12.641474 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-fb18ad9f-e286-4999-b6ef-726847b96317 tempest-AttachVolumeNegativeTest-2126197630 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:23:12.671488 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-fb18ad9f-e286-4999-b6ef-726847b96317 tempest-AttachVolumeNegativeTest-2126197630 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:23:12.702721 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-fb18ad9f-e286-4999-b6ef-726847b96317 tempest-AttachVolumeNegativeTest-2126197630 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:23:12.713299 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-fb18ad9f-e286-4999-b6ef-726847b96317 tempest-AttachVolumeNegativeTest-2126197630 None] Deleted volume successfully. Dec 25 21:23:12.844440 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-fb18ad9f-e286-4999-b6ef-726847b96317 tempest-AttachVolumeNegativeTest-2126197630 None] Lock "b'cinder-115961e3-4417-4431-86e4-91e13094bf9d-delete_volume'" released by "delete_volume" :: held 10.032s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:23:12.883429 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-6b4a24ce-4f90-4229-a131-31ac7dd145e4 tempest-VolumesTestJSON-2514202 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:23:12.956142 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-6b4a24ce-4f90-4229-a131-31ac7dd145e4 tempest-VolumesTestJSON-2514202 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:23:13.000471 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-6b4a24ce-4f90-4229-a131-31ac7dd145e4 tempest-VolumesTestJSON-2514202 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:23:13.004540 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-6b4a24ce-4f90-4229-a131-31ac7dd145e4 tempest-VolumesTestJSON-2514202 None] Deleted volume successfully. Dec 25 21:23:13.125296 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-6b4a24ce-4f90-4229-a131-31ac7dd145e4 tempest-VolumesTestJSON-2514202 None] Lock "b'cinder-7447ea85-fe46-4732-9563-e70cf2a4aa37-delete_volume'" released by "delete_volume" :: held 10.217s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:23:18.940461 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-c60aee8f-0958-42e7-986a-effe77bb5a2f tempest-AttachVolumeNegativeTest-2126197630 None] Lock "b'cinder-0eac0146-d3ac-44c5-8076-4c22e019600b-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:23:19.046720 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-c60aee8f-0958-42e7-986a-effe77bb5a2f tempest-AttachVolumeNegativeTest-2126197630 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:23:20.054435 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-c60aee8f-0958-42e7-986a-effe77bb5a2f tempest-AttachVolumeNegativeTest-2126197630 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:23:20.059808 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-c60aee8f-0958-42e7-986a-effe77bb5a2f tempest-AttachVolumeNegativeTest-2126197630 None] Volume volume-0eac0146-d3ac-44c5-8076-4c22e019600b is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:23:20.498920 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-c60aee8f-0958-42e7-986a-effe77bb5a2f tempest-AttachVolumeNegativeTest-2126197630 None] deleting rbd volume volume-0eac0146-d3ac-44c5-8076-4c22e019600b {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:23:28.837088 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-c60aee8f-0958-42e7-986a-effe77bb5a2f tempest-AttachVolumeNegativeTest-2126197630 None] Created reservations ['36b84591-8eeb-45e3-8240-83fc9d38a70a', '964fd54a-82b1-4874-84d1-d84154032c11', '93c53ee3-11e1-41be-8537-67c692beb168', 'd8c0471e-8b9c-48a1-ae5f-78f87174606e'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:23:29.069365 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-c60aee8f-0958-42e7-986a-effe77bb5a2f tempest-AttachVolumeNegativeTest-2126197630 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:23:29.097093 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-c60aee8f-0958-42e7-986a-effe77bb5a2f tempest-AttachVolumeNegativeTest-2126197630 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:23:29.125843 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-c60aee8f-0958-42e7-986a-effe77bb5a2f tempest-AttachVolumeNegativeTest-2126197630 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:23:29.127914 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-c60aee8f-0958-42e7-986a-effe77bb5a2f tempest-AttachVolumeNegativeTest-2126197630 None] Deleted volume successfully. Dec 25 21:23:29.230518 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-c60aee8f-0958-42e7-986a-effe77bb5a2f tempest-AttachVolumeNegativeTest-2126197630 None] Lock "b'cinder-0eac0146-d3ac-44c5-8076-4c22e019600b-delete_volume'" released by "delete_volume" :: held 10.294s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:23:29.570521 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:23:29.575891 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:23:29.627625 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:23:29.694849 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:23:38.932045 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-d5e865ce-6735-4a3f-9b41-c223a0128783 tempest-AttachVolumeNegativeTest-2126197630 None] Lock "b'cinder-aa359d7e-7889-4e7a-9d7d-20b3a5bd215b-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:23:39.030990 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-d5e865ce-6735-4a3f-9b41-c223a0128783 tempest-AttachVolumeNegativeTest-2126197630 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:23:39.260633 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-d5e865ce-6735-4a3f-9b41-c223a0128783 tempest-AttachVolumeNegativeTest-2126197630 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:23:39.261300 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-d5e865ce-6735-4a3f-9b41-c223a0128783 tempest-AttachVolumeNegativeTest-2126197630 None] Volume volume-aa359d7e-7889-4e7a-9d7d-20b3a5bd215b is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:23:39.563835 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-d5e865ce-6735-4a3f-9b41-c223a0128783 tempest-AttachVolumeNegativeTest-2126197630 None] deleting rbd volume volume-aa359d7e-7889-4e7a-9d7d-20b3a5bd215b {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:23:41.133826 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-95e7e4b5-b491-405f-aff8-7268d3e10758 tempest-ServersNegativeTestJSON-1875920152 None] Lock "b'cinder-c7f962ef-3f30-4f92-a684-1bdaf2635c0b-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:23:41.245478 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-95e7e4b5-b491-405f-aff8-7268d3e10758 tempest-ServersNegativeTestJSON-1875920152 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:23:41.590599 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-95e7e4b5-b491-405f-aff8-7268d3e10758 tempest-ServersNegativeTestJSON-1875920152 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:23:41.591119 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-95e7e4b5-b491-405f-aff8-7268d3e10758 tempest-ServersNegativeTestJSON-1875920152 None] Volume volume-c7f962ef-3f30-4f92-a684-1bdaf2635c0b is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:23:41.869040 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-95e7e4b5-b491-405f-aff8-7268d3e10758 tempest-ServersNegativeTestJSON-1875920152 None] deleting rbd volume volume-c7f962ef-3f30-4f92-a684-1bdaf2635c0b {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:23:48.755531 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-d5e865ce-6735-4a3f-9b41-c223a0128783 tempest-AttachVolumeNegativeTest-2126197630 None] Created reservations ['7e62184b-5a18-46d8-9302-4e78a2fdd806', '7710c2fd-9813-439b-a085-d16430ed4047', '0ec50512-93fb-41d7-8ad7-70d81e1629db', 'bee2c415-e094-486c-a672-c9da6d61621c'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:23:48.997994 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-d5e865ce-6735-4a3f-9b41-c223a0128783 tempest-AttachVolumeNegativeTest-2126197630 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:23:49.040963 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-d5e865ce-6735-4a3f-9b41-c223a0128783 tempest-AttachVolumeNegativeTest-2126197630 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:23:49.094841 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-d5e865ce-6735-4a3f-9b41-c223a0128783 tempest-AttachVolumeNegativeTest-2126197630 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:23:49.099568 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-d5e865ce-6735-4a3f-9b41-c223a0128783 tempest-AttachVolumeNegativeTest-2126197630 None] Deleted volume successfully. Dec 25 21:23:49.177744 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-d5e865ce-6735-4a3f-9b41-c223a0128783 tempest-AttachVolumeNegativeTest-2126197630 None] Lock "b'cinder-aa359d7e-7889-4e7a-9d7d-20b3a5bd215b-delete_volume'" released by "delete_volume" :: held 10.246s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:23:49.838275 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-c4c7d2b9-c0c4-4bf7-b457-3ea682539b39 req-8d9dcfd6-3ae4-49cf-a47b-eb5158523c01 tempest-ServerRescueNegativeTestJSON-1185237855 None] Terminate volume connection completed successfully. Dec 25 21:23:49.839886 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-c4c7d2b9-c0c4-4bf7-b457-3ea682539b39 req-8d9dcfd6-3ae4-49cf-a47b-eb5158523c01 tempest-ServerRescueNegativeTestJSON-1185237855 None] Deleting attachment 90c5b4d7-ba95-4dc5-9005-4c34fc3741c1. {{(pid=129926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 25 21:23:51.237758 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-95e7e4b5-b491-405f-aff8-7268d3e10758 tempest-ServersNegativeTestJSON-1875920152 None] Created reservations ['7cdac45b-7338-4a4d-9c37-98d4b1fc657a', 'c8413605-273d-45a0-b534-d97ca28bc901', 'd3630b34-7085-4bc5-a23b-78363b184f63', 'f0d44944-82d8-47b1-85cf-b30ed5344616'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:23:51.411613 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-95e7e4b5-b491-405f-aff8-7268d3e10758 tempest-ServersNegativeTestJSON-1875920152 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:23:51.433021 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-95e7e4b5-b491-405f-aff8-7268d3e10758 tempest-ServersNegativeTestJSON-1875920152 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:23:51.464584 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-95e7e4b5-b491-405f-aff8-7268d3e10758 tempest-ServersNegativeTestJSON-1875920152 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:23:51.469504 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-95e7e4b5-b491-405f-aff8-7268d3e10758 tempest-ServersNegativeTestJSON-1875920152 None] Deleted volume successfully. Dec 25 21:23:51.517413 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-fe751fac-f751-480d-ba07-cea60d268f71 tempest-ServerRescueNegativeTestJSON-1185237855 None] Lock "b'cinder-240601d5-5803-4db4-ad87-ded28e2eb84d-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:23:51.582473 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-95e7e4b5-b491-405f-aff8-7268d3e10758 tempest-ServersNegativeTestJSON-1875920152 None] Lock "b'cinder-c7f962ef-3f30-4f92-a684-1bdaf2635c0b-delete_volume'" released by "delete_volume" :: held 10.449s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:23:51.643889 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-fe751fac-f751-480d-ba07-cea60d268f71 tempest-ServerRescueNegativeTestJSON-1185237855 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:23:52.062318 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-fe751fac-f751-480d-ba07-cea60d268f71 tempest-ServerRescueNegativeTestJSON-1185237855 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:23:52.063262 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-fe751fac-f751-480d-ba07-cea60d268f71 tempest-ServerRescueNegativeTestJSON-1185237855 None] Volume volume-240601d5-5803-4db4-ad87-ded28e2eb84d is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:23:52.342013 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-fe751fac-f751-480d-ba07-cea60d268f71 tempest-ServerRescueNegativeTestJSON-1185237855 None] deleting rbd volume volume-240601d5-5803-4db4-ad87-ded28e2eb84d {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:23:52.368035 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-17ab15c7-a276-41f1-b592-746755ecdc59 tempest-ServersNegativeTestJSON-1875920152 None] Lock "b'cinder-4fbcf4fb-0878-421e-9c0a-fee002967afc-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:23:52.547829 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-17ab15c7-a276-41f1-b592-746755ecdc59 tempest-ServersNegativeTestJSON-1875920152 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:23:52.978293 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-17ab15c7-a276-41f1-b592-746755ecdc59 tempest-ServersNegativeTestJSON-1875920152 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:23:52.978817 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-17ab15c7-a276-41f1-b592-746755ecdc59 tempest-ServersNegativeTestJSON-1875920152 None] Volume volume-4fbcf4fb-0878-421e-9c0a-fee002967afc is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:23:53.232257 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-17ab15c7-a276-41f1-b592-746755ecdc59 tempest-ServersNegativeTestJSON-1875920152 None] deleting rbd volume volume-4fbcf4fb-0878-421e-9c0a-fee002967afc {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:24:01.493378 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-17ab15c7-a276-41f1-b592-746755ecdc59 tempest-ServersNegativeTestJSON-1875920152 None] Created reservations ['9e388260-0344-4e22-8c00-9bb121f84bf7', 'ffd68d33-bb05-4180-b066-79905d269f34', 'efa3839b-efed-4433-9f53-d4c1dd0dbe2b', 'a584f66e-8690-4d25-bb32-5084f776defb'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:24:01.503882 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-fe751fac-f751-480d-ba07-cea60d268f71 tempest-ServerRescueNegativeTestJSON-1185237855 None] Created reservations ['f7260b29-86eb-401d-b8e5-d35701ea5bdf', '126b7d53-315c-45da-83be-08c92b8bd4b3', '576c84c5-96c0-4fba-a426-007a3aabad83', 'fb9fc9ba-f20b-499c-ba1a-f735977e8caa'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:24:02.374601 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-17ab15c7-a276-41f1-b592-746755ecdc59 tempest-ServersNegativeTestJSON-1875920152 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:24:02.450496 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-17ab15c7-a276-41f1-b592-746755ecdc59 tempest-ServersNegativeTestJSON-1875920152 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:24:02.656678 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-17ab15c7-a276-41f1-b592-746755ecdc59 tempest-ServersNegativeTestJSON-1875920152 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:24:02.671050 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-17ab15c7-a276-41f1-b592-746755ecdc59 tempest-ServersNegativeTestJSON-1875920152 None] Deleted volume successfully. Dec 25 21:24:02.725457 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-f7165c3e-f7b4-4686-86cf-9c1afa580d8b tempest-ServerRescueNegativeTestJSON-1185237855 None] Lock "b'cinder-dc7c39fd-b000-49c4-9c3e-a1b1f848e64b-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:24:02.787559 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-fe751fac-f751-480d-ba07-cea60d268f71 tempest-ServerRescueNegativeTestJSON-1185237855 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:24:02.871325 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-fe751fac-f751-480d-ba07-cea60d268f71 tempest-ServerRescueNegativeTestJSON-1185237855 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:24:02.918218 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-fe751fac-f751-480d-ba07-cea60d268f71 tempest-ServerRescueNegativeTestJSON-1185237855 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:24:02.925251 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-fe751fac-f751-480d-ba07-cea60d268f71 tempest-ServerRescueNegativeTestJSON-1185237855 None] Deleted volume successfully. Dec 25 21:24:02.929121 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-17ab15c7-a276-41f1-b592-746755ecdc59 tempest-ServersNegativeTestJSON-1875920152 None] Lock "b'cinder-4fbcf4fb-0878-421e-9c0a-fee002967afc-delete_volume'" released by "delete_volume" :: held 10.561s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:24:02.970548 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f7165c3e-f7b4-4686-86cf-9c1afa580d8b tempest-ServerRescueNegativeTestJSON-1185237855 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:24:03.286519 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f7165c3e-f7b4-4686-86cf-9c1afa580d8b tempest-ServerRescueNegativeTestJSON-1185237855 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:24:03.287038 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f7165c3e-f7b4-4686-86cf-9c1afa580d8b tempest-ServerRescueNegativeTestJSON-1185237855 None] Volume volume-dc7c39fd-b000-49c4-9c3e-a1b1f848e64b is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:24:03.546036 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f7165c3e-f7b4-4686-86cf-9c1afa580d8b tempest-ServerRescueNegativeTestJSON-1185237855 None] deleting rbd volume volume-dc7c39fd-b000-49c4-9c3e-a1b1f848e64b {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:24:03.561866 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-fe751fac-f751-480d-ba07-cea60d268f71 tempest-ServerRescueNegativeTestJSON-1185237855 None] Lock "b'cinder-240601d5-5803-4db4-ad87-ded28e2eb84d-delete_volume'" released by "delete_volume" :: held 12.041s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:24:13.617340 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-f7165c3e-f7b4-4686-86cf-9c1afa580d8b tempest-ServerRescueNegativeTestJSON-1185237855 None] Created reservations ['4600f362-4484-44cc-8539-c38e77b5f936', '15780071-cd02-4a97-8b70-d6b64106a912', '7f34ceed-c1fb-44ba-9202-def4ebd03ec0', 'd31ab946-5372-4ee9-876f-13d152bcc32d'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:24:13.896089 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f7165c3e-f7b4-4686-86cf-9c1afa580d8b tempest-ServerRescueNegativeTestJSON-1185237855 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:24:13.971855 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f7165c3e-f7b4-4686-86cf-9c1afa580d8b tempest-ServerRescueNegativeTestJSON-1185237855 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:24:14.021606 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-f7165c3e-f7b4-4686-86cf-9c1afa580d8b tempest-ServerRescueNegativeTestJSON-1185237855 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:24:14.038933 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-f7165c3e-f7b4-4686-86cf-9c1afa580d8b tempest-ServerRescueNegativeTestJSON-1185237855 None] Deleted volume successfully. Dec 25 21:24:14.154977 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-f7165c3e-f7b4-4686-86cf-9c1afa580d8b tempest-ServerRescueNegativeTestJSON-1185237855 None] Lock "b'cinder-dc7c39fd-b000-49c4-9c3e-a1b1f848e64b-delete_volume'" released by "delete_volume" :: held 11.463s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:24:29.569937 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:24:29.571331 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:24:29.631854 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:24:29.728135 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:24:40.475442 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [req-48ec0bab-faae-4788-9a04-2d0000a497f3 req-dcd9ba0f-7857-4867-96db-4a56a8871546 tempest-VolumesGetTestJSON-157046292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:24:40.480013 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [req-48ec0bab-faae-4788-9a04-2d0000a497f3 req-dcd9ba0f-7857-4867-96db-4a56a8871546 tempest-VolumesGetTestJSON-157046292 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:24:40.480772 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [req-48ec0bab-faae-4788-9a04-2d0000a497f3 req-dcd9ba0f-7857-4867-96db-4a56a8871546 tempest-VolumesGetTestJSON-157046292 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:24:40.511972 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-48ec0bab-faae-4788-9a04-2d0000a497f3 req-dcd9ba0f-7857-4867-96db-4a56a8871546 tempest-VolumesGetTestJSON-157046292 None] Flow 'volume_create_manager' (9267568d-6d23-43c5-a8b1-2b58061404e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:24:40.519438 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-48ec0bab-faae-4788-9a04-2d0000a497f3 req-dcd9ba0f-7857-4867-96db-4a56a8871546 tempest-VolumesGetTestJSON-157046292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1be666fa-6a40-4f46-b3bf-dfecfe81a262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:24:40.544286 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [req-48ec0bab-faae-4788-9a04-2d0000a497f3 req-dcd9ba0f-7857-4867-96db-4a56a8871546 tempest-VolumesGetTestJSON-157046292 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:24:40.578097 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-48ec0bab-faae-4788-9a04-2d0000a497f3 req-dcd9ba0f-7857-4867-96db-4a56a8871546 tempest-VolumesGetTestJSON-157046292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1be666fa-6a40-4f46-b3bf-dfecfe81a262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-225946996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=13b96a22-3669-467f-b804-105709b063fe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='352ec3feac38422a973bdc8134d9678b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:24:40Z,use_quota=True,user_id='66cffeb0cda44ffbb26d9cbf29e325d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:24:40.585732 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-48ec0bab-faae-4788-9a04-2d0000a497f3 req-dcd9ba0f-7857-4867-96db-4a56a8871546 tempest-VolumesGetTestJSON-157046292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7462cef-bced-42b4-aa5c-1243c078d258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:24:40.592332 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-48ec0bab-faae-4788-9a04-2d0000a497f3 req-dcd9ba0f-7857-4867-96db-4a56a8871546 tempest-VolumesGetTestJSON-157046292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7462cef-bced-42b4-aa5c-1243c078d258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:24:40.598181 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-48ec0bab-faae-4788-9a04-2d0000a497f3 req-dcd9ba0f-7857-4867-96db-4a56a8871546 tempest-VolumesGetTestJSON-157046292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (963284c4-75d5-4868-848c-4621c876ebae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:24:40.605214 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-48ec0bab-faae-4788-9a04-2d0000a497f3 req-dcd9ba0f-7857-4867-96db-4a56a8871546 tempest-VolumesGetTestJSON-157046292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (963284c4-75d5-4868-848c-4621c876ebae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13b96a22-3669-467f-b804-105709b063fe', 'volume_name': 'volume-13b96a22-3669-467f-b804-105709b063fe', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:24:40.612794 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-48ec0bab-faae-4788-9a04-2d0000a497f3 req-dcd9ba0f-7857-4867-96db-4a56a8871546 tempest-VolumesGetTestJSON-157046292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22e6969d-1cda-402d-bd8f-8955e0e315f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:24:40.615198 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-48ec0bab-faae-4788-9a04-2d0000a497f3 req-dcd9ba0f-7857-4867-96db-4a56a8871546 tempest-VolumesGetTestJSON-157046292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22e6969d-1cda-402d-bd8f-8955e0e315f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:24:40.622684 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-48ec0bab-faae-4788-9a04-2d0000a497f3 req-dcd9ba0f-7857-4867-96db-4a56a8871546 tempest-VolumesGetTestJSON-157046292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (674fa413-ca58-4ce9-9dc7-f1cfa9992b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:24:40.623563 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [req-48ec0bab-faae-4788-9a04-2d0000a497f3 req-dcd9ba0f-7857-4867-96db-4a56a8871546 tempest-VolumesGetTestJSON-157046292 None] Volume 13b96a22-3669-467f-b804-105709b063fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13b96a22-3669-467f-b804-105709b063fe', 'volume_size': 1} Dec 25 21:24:40.624140 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-48ec0bab-faae-4788-9a04-2d0000a497f3 req-dcd9ba0f-7857-4867-96db-4a56a8871546 tempest-VolumesGetTestJSON-157046292 None] creating volume 'volume-13b96a22-3669-467f-b804-105709b063fe' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:24:40.625336 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-48ec0bab-faae-4788-9a04-2d0000a497f3 req-dcd9ba0f-7857-4867-96db-4a56a8871546 tempest-VolumesGetTestJSON-157046292 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:24:41.775856 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-48ec0bab-faae-4788-9a04-2d0000a497f3 req-dcd9ba0f-7857-4867-96db-4a56a8871546 tempest-VolumesGetTestJSON-157046292 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:24:41.776918 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-48ec0bab-faae-4788-9a04-2d0000a497f3 req-dcd9ba0f-7857-4867-96db-4a56a8871546 tempest-VolumesGetTestJSON-157046292 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:24:41.779910 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-48ec0bab-faae-4788-9a04-2d0000a497f3 req-dcd9ba0f-7857-4867-96db-4a56a8871546 tempest-VolumesGetTestJSON-157046292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (674fa413-ca58-4ce9-9dc7-f1cfa9992b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13b96a22-3669-467f-b804-105709b063fe', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:24:41.782518 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-48ec0bab-faae-4788-9a04-2d0000a497f3 req-dcd9ba0f-7857-4867-96db-4a56a8871546 tempest-VolumesGetTestJSON-157046292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93f58dc5-b6dc-42aa-a446-fa20939e15e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:24:41.891041 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [req-48ec0bab-faae-4788-9a04-2d0000a497f3 req-dcd9ba0f-7857-4867-96db-4a56a8871546 tempest-VolumesGetTestJSON-157046292 None] Volume volume-13b96a22-3669-467f-b804-105709b063fe (13b96a22-3669-467f-b804-105709b063fe): created successfully Dec 25 21:24:41.894965 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-48ec0bab-faae-4788-9a04-2d0000a497f3 req-dcd9ba0f-7857-4867-96db-4a56a8871546 tempest-VolumesGetTestJSON-157046292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93f58dc5-b6dc-42aa-a446-fa20939e15e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:24:41.896829 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-48ec0bab-faae-4788-9a04-2d0000a497f3 req-dcd9ba0f-7857-4867-96db-4a56a8871546 tempest-VolumesGetTestJSON-157046292 None] Flow 'volume_create_manager' (9267568d-6d23-43c5-a8b1-2b58061404e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:24:42.015655 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-48ec0bab-faae-4788-9a04-2d0000a497f3 req-dcd9ba0f-7857-4867-96db-4a56a8871546 tempest-VolumesGetTestJSON-157046292 None] Created volume successfully. Dec 25 21:24:43.311564 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [req-e9b309e6-36a4-4f1f-9c41-34af28f75223 req-5d1f8355-a415-4d89-a5b2-54d0ccc0131c tempest-VolumesGetTestJSON-157046292 None] Lock "b'cinder-13b96a22-3669-467f-b804-105709b063fe-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:24:43.472703 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-e9b309e6-36a4-4f1f-9c41-34af28f75223 req-5d1f8355-a415-4d89-a5b2-54d0ccc0131c tempest-VolumesGetTestJSON-157046292 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:24:43.823440 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-e9b309e6-36a4-4f1f-9c41-34af28f75223 req-5d1f8355-a415-4d89-a5b2-54d0ccc0131c tempest-VolumesGetTestJSON-157046292 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:24:43.824225 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-e9b309e6-36a4-4f1f-9c41-34af28f75223 req-5d1f8355-a415-4d89-a5b2-54d0ccc0131c tempest-VolumesGetTestJSON-157046292 None] Volume volume-13b96a22-3669-467f-b804-105709b063fe is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:24:44.126374 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-e9b309e6-36a4-4f1f-9c41-34af28f75223 req-5d1f8355-a415-4d89-a5b2-54d0ccc0131c tempest-VolumesGetTestJSON-157046292 None] deleting rbd volume volume-13b96a22-3669-467f-b804-105709b063fe {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:24:52.989858 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [req-e9b309e6-36a4-4f1f-9c41-34af28f75223 req-5d1f8355-a415-4d89-a5b2-54d0ccc0131c tempest-VolumesGetTestJSON-157046292 None] Created reservations ['7979b030-a88e-482d-b142-9996e95ba2fb', '9f83d0e7-ee2a-449c-a5ad-4b13412517fc', 'dc832276-9595-422a-b686-4481621f0409', '3c4e0b6e-16aa-437b-8694-eb297e0c8bfb'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:24:53.318696 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-e9b309e6-36a4-4f1f-9c41-34af28f75223 req-5d1f8355-a415-4d89-a5b2-54d0ccc0131c tempest-VolumesGetTestJSON-157046292 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:24:53.397626 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-e9b309e6-36a4-4f1f-9c41-34af28f75223 req-5d1f8355-a415-4d89-a5b2-54d0ccc0131c tempest-VolumesGetTestJSON-157046292 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:24:53.479804 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [req-e9b309e6-36a4-4f1f-9c41-34af28f75223 req-5d1f8355-a415-4d89-a5b2-54d0ccc0131c tempest-VolumesGetTestJSON-157046292 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:24:53.487845 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-e9b309e6-36a4-4f1f-9c41-34af28f75223 req-5d1f8355-a415-4d89-a5b2-54d0ccc0131c tempest-VolumesGetTestJSON-157046292 None] Deleted volume successfully. Dec 25 21:24:53.594766 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [req-e9b309e6-36a4-4f1f-9c41-34af28f75223 req-5d1f8355-a415-4d89-a5b2-54d0ccc0131c tempest-VolumesGetTestJSON-157046292 None] Lock "b'cinder-13b96a22-3669-467f-b804-105709b063fe-delete_volume'" released by "delete_volume" :: held 10.280s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:25:29.574019 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:25:29.574861 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:25:29.638546 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:25:29.690004 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:26:29.579102 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:26:29.581464 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:26:29.669923 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:26:29.761107 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:27:27.384728 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-bc89a77e-e533-43c4-a86a-ff1127c89bcd req-b32a80fe-31e2-46a7-940e-47851cfe62a7 tempest-ServersTestBootFromVolume-822926053 None] Terminate volume connection completed successfully. Dec 25 21:27:27.385533 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-bc89a77e-e533-43c4-a86a-ff1127c89bcd req-b32a80fe-31e2-46a7-940e-47851cfe62a7 tempest-ServersTestBootFromVolume-822926053 None] Deleting attachment 3e16e0b5-c229-451c-9f5c-5dd0880b8d88. {{(pid=129926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 25 21:27:27.866196 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [req-bc89a77e-e533-43c4-a86a-ff1127c89bcd req-0256b46c-8a91-4153-b512-0abdaac11b67 tempest-ServersTestBootFromVolume-822926053 None] Lock "b'cinder-ed6b3e76-7317-467c-b37b-47dd7301c918-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:27:27.991024 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-bc89a77e-e533-43c4-a86a-ff1127c89bcd req-0256b46c-8a91-4153-b512-0abdaac11b67 tempest-ServersTestBootFromVolume-822926053 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:27:28.592727 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-bc89a77e-e533-43c4-a86a-ff1127c89bcd req-0256b46c-8a91-4153-b512-0abdaac11b67 tempest-ServersTestBootFromVolume-822926053 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:27:28.869604 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-bc89a77e-e533-43c4-a86a-ff1127c89bcd req-0256b46c-8a91-4153-b512-0abdaac11b67 tempest-ServersTestBootFromVolume-822926053 None] deleting rbd volume volume-ed6b3e76-7317-467c-b37b-47dd7301c918 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:27:29.584361 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:27:29.585699 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:27:29.645953 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:27:29.695544 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:27:38.566439 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-bc89a77e-e533-43c4-a86a-ff1127c89bcd req-0256b46c-8a91-4153-b512-0abdaac11b67 tempest-ServersTestBootFromVolume-822926053 None] volume is a clone so cleaning references {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 25 21:27:38.777421 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-bc89a77e-e533-43c4-a86a-ff1127c89bcd req-0256b46c-8a91-4153-b512-0abdaac11b67 tempest-ServersTestBootFromVolume-822926053 None] deleting parent snapshot volume-ed6b3e76-7317-467c-b37b-47dd7301c918.clone_snap {{(pid=129926) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 25 21:27:42.840516 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [req-bc89a77e-e533-43c4-a86a-ff1127c89bcd req-0256b46c-8a91-4153-b512-0abdaac11b67 tempest-ServersTestBootFromVolume-822926053 None] Created reservations ['bb3f4398-ac1f-4c71-bec5-e3a691670b6a', 'ac5d912e-20b6-47ec-9c88-6a769199c187', '3816b084-7b78-4760-932a-7c3022139f37', '544a03d2-5495-4a6b-ad9b-c09164b7219b'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:27:43.118430 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-bc89a77e-e533-43c4-a86a-ff1127c89bcd req-0256b46c-8a91-4153-b512-0abdaac11b67 tempest-ServersTestBootFromVolume-822926053 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:27:43.164732 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-bc89a77e-e533-43c4-a86a-ff1127c89bcd req-0256b46c-8a91-4153-b512-0abdaac11b67 tempest-ServersTestBootFromVolume-822926053 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:27:43.212176 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [req-bc89a77e-e533-43c4-a86a-ff1127c89bcd req-0256b46c-8a91-4153-b512-0abdaac11b67 tempest-ServersTestBootFromVolume-822926053 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:27:43.218719 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-bc89a77e-e533-43c4-a86a-ff1127c89bcd req-0256b46c-8a91-4153-b512-0abdaac11b67 tempest-ServersTestBootFromVolume-822926053 None] Deleted volume successfully. Dec 25 21:27:43.312765 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [req-bc89a77e-e533-43c4-a86a-ff1127c89bcd req-0256b46c-8a91-4153-b512-0abdaac11b67 tempest-ServersTestBootFromVolume-822926053 None] Lock "b'cinder-ed6b3e76-7317-467c-b37b-47dd7301c918-delete_volume'" released by "delete_volume" :: held 15.447s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:28:13.727353 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-3741077c-4510-49be-b9ca-043d4019bb45 tempest-VolumesCloneTest-843094097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:28:13.737208 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-3741077c-4510-49be-b9ca-043d4019bb45 tempest-VolumesCloneTest-843094097 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:28:13.738899 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-3741077c-4510-49be-b9ca-043d4019bb45 tempest-VolumesCloneTest-843094097 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:28:13.777436 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3741077c-4510-49be-b9ca-043d4019bb45 tempest-VolumesCloneTest-843094097 None] Flow 'volume_create_manager' (d09d25c8-42c6-4cb2-b364-6b7455068850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:28:13.783296 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3741077c-4510-49be-b9ca-043d4019bb45 tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ef0229b-ac4a-4dad-a1f8-37ef288e3039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:13.790002 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-3741077c-4510-49be-b9ca-043d4019bb45 tempest-VolumesCloneTest-843094097 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:28:13.805103 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3741077c-4510-49be-b9ca-043d4019bb45 tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ef0229b-ac4a-4dad-a1f8-37ef288e3039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:28:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1993663171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8e11017c-7649-4b11-8607-8f99ddd48c83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d33281b0c4c402eacd641a45e81edd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:28:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:28:13Z,use_quota=True,user_id='ebf61af4a7d6490ca760c131cfa5cf8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:13.810376 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3741077c-4510-49be-b9ca-043d4019bb45 tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (083a36e5-1148-4ed1-b69f-cfc7a762d020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:13.813645 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3741077c-4510-49be-b9ca-043d4019bb45 tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (083a36e5-1148-4ed1-b69f-cfc7a762d020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:13.818286 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3741077c-4510-49be-b9ca-043d4019bb45 tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c29ba4a-79ec-4a6b-bdfd-67b029d7ed62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:13.972670 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3741077c-4510-49be-b9ca-043d4019bb45 tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c29ba4a-79ec-4a6b-bdfd-67b029d7ed62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8e11017c-7649-4b11-8607-8f99ddd48c83', 'volume_name': 'volume-8e11017c-7649-4b11-8607-8f99ddd48c83', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:13.978320 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3741077c-4510-49be-b9ca-043d4019bb45 tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dded248e-655e-479a-9867-dc3a2ded20ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:13.985859 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3741077c-4510-49be-b9ca-043d4019bb45 tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dded248e-655e-479a-9867-dc3a2ded20ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:13.988595 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3741077c-4510-49be-b9ca-043d4019bb45 tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b938b7b-cdbd-415d-9ba3-5df5626fb949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:13.989841 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-3741077c-4510-49be-b9ca-043d4019bb45 tempest-VolumesCloneTest-843094097 None] Volume 8e11017c-7649-4b11-8607-8f99ddd48c83: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8e11017c-7649-4b11-8607-8f99ddd48c83', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 25 21:28:13.991055 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-3741077c-4510-49be-b9ca-043d4019bb45 tempest-VolumesCloneTest-843094097 None] Cloning 8e11017c-7649-4b11-8607-8f99ddd48c83 from image aca914d0-5f7b-465f-a024-75efa27d7291 at location (None, None). {{(pid=129926) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Dec 25 21:28:14.007054 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-3741077c-4510-49be-b9ca-043d4019bb45 tempest-VolumesCloneTest-843094097 None] Lock "b'cinder-aca914d0-5f7b-465f-a024-75efa27d7291'" acquired by "_prepare_image_cache_entry" :: waited 0.015s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:28:14.104089 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-3741077c-4510-49be-b9ca-043d4019bb45 tempest-VolumesCloneTest-843094097 None] Found image-volume cache entry: {'id': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'volume_id': '058f5fb3-51e4-40e3-9c98-542207f1fc1f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31), 'last_used': datetime.datetime(2021, 12, 25, 21, 28, 14, 11701)}. {{(pid=129926) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 25 21:28:14.104529 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-3741077c-4510-49be-b9ca-043d4019bb45 tempest-VolumesCloneTest-843094097 None] Image-volume cache entry image_update_at = 2021-12-25 20:58:31+00:00, requested image updated_at = 2021-12-25 20:58:31+00:00. {{(pid=129926) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 25 21:28:14.105112 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-3741077c-4510-49be-b9ca-043d4019bb45 tempest-VolumesCloneTest-843094097 None] Found cache entry for image = aca914d0-5f7b-465f-a024-75efa27d7291 on host ncdv-master-1@ceph#ceph. {{(pid=129926) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Dec 25 21:28:14.116319 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-3741077c-4510-49be-b9ca-043d4019bb45 tempest-VolumesCloneTest-843094097 None] Lock "b'cinder-aca914d0-5f7b-465f-a024-75efa27d7291'" released by "_prepare_image_cache_entry" :: held 0.107s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:28:14.116319 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-3741077c-4510-49be-b9ca-043d4019bb45 tempest-VolumesCloneTest-843094097 None] Attempting to retrieve cache entry for image = aca914d0-5f7b-465f-a024-75efa27d7291 on host ncdv-master-1@ceph#ceph. {{(pid=129926) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Dec 25 21:28:14.142215 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-3741077c-4510-49be-b9ca-043d4019bb45 tempest-VolumesCloneTest-843094097 None] Found image-volume cache entry: {'id': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'volume_id': '058f5fb3-51e4-40e3-9c98-542207f1fc1f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31), 'last_used': datetime.datetime(2021, 12, 25, 21, 28, 14, 132379)}. {{(pid=129926) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 25 21:28:14.142561 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-3741077c-4510-49be-b9ca-043d4019bb45 tempest-VolumesCloneTest-843094097 None] Image-volume cache entry image_update_at = 2021-12-25 20:58:31+00:00, requested image updated_at = 2021-12-25 20:58:31+00:00. {{(pid=129926) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 25 21:28:14.147671 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-3741077c-4510-49be-b9ca-043d4019bb45 tempest-VolumesCloneTest-843094097 None] Creating from source image-volume 058f5fb3-51e4-40e3-9c98-542207f1fc1f {{(pid=129926) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Dec 25 21:28:14.189301 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-3741077c-4510-49be-b9ca-043d4019bb45 tempest-VolumesCloneTest-843094097 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:28:14.628995 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-3741077c-4510-49be-b9ca-043d4019bb45 tempest-VolumesCloneTest-843094097 None] creating snapshot='volume-8e11017c-7649-4b11-8607-8f99ddd48c83.clone_snap' {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 25 21:28:16.817334 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-3741077c-4510-49be-b9ca-043d4019bb45 tempest-VolumesCloneTest-843094097 None] cloning 'volume-058f5fb3-51e4-40e3-9c98-542207f1fc1f@volume-8e11017c-7649-4b11-8607-8f99ddd48c83.clone_snap' to 'volume-8e11017c-7649-4b11-8607-8f99ddd48c83' {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 25 21:28:16.970029 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-11cea441-67eb-40b1-906f-810c056c6bee tempest-TaggedBootDevicesTest-292780470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:28:16.972972 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-11cea441-67eb-40b1-906f-810c056c6bee tempest-TaggedBootDevicesTest-292780470 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:28:16.976965 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-11cea441-67eb-40b1-906f-810c056c6bee tempest-TaggedBootDevicesTest-292780470 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:28:16.991755 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-11cea441-67eb-40b1-906f-810c056c6bee tempest-TaggedBootDevicesTest-292780470 None] Flow 'volume_create_manager' (22499db8-cd00-4aa2-8594-eb0730393f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:28:16.995512 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-11cea441-67eb-40b1-906f-810c056c6bee tempest-TaggedBootDevicesTest-292780470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dd22d70-75c4-499d-a36f-87adaf8b6a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:17.004067 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-11cea441-67eb-40b1-906f-810c056c6bee tempest-TaggedBootDevicesTest-292780470 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:28:17.020713 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-11cea441-67eb-40b1-906f-810c056c6bee tempest-TaggedBootDevicesTest-292780470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dd22d70-75c4-499d-a36f-87adaf8b6a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-604020395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6c571104-d681-49c0-b0ed-045a03bd3bba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='980165331b334d7795b91adc96459725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:28:17Z,use_quota=True,user_id='0d9b0c5962544b66b24db53b7e9b8333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:17.027684 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-11cea441-67eb-40b1-906f-810c056c6bee tempest-TaggedBootDevicesTest-292780470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6846e156-0312-4861-bbc7-6f97eab3b28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:17.031641 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-11cea441-67eb-40b1-906f-810c056c6bee tempest-TaggedBootDevicesTest-292780470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6846e156-0312-4861-bbc7-6f97eab3b28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:17.034704 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-11cea441-67eb-40b1-906f-810c056c6bee tempest-TaggedBootDevicesTest-292780470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0789e3d4-3696-40a3-b164-5604bd123c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:17.170707 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-11cea441-67eb-40b1-906f-810c056c6bee tempest-TaggedBootDevicesTest-292780470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0789e3d4-3696-40a3-b164-5604bd123c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6c571104-d681-49c0-b0ed-045a03bd3bba', 'volume_name': 'volume-6c571104-d681-49c0-b0ed-045a03bd3bba', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:17.173009 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-11cea441-67eb-40b1-906f-810c056c6bee tempest-TaggedBootDevicesTest-292780470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec109dd2-3632-4d5d-8b75-ebc65bab9e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:17.180071 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-11cea441-67eb-40b1-906f-810c056c6bee tempest-TaggedBootDevicesTest-292780470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec109dd2-3632-4d5d-8b75-ebc65bab9e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:17.182404 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-11cea441-67eb-40b1-906f-810c056c6bee tempest-TaggedBootDevicesTest-292780470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d826569-de83-4ade-8d1d-24329db4df9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:17.183287 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-11cea441-67eb-40b1-906f-810c056c6bee tempest-TaggedBootDevicesTest-292780470 None] Volume 6c571104-d681-49c0-b0ed-045a03bd3bba: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6c571104-d681-49c0-b0ed-045a03bd3bba', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 25 21:28:17.189631 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-11cea441-67eb-40b1-906f-810c056c6bee tempest-TaggedBootDevicesTest-292780470 None] Cloning 6c571104-d681-49c0-b0ed-045a03bd3bba from image aca914d0-5f7b-465f-a024-75efa27d7291 at location (None, None). {{(pid=129926) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Dec 25 21:28:17.210222 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-11cea441-67eb-40b1-906f-810c056c6bee tempest-TaggedBootDevicesTest-292780470 None] Lock "b'cinder-aca914d0-5f7b-465f-a024-75efa27d7291'" acquired by "_prepare_image_cache_entry" :: waited 0.019s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:28:17.343437 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-4932c0e5-7d89-442c-a63b-98bd45cc9716 tempest-GroupsV314Test-641327080 None] Group tempest-GroupsV314Test-Group-162056949: creating Dec 25 21:28:17.346435 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-11cea441-67eb-40b1-906f-810c056c6bee tempest-TaggedBootDevicesTest-292780470 None] Found image-volume cache entry: {'id': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'volume_id': '058f5fb3-51e4-40e3-9c98-542207f1fc1f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31), 'last_used': datetime.datetime(2021, 12, 25, 21, 28, 17, 214941)}. {{(pid=129926) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 25 21:28:17.346849 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-11cea441-67eb-40b1-906f-810c056c6bee tempest-TaggedBootDevicesTest-292780470 None] Image-volume cache entry image_update_at = 2021-12-25 20:58:31+00:00, requested image updated_at = 2021-12-25 20:58:31+00:00. {{(pid=129926) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 25 21:28:17.347250 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-11cea441-67eb-40b1-906f-810c056c6bee tempest-TaggedBootDevicesTest-292780470 None] Found cache entry for image = aca914d0-5f7b-465f-a024-75efa27d7291 on host ncdv-master-1@ceph#ceph. {{(pid=129926) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Dec 25 21:28:17.368367 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-11cea441-67eb-40b1-906f-810c056c6bee tempest-TaggedBootDevicesTest-292780470 None] Lock "b'cinder-aca914d0-5f7b-465f-a024-75efa27d7291'" released by "_prepare_image_cache_entry" :: held 0.158s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:28:17.369249 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-11cea441-67eb-40b1-906f-810c056c6bee tempest-TaggedBootDevicesTest-292780470 None] Attempting to retrieve cache entry for image = aca914d0-5f7b-465f-a024-75efa27d7291 on host ncdv-master-1@ceph#ceph. {{(pid=129926) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Dec 25 21:28:17.382536 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-11cea441-67eb-40b1-906f-810c056c6bee tempest-TaggedBootDevicesTest-292780470 None] Found image-volume cache entry: {'id': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'volume_id': '058f5fb3-51e4-40e3-9c98-542207f1fc1f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31), 'last_used': datetime.datetime(2021, 12, 25, 21, 28, 17, 379202)}. {{(pid=129926) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 25 21:28:17.382882 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-11cea441-67eb-40b1-906f-810c056c6bee tempest-TaggedBootDevicesTest-292780470 None] Image-volume cache entry image_update_at = 2021-12-25 20:58:31+00:00, requested image updated_at = 2021-12-25 20:58:31+00:00. {{(pid=129926) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 25 21:28:17.383283 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-11cea441-67eb-40b1-906f-810c056c6bee tempest-TaggedBootDevicesTest-292780470 None] Creating from source image-volume 058f5fb3-51e4-40e3-9c98-542207f1fc1f {{(pid=129926) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Dec 25 21:28:17.401047 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-11cea441-67eb-40b1-906f-810c056c6bee tempest-TaggedBootDevicesTest-292780470 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:28:17.722522 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-11cea441-67eb-40b1-906f-810c056c6bee tempest-TaggedBootDevicesTest-292780470 None] creating snapshot='volume-6c571104-d681-49c0-b0ed-045a03bd3bba.clone_snap' {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 25 21:28:19.918445 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-11cea441-67eb-40b1-906f-810c056c6bee tempest-TaggedBootDevicesTest-292780470 None] cloning 'volume-058f5fb3-51e4-40e3-9c98-542207f1fc1f@volume-6c571104-d681-49c0-b0ed-045a03bd3bba.clone_snap' to 'volume-6c571104-d681-49c0-b0ed-045a03bd3bba' {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 25 21:28:20.009215 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-3741077c-4510-49be-b9ca-043d4019bb45 tempest-VolumesCloneTest-843094097 None] Volume volume-98b6d31e-e760-499e-8962-7b22479c1e9a.deleted is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:28:20.010780 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-3741077c-4510-49be-b9ca-043d4019bb45 tempest-VolumesCloneTest-843094097 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:28:20.012186 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-3741077c-4510-49be-b9ca-043d4019bb45 tempest-VolumesCloneTest-843094097 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:28:20.691722 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-3741077c-4510-49be-b9ca-043d4019bb45 tempest-VolumesCloneTest-843094097 None] clone created successfully {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 25 21:28:20.693306 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.volume_utils [None req-3741077c-4510-49be-b9ca-043d4019bb45 tempest-VolumesCloneTest-843094097 None] Marking volume 8e11017c-7649-4b11-8607-8f99ddd48c83 as bootable. {{(pid=129926) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 25 21:28:20.819387 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-4932c0e5-7d89-442c-a63b-98bd45cc9716 tempest-GroupsV314Test-641327080 None] Group tempest-GroupsV314Test-Group-162056949: created successfully Dec 25 21:28:20.831631 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-4932c0e5-7d89-442c-a63b-98bd45cc9716 tempest-GroupsV314Test-641327080 None] Create group completed successfully. Dec 25 21:28:20.845740 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-3741077c-4510-49be-b9ca-043d4019bb45 tempest-VolumesCloneTest-843094097 None] Copying metadata from image aca914d0-5f7b-465f-a024-75efa27d7291 to 8e11017c-7649-4b11-8607-8f99ddd48c83. {{(pid=129926) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Dec 25 21:28:20.846248 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-3741077c-4510-49be-b9ca-043d4019bb45 tempest-VolumesCloneTest-843094097 None] Creating volume glance metadata for volume 8e11017c-7649-4b11-8607-8f99ddd48c83 backed by image aca914d0-5f7b-465f-a024-75efa27d7291 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129926) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Dec 25 21:28:20.854405 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-88f20deb-909a-43ef-a085-c7a5e1965c52 tempest-GroupsV314Test-641327080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:28:20.854405 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-88f20deb-909a-43ef-a085-c7a5e1965c52 tempest-GroupsV314Test-641327080 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:28:20.854405 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-88f20deb-909a-43ef-a085-c7a5e1965c52 tempest-GroupsV314Test-641327080 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:28:20.865444 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-88f20deb-909a-43ef-a085-c7a5e1965c52 tempest-GroupsV314Test-641327080 None] Flow 'volume_create_manager' (8abc1915-b321-491d-9322-e9e69b756058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:28:20.869250 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-88f20deb-909a-43ef-a085-c7a5e1965c52 tempest-GroupsV314Test-641327080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b8b585d-d65c-4775-b7f0-d47f92f76b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:20.877445 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-88f20deb-909a-43ef-a085-c7a5e1965c52 tempest-GroupsV314Test-641327080 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:28:20.893890 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-88f20deb-909a-43ef-a085-c7a5e1965c52 tempest-GroupsV314Test-641327080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b8b585d-d65c-4775-b7f0-d47f92f76b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsV314Test-Volume-431610567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6e290c68-844b-4bd2-98e4-0474acdc81d8,host='ncdv-master-1@ceph#ceph',id=692b5026-7577-41a7-aa69-91d6f8ebac8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01fe97247f8d425d80e1d145476201a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:28:19Z,use_quota=True,user_id='cff6cb2ab4fc4993a8c9fca4b07a2522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffe812c-9834-4a27-9664-6c697dd136af),volume_type_id=9ffe812c-9834-4a27-9664-6c697dd136af)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:20.896508 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-88f20deb-909a-43ef-a085-c7a5e1965c52 tempest-GroupsV314Test-641327080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1a7619a-b62f-4ddb-be47-cb4818450f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:20.898696 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-88f20deb-909a-43ef-a085-c7a5e1965c52 tempest-GroupsV314Test-641327080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1a7619a-b62f-4ddb-be47-cb4818450f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:20.901146 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-88f20deb-909a-43ef-a085-c7a5e1965c52 tempest-GroupsV314Test-641327080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0db94107-d449-4069-b2f8-f4819b8ab08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:20.904306 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-88f20deb-909a-43ef-a085-c7a5e1965c52 tempest-GroupsV314Test-641327080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0db94107-d449-4069-b2f8-f4819b8ab08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '692b5026-7577-41a7-aa69-91d6f8ebac8a', 'volume_name': 'volume-692b5026-7577-41a7-aa69-91d6f8ebac8a', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:20.907005 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-88f20deb-909a-43ef-a085-c7a5e1965c52 tempest-GroupsV314Test-641327080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3097220-98e8-4dfe-b095-b1612c829bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:20.909375 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-88f20deb-909a-43ef-a085-c7a5e1965c52 tempest-GroupsV314Test-641327080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3097220-98e8-4dfe-b095-b1612c829bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:20.911758 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-88f20deb-909a-43ef-a085-c7a5e1965c52 tempest-GroupsV314Test-641327080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a28474f7-bd12-460b-81be-76280319ba8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:20.912794 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-88f20deb-909a-43ef-a085-c7a5e1965c52 tempest-GroupsV314Test-641327080 None] Volume 692b5026-7577-41a7-aa69-91d6f8ebac8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-692b5026-7577-41a7-aa69-91d6f8ebac8a', 'volume_size': 1} Dec 25 21:28:20.913364 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-88f20deb-909a-43ef-a085-c7a5e1965c52 tempest-GroupsV314Test-641327080 None] creating volume 'volume-692b5026-7577-41a7-aa69-91d6f8ebac8a' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:28:20.914335 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-88f20deb-909a-43ef-a085-c7a5e1965c52 tempest-GroupsV314Test-641327080 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:28:21.179907 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3741077c-4510-49be-b9ca-043d4019bb45 tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b938b7b-cdbd-415d-9ba3-5df5626fb949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e11017c-7649-4b11-8607-8f99ddd48c83', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:21.184131 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3741077c-4510-49be-b9ca-043d4019bb45 tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bee9ed76-cbe2-4068-8df6-fdf74f694b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:21.262469 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-3741077c-4510-49be-b9ca-043d4019bb45 tempest-VolumesCloneTest-843094097 None] Volume volume-8e11017c-7649-4b11-8607-8f99ddd48c83 (8e11017c-7649-4b11-8607-8f99ddd48c83): created successfully Dec 25 21:28:21.265723 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3741077c-4510-49be-b9ca-043d4019bb45 tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bee9ed76-cbe2-4068-8df6-fdf74f694b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:21.271257 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3741077c-4510-49be-b9ca-043d4019bb45 tempest-VolumesCloneTest-843094097 None] Flow 'volume_create_manager' (d09d25c8-42c6-4cb2-b364-6b7455068850) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:28:21.344011 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-3741077c-4510-49be-b9ca-043d4019bb45 tempest-VolumesCloneTest-843094097 None] Created volume successfully. Dec 25 21:28:21.910436 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-88f20deb-909a-43ef-a085-c7a5e1965c52 tempest-GroupsV314Test-641327080 None] extra_specs: {} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:28:21.910824 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-88f20deb-909a-43ef-a085-c7a5e1965c52 tempest-GroupsV314Test-641327080 None] extra_specs: {} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:28:21.912989 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-88f20deb-909a-43ef-a085-c7a5e1965c52 tempest-GroupsV314Test-641327080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a28474f7-bd12-460b-81be-76280319ba8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-692b5026-7577-41a7-aa69-91d6f8ebac8a', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:21.915161 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-88f20deb-909a-43ef-a085-c7a5e1965c52 tempest-GroupsV314Test-641327080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43a1a05b-38f0-4b47-b7f2-eb78b85f4e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:22.007763 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-88f20deb-909a-43ef-a085-c7a5e1965c52 tempest-GroupsV314Test-641327080 None] Volume volume-692b5026-7577-41a7-aa69-91d6f8ebac8a (692b5026-7577-41a7-aa69-91d6f8ebac8a): created successfully Dec 25 21:28:22.009795 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-88f20deb-909a-43ef-a085-c7a5e1965c52 tempest-GroupsV314Test-641327080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43a1a05b-38f0-4b47-b7f2-eb78b85f4e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:22.013554 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-88f20deb-909a-43ef-a085-c7a5e1965c52 tempest-GroupsV314Test-641327080 None] Flow 'volume_create_manager' (8abc1915-b321-491d-9322-e9e69b756058) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:28:22.087234 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-11cea441-67eb-40b1-906f-810c056c6bee tempest-TaggedBootDevicesTest-292780470 None] Volume volume-98b6d31e-e760-499e-8962-7b22479c1e9a.deleted is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:28:22.089070 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-11cea441-67eb-40b1-906f-810c056c6bee tempest-TaggedBootDevicesTest-292780470 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:28:22.089661 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-11cea441-67eb-40b1-906f-810c056c6bee tempest-TaggedBootDevicesTest-292780470 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:28:22.373515 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-11cea441-67eb-40b1-906f-810c056c6bee tempest-TaggedBootDevicesTest-292780470 None] clone created successfully {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 25 21:28:22.374120 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.volume_utils [None req-11cea441-67eb-40b1-906f-810c056c6bee tempest-TaggedBootDevicesTest-292780470 None] Marking volume 6c571104-d681-49c0-b0ed-045a03bd3bba as bootable. {{(pid=129926) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 25 21:28:22.378992 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-88f20deb-909a-43ef-a085-c7a5e1965c52 tempest-GroupsV314Test-641327080 None] Created volume successfully. Dec 25 21:28:22.459663 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-11cea441-67eb-40b1-906f-810c056c6bee tempest-TaggedBootDevicesTest-292780470 None] Copying metadata from image aca914d0-5f7b-465f-a024-75efa27d7291 to 6c571104-d681-49c0-b0ed-045a03bd3bba. {{(pid=129926) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Dec 25 21:28:22.460538 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-11cea441-67eb-40b1-906f-810c056c6bee tempest-TaggedBootDevicesTest-292780470 None] Creating volume glance metadata for volume 6c571104-d681-49c0-b0ed-045a03bd3bba backed by image aca914d0-5f7b-465f-a024-75efa27d7291 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129926) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Dec 25 21:28:22.671983 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-11cea441-67eb-40b1-906f-810c056c6bee tempest-TaggedBootDevicesTest-292780470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d826569-de83-4ade-8d1d-24329db4df9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c571104-d681-49c0-b0ed-045a03bd3bba', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:22.675720 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-11cea441-67eb-40b1-906f-810c056c6bee tempest-TaggedBootDevicesTest-292780470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d27f7405-7c3a-4fc6-ba26-cd5cbf5c6a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:22.760219 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-11cea441-67eb-40b1-906f-810c056c6bee tempest-TaggedBootDevicesTest-292780470 None] Volume volume-6c571104-d681-49c0-b0ed-045a03bd3bba (6c571104-d681-49c0-b0ed-045a03bd3bba): created successfully Dec 25 21:28:22.764856 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-11cea441-67eb-40b1-906f-810c056c6bee tempest-TaggedBootDevicesTest-292780470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d27f7405-7c3a-4fc6-ba26-cd5cbf5c6a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:22.771753 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-11cea441-67eb-40b1-906f-810c056c6bee tempest-TaggedBootDevicesTest-292780470 None] Flow 'volume_create_manager' (22499db8-cd00-4aa2-8594-eb0730393f7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:28:22.845367 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-11cea441-67eb-40b1-906f-810c056c6bee tempest-TaggedBootDevicesTest-292780470 None] Created volume successfully. Dec 25 21:28:23.538072 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1772a2f-0a7e-4c5d-be1e-9d76c3542c5f tempest-VolumesCloneTest-843094097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:28:23.542639 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-b1772a2f-0a7e-4c5d-be1e-9d76c3542c5f tempest-VolumesCloneTest-843094097 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:28:23.543271 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-b1772a2f-0a7e-4c5d-be1e-9d76c3542c5f tempest-VolumesCloneTest-843094097 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:28:23.583150 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b1772a2f-0a7e-4c5d-be1e-9d76c3542c5f tempest-VolumesCloneTest-843094097 None] Flow 'volume_create_manager' (df56161b-a254-4c90-ba93-6b63e097e268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:28:23.593430 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b1772a2f-0a7e-4c5d-be1e-9d76c3542c5f tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5117e82a-6230-4ab3-8d71-1ad9678892bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:23.605751 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-b1772a2f-0a7e-4c5d-be1e-9d76c3542c5f tempest-VolumesCloneTest-843094097 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:28:23.618656 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b1772a2f-0a7e-4c5d-be1e-9d76c3542c5f tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5117e82a-6230-4ab3-8d71-1ad9678892bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-150873726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4aebfc13-7c5d-4bfd-ab8f-3812fd99e521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d33281b0c4c402eacd641a45e81edd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=8e11017c-7649-4b11-8607-8f99ddd48c83,status='creating',terminated_at=None,updated_at=2021-12-25T21:28:23Z,use_quota=True,user_id='ebf61af4a7d6490ca760c131cfa5cf8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:23.621984 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b1772a2f-0a7e-4c5d-be1e-9d76c3542c5f tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25ff1426-49af-4c57-9ddb-5ea5a06ebe6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:23.626129 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b1772a2f-0a7e-4c5d-be1e-9d76c3542c5f tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25ff1426-49af-4c57-9ddb-5ea5a06ebe6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:23.627001 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b1772a2f-0a7e-4c5d-be1e-9d76c3542c5f tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e746e3fa-07db-4ad8-82b1-0c4c6439f063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:23.642629 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b1772a2f-0a7e-4c5d-be1e-9d76c3542c5f tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e746e3fa-07db-4ad8-82b1-0c4c6439f063) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4aebfc13-7c5d-4bfd-ab8f-3812fd99e521', 'volume_name': 'volume-4aebfc13-7c5d-4bfd-ab8f-3812fd99e521', 'volume_size': 1, 'source_volid': '8e11017c-7649-4b11-8607-8f99ddd48c83', 'source_volstatus': 'available'}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:23.645312 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b1772a2f-0a7e-4c5d-be1e-9d76c3542c5f tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1270ef9-35ef-47de-8abf-1bb3c07bd905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:23.648143 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b1772a2f-0a7e-4c5d-be1e-9d76c3542c5f tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1270ef9-35ef-47de-8abf-1bb3c07bd905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:23.651448 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b1772a2f-0a7e-4c5d-be1e-9d76c3542c5f tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17e7e59c-1e50-4a10-97e5-fdd3e4bc3b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:23.652706 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-b1772a2f-0a7e-4c5d-be1e-9d76c3542c5f tempest-VolumesCloneTest-843094097 None] Volume 4aebfc13-7c5d-4bfd-ab8f-3812fd99e521: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4aebfc13-7c5d-4bfd-ab8f-3812fd99e521', 'volume_size': 1, 'source_volid': '8e11017c-7649-4b11-8607-8f99ddd48c83', 'source_volstatus': 'available'} Dec 25 21:28:23.667987 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b1772a2f-0a7e-4c5d-be1e-9d76c3542c5f tempest-VolumesCloneTest-843094097 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:28:23.978813 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b1772a2f-0a7e-4c5d-be1e-9d76c3542c5f tempest-VolumesCloneTest-843094097 None] creating snapshot='volume-4aebfc13-7c5d-4bfd-ab8f-3812fd99e521.clone_snap' {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 25 21:28:27.300082 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b1772a2f-0a7e-4c5d-be1e-9d76c3542c5f tempest-VolumesCloneTest-843094097 None] cloning 'volume-8e11017c-7649-4b11-8607-8f99ddd48c83@volume-4aebfc13-7c5d-4bfd-ab8f-3812fd99e521.clone_snap' to 'volume-4aebfc13-7c5d-4bfd-ab8f-3812fd99e521' {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 25 21:28:27.415154 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-8478d76a-3a40-42ad-a9ea-e6d3734b468f tempest-GroupsV314Test-641327080 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:28:27.658949 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-8478d76a-3a40-42ad-a9ea-e6d3734b468f tempest-GroupsV314Test-641327080 None] creating snapshot='volume-704ead87-ef4a-49a9-b1ee-dfab4b99a4f4.clone_snap' {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 25 21:28:29.856743 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-8478d76a-3a40-42ad-a9ea-e6d3734b468f tempest-GroupsV314Test-641327080 None] cloning 'volume-692b5026-7577-41a7-aa69-91d6f8ebac8a@volume-704ead87-ef4a-49a9-b1ee-dfab4b99a4f4.clone_snap' to 'volume-704ead87-ef4a-49a9-b1ee-dfab4b99a4f4' {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 25 21:28:29.858600 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:28:29.859319 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:28:29.904142 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:28:29.943931 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:28:30.119926 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b1772a2f-0a7e-4c5d-be1e-9d76c3542c5f tempest-VolumesCloneTest-843094097 None] Volume volume-98b6d31e-e760-499e-8962-7b22479c1e9a.deleted is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:28:30.121895 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b1772a2f-0a7e-4c5d-be1e-9d76c3542c5f tempest-VolumesCloneTest-843094097 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:28:30.122362 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b1772a2f-0a7e-4c5d-be1e-9d76c3542c5f tempest-VolumesCloneTest-843094097 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:28:30.940982 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b1772a2f-0a7e-4c5d-be1e-9d76c3542c5f tempest-VolumesCloneTest-843094097 None] clone created successfully {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 25 21:28:30.941618 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.volume_utils [None req-b1772a2f-0a7e-4c5d-be1e-9d76c3542c5f tempest-VolumesCloneTest-843094097 None] Marking volume 4aebfc13-7c5d-4bfd-ab8f-3812fd99e521 as bootable. {{(pid=129926) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 25 21:28:30.950994 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-711987a8-b594-4c4e-a154-d936e7c2ec64 tempest-TaggedBootDevicesTest-292780470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:28:30.955181 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-711987a8-b594-4c4e-a154-d936e7c2ec64 tempest-TaggedBootDevicesTest-292780470 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:28:30.955660 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-711987a8-b594-4c4e-a154-d936e7c2ec64 tempest-TaggedBootDevicesTest-292780470 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:28:30.968305 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-711987a8-b594-4c4e-a154-d936e7c2ec64 tempest-TaggedBootDevicesTest-292780470 None] Flow 'volume_create_manager' (1ee3e78f-44b5-468c-906b-50b80f283a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:28:30.971571 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-711987a8-b594-4c4e-a154-d936e7c2ec64 tempest-TaggedBootDevicesTest-292780470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ca8a766-a860-4316-b065-c895b01e6176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:30.978166 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-711987a8-b594-4c4e-a154-d936e7c2ec64 tempest-TaggedBootDevicesTest-292780470 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:28:30.991550 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-711987a8-b594-4c4e-a154-d936e7c2ec64 tempest-TaggedBootDevicesTest-292780470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ca8a766-a860-4316-b065-c895b01e6176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-974109869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e7976291-a452-4d2e-b90b-b00735370896,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='980165331b334d7795b91adc96459725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:28:24Z,use_quota=True,user_id='0d9b0c5962544b66b24db53b7e9b8333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:30.994413 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-711987a8-b594-4c4e-a154-d936e7c2ec64 tempest-TaggedBootDevicesTest-292780470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f18990d3-2c78-4abc-98df-126c8a320f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:30.996503 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-711987a8-b594-4c4e-a154-d936e7c2ec64 tempest-TaggedBootDevicesTest-292780470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f18990d3-2c78-4abc-98df-126c8a320f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:30.999062 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-711987a8-b594-4c4e-a154-d936e7c2ec64 tempest-TaggedBootDevicesTest-292780470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62e38844-1384-4d03-aadb-74b89fef391d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:31.001306 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-711987a8-b594-4c4e-a154-d936e7c2ec64 tempest-TaggedBootDevicesTest-292780470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62e38844-1384-4d03-aadb-74b89fef391d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7976291-a452-4d2e-b90b-b00735370896', 'volume_name': 'volume-e7976291-a452-4d2e-b90b-b00735370896', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:31.003621 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-711987a8-b594-4c4e-a154-d936e7c2ec64 tempest-TaggedBootDevicesTest-292780470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aa1319f-9fb3-49be-85be-fda9bc45a476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:31.005886 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-711987a8-b594-4c4e-a154-d936e7c2ec64 tempest-TaggedBootDevicesTest-292780470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aa1319f-9fb3-49be-85be-fda9bc45a476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:31.008249 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-711987a8-b594-4c4e-a154-d936e7c2ec64 tempest-TaggedBootDevicesTest-292780470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8aadaf6-9600-4bcd-87a6-bcc0a2dfc46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:31.009239 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-711987a8-b594-4c4e-a154-d936e7c2ec64 tempest-TaggedBootDevicesTest-292780470 None] Volume e7976291-a452-4d2e-b90b-b00735370896: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7976291-a452-4d2e-b90b-b00735370896', 'volume_size': 1} Dec 25 21:28:31.009776 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-711987a8-b594-4c4e-a154-d936e7c2ec64 tempest-TaggedBootDevicesTest-292780470 None] creating volume 'volume-e7976291-a452-4d2e-b90b-b00735370896' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:28:31.010891 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-711987a8-b594-4c4e-a154-d936e7c2ec64 tempest-TaggedBootDevicesTest-292780470 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:28:31.046794 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1772a2f-0a7e-4c5d-be1e-9d76c3542c5f tempest-VolumesCloneTest-843094097 None] Copying metadata from source volume 8e11017c-7649-4b11-8607-8f99ddd48c83 to 4aebfc13-7c5d-4bfd-ab8f-3812fd99e521. {{(pid=129926) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:431}} Dec 25 21:28:31.152170 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b1772a2f-0a7e-4c5d-be1e-9d76c3542c5f tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17e7e59c-1e50-4a10-97e5-fdd3e4bc3b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4aebfc13-7c5d-4bfd-ab8f-3812fd99e521', 'volume_size': 1, 'source_volid': '8e11017c-7649-4b11-8607-8f99ddd48c83', 'source_volstatus': 'available'}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:31.155353 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b1772a2f-0a7e-4c5d-be1e-9d76c3542c5f tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d3d2c08-2c5b-4a30-9a82-b7778950a1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:31.290767 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-b1772a2f-0a7e-4c5d-be1e-9d76c3542c5f tempest-VolumesCloneTest-843094097 None] Volume volume-4aebfc13-7c5d-4bfd-ab8f-3812fd99e521 (4aebfc13-7c5d-4bfd-ab8f-3812fd99e521): created successfully Dec 25 21:28:31.293088 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b1772a2f-0a7e-4c5d-be1e-9d76c3542c5f tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d3d2c08-2c5b-4a30-9a82-b7778950a1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:31.296103 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b1772a2f-0a7e-4c5d-be1e-9d76c3542c5f tempest-VolumesCloneTest-843094097 None] Flow 'volume_create_manager' (df56161b-a254-4c90-ba93-6b63e097e268) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:28:31.399742 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-b1772a2f-0a7e-4c5d-be1e-9d76c3542c5f tempest-VolumesCloneTest-843094097 None] Created volume successfully. Dec 25 21:28:32.414403 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-711987a8-b594-4c4e-a154-d936e7c2ec64 tempest-TaggedBootDevicesTest-292780470 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:28:32.421835 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-711987a8-b594-4c4e-a154-d936e7c2ec64 tempest-TaggedBootDevicesTest-292780470 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:28:32.421835 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-711987a8-b594-4c4e-a154-d936e7c2ec64 tempest-TaggedBootDevicesTest-292780470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8aadaf6-9600-4bcd-87a6-bcc0a2dfc46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7976291-a452-4d2e-b90b-b00735370896', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:32.421835 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-711987a8-b594-4c4e-a154-d936e7c2ec64 tempest-TaggedBootDevicesTest-292780470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d55182ff-66b1-4698-b33d-4d8c750f9811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:32.435953 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-8478d76a-3a40-42ad-a9ea-e6d3734b468f tempest-GroupsV314Test-641327080 None] Volume volume-692b5026-7577-41a7-aa69-91d6f8ebac8a is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:28:32.449874 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-8478d76a-3a40-42ad-a9ea-e6d3734b468f tempest-GroupsV314Test-641327080 None] extra_specs: {} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:28:32.456359 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-8478d76a-3a40-42ad-a9ea-e6d3734b468f tempest-GroupsV314Test-641327080 None] extra_specs: {} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:28:33.214411 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-8478d76a-3a40-42ad-a9ea-e6d3734b468f tempest-GroupsV314Test-641327080 None] clone created successfully {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 25 21:28:33.234774 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-711987a8-b594-4c4e-a154-d936e7c2ec64 tempest-TaggedBootDevicesTest-292780470 None] Volume volume-e7976291-a452-4d2e-b90b-b00735370896 (e7976291-a452-4d2e-b90b-b00735370896): created successfully Dec 25 21:28:33.236826 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-711987a8-b594-4c4e-a154-d936e7c2ec64 tempest-TaggedBootDevicesTest-292780470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d55182ff-66b1-4698-b33d-4d8c750f9811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:33.239814 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-711987a8-b594-4c4e-a154-d936e7c2ec64 tempest-TaggedBootDevicesTest-292780470 None] Flow 'volume_create_manager' (1ee3e78f-44b5-468c-906b-50b80f283a73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:28:33.389180 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-711987a8-b594-4c4e-a154-d936e7c2ec64 tempest-TaggedBootDevicesTest-292780470 None] Created volume successfully. Dec 25 21:28:33.488978 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-0feb6ac3-ed46-4fcc-bc3b-653d98bc95ee tempest-VolumesCloneTest-843094097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:28:33.497011 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-0feb6ac3-ed46-4fcc-bc3b-653d98bc95ee tempest-VolumesCloneTest-843094097 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:28:33.497466 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-0feb6ac3-ed46-4fcc-bc3b-653d98bc95ee tempest-VolumesCloneTest-843094097 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:28:33.527825 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0feb6ac3-ed46-4fcc-bc3b-653d98bc95ee tempest-VolumesCloneTest-843094097 None] Flow 'volume_create_manager' (a094b422-fc28-4110-bb3d-afa85053cab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:28:33.536105 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0feb6ac3-ed46-4fcc-bc3b-653d98bc95ee tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f9fefa3-3f46-456b-be6f-070484c1e625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:33.552736 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-0feb6ac3-ed46-4fcc-bc3b-653d98bc95ee tempest-VolumesCloneTest-843094097 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:28:33.579516 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0feb6ac3-ed46-4fcc-bc3b-653d98bc95ee tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f9fefa3-3f46-456b-be6f-070484c1e625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-215775944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=28588cfc-c902-47ec-a542-1e57bbcf9098,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d33281b0c4c402eacd641a45e81edd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:28:33Z,use_quota=True,user_id='ebf61af4a7d6490ca760c131cfa5cf8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:33.582855 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0feb6ac3-ed46-4fcc-bc3b-653d98bc95ee tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6448734c-6d8a-4ccc-8de4-97a3e0917ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:33.586090 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0feb6ac3-ed46-4fcc-bc3b-653d98bc95ee tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6448734c-6d8a-4ccc-8de4-97a3e0917ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:33.589160 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0feb6ac3-ed46-4fcc-bc3b-653d98bc95ee tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34e3f00d-85cd-460f-9f07-ccbce18d494f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:33.591526 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0feb6ac3-ed46-4fcc-bc3b-653d98bc95ee tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34e3f00d-85cd-460f-9f07-ccbce18d494f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28588cfc-c902-47ec-a542-1e57bbcf9098', 'volume_name': 'volume-28588cfc-c902-47ec-a542-1e57bbcf9098', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:33.594148 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0feb6ac3-ed46-4fcc-bc3b-653d98bc95ee tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fafae49-301d-46ae-b4e5-8fa31acb0a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:33.596279 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0feb6ac3-ed46-4fcc-bc3b-653d98bc95ee tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fafae49-301d-46ae-b4e5-8fa31acb0a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:33.598572 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0feb6ac3-ed46-4fcc-bc3b-653d98bc95ee tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38f4f1b7-8988-4cf9-a7fe-dc1126c3f985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:33.600071 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-0feb6ac3-ed46-4fcc-bc3b-653d98bc95ee tempest-VolumesCloneTest-843094097 None] Volume 28588cfc-c902-47ec-a542-1e57bbcf9098: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28588cfc-c902-47ec-a542-1e57bbcf9098', 'volume_size': 1} Dec 25 21:28:33.603711 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0feb6ac3-ed46-4fcc-bc3b-653d98bc95ee tempest-VolumesCloneTest-843094097 None] creating volume 'volume-28588cfc-c902-47ec-a542-1e57bbcf9098' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:28:33.603711 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0feb6ac3-ed46-4fcc-bc3b-653d98bc95ee tempest-VolumesCloneTest-843094097 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:28:33.754388 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-8478d76a-3a40-42ad-a9ea-e6d3734b468f tempest-GroupsV314Test-641327080 None] Create group from source-group-6e290c68-844b-4bd2-98e4-0474acdc81d8 completed successfully. Dec 25 21:28:34.440444 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-5193ad2e-7cad-4b93-bc70-f17ad7696a9d tempest-TaggedBootDevicesTest-292780470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:28:34.444219 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-5193ad2e-7cad-4b93-bc70-f17ad7696a9d tempest-TaggedBootDevicesTest-292780470 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:28:34.445073 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-5193ad2e-7cad-4b93-bc70-f17ad7696a9d tempest-TaggedBootDevicesTest-292780470 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:28:34.457815 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5193ad2e-7cad-4b93-bc70-f17ad7696a9d tempest-TaggedBootDevicesTest-292780470 None] Flow 'volume_create_manager' (7d044359-d2b5-40e5-b8fe-3094b66e7b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:28:34.461050 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5193ad2e-7cad-4b93-bc70-f17ad7696a9d tempest-TaggedBootDevicesTest-292780470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8360de6-ea31-49d4-ba88-015c7c50d9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:34.471964 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-5193ad2e-7cad-4b93-bc70-f17ad7696a9d tempest-TaggedBootDevicesTest-292780470 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:28:34.504812 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5193ad2e-7cad-4b93-bc70-f17ad7696a9d tempest-TaggedBootDevicesTest-292780470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8360de6-ea31-49d4-ba88-015c7c50d9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1815582803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=84d8c368-fc65-4b1d-bfa0-8dcd9af9fee2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='980165331b334d7795b91adc96459725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:28:34Z,use_quota=True,user_id='0d9b0c5962544b66b24db53b7e9b8333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:34.508184 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5193ad2e-7cad-4b93-bc70-f17ad7696a9d tempest-TaggedBootDevicesTest-292780470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06662c4a-3fc6-4c54-8aae-44abe5af6050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:34.510608 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5193ad2e-7cad-4b93-bc70-f17ad7696a9d tempest-TaggedBootDevicesTest-292780470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06662c4a-3fc6-4c54-8aae-44abe5af6050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:34.514018 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5193ad2e-7cad-4b93-bc70-f17ad7696a9d tempest-TaggedBootDevicesTest-292780470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18d681d0-520a-4325-a57b-0838697e0349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:34.516469 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5193ad2e-7cad-4b93-bc70-f17ad7696a9d tempest-TaggedBootDevicesTest-292780470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18d681d0-520a-4325-a57b-0838697e0349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84d8c368-fc65-4b1d-bfa0-8dcd9af9fee2', 'volume_name': 'volume-84d8c368-fc65-4b1d-bfa0-8dcd9af9fee2', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:34.519440 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5193ad2e-7cad-4b93-bc70-f17ad7696a9d tempest-TaggedBootDevicesTest-292780470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (122b72fc-5cbe-49d0-aa3b-279d8bc2167a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:34.521884 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5193ad2e-7cad-4b93-bc70-f17ad7696a9d tempest-TaggedBootDevicesTest-292780470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (122b72fc-5cbe-49d0-aa3b-279d8bc2167a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:34.524508 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5193ad2e-7cad-4b93-bc70-f17ad7696a9d tempest-TaggedBootDevicesTest-292780470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79f2886b-275c-4577-8919-462d00d0a6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:34.525650 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-5193ad2e-7cad-4b93-bc70-f17ad7696a9d tempest-TaggedBootDevicesTest-292780470 None] Volume 84d8c368-fc65-4b1d-bfa0-8dcd9af9fee2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84d8c368-fc65-4b1d-bfa0-8dcd9af9fee2', 'volume_size': 1} Dec 25 21:28:34.526197 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-5193ad2e-7cad-4b93-bc70-f17ad7696a9d tempest-TaggedBootDevicesTest-292780470 None] creating volume 'volume-84d8c368-fc65-4b1d-bfa0-8dcd9af9fee2' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:28:34.528203 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-5193ad2e-7cad-4b93-bc70-f17ad7696a9d tempest-TaggedBootDevicesTest-292780470 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:28:34.598662 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-dbcc56f9-5a0f-492b-bca8-95341310ef6b tempest-GroupsV314Test-641327080 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:28:35.089871 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-dbcc56f9-5a0f-492b-bca8-95341310ef6b tempest-GroupsV314Test-641327080 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:28:35.340308 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-dbcc56f9-5a0f-492b-bca8-95341310ef6b tempest-GroupsV314Test-641327080 None] deleting rbd volume volume-704ead87-ef4a-49a9-b1ee-dfab4b99a4f4 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:28:35.352744 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0feb6ac3-ed46-4fcc-bc3b-653d98bc95ee tempest-VolumesCloneTest-843094097 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:28:35.353732 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0feb6ac3-ed46-4fcc-bc3b-653d98bc95ee tempest-VolumesCloneTest-843094097 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:28:35.357390 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0feb6ac3-ed46-4fcc-bc3b-653d98bc95ee tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38f4f1b7-8988-4cf9-a7fe-dc1126c3f985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28588cfc-c902-47ec-a542-1e57bbcf9098', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:35.360277 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0feb6ac3-ed46-4fcc-bc3b-653d98bc95ee tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d3ff162-6c5c-4702-a72a-60b8296d1d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:35.436727 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-0feb6ac3-ed46-4fcc-bc3b-653d98bc95ee tempest-VolumesCloneTest-843094097 None] Volume volume-28588cfc-c902-47ec-a542-1e57bbcf9098 (28588cfc-c902-47ec-a542-1e57bbcf9098): created successfully Dec 25 21:28:35.441653 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0feb6ac3-ed46-4fcc-bc3b-653d98bc95ee tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d3ff162-6c5c-4702-a72a-60b8296d1d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:35.442932 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0feb6ac3-ed46-4fcc-bc3b-653d98bc95ee tempest-VolumesCloneTest-843094097 None] Flow 'volume_create_manager' (a094b422-fc28-4110-bb3d-afa85053cab0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:28:35.449361 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-5193ad2e-7cad-4b93-bc70-f17ad7696a9d tempest-TaggedBootDevicesTest-292780470 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:28:35.450012 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-5193ad2e-7cad-4b93-bc70-f17ad7696a9d tempest-TaggedBootDevicesTest-292780470 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:28:35.452201 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5193ad2e-7cad-4b93-bc70-f17ad7696a9d tempest-TaggedBootDevicesTest-292780470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79f2886b-275c-4577-8919-462d00d0a6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84d8c368-fc65-4b1d-bfa0-8dcd9af9fee2', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:35.454514 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5193ad2e-7cad-4b93-bc70-f17ad7696a9d tempest-TaggedBootDevicesTest-292780470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4ed2705-0c80-4728-b295-bb9dc6c01384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:35.524649 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-5193ad2e-7cad-4b93-bc70-f17ad7696a9d tempest-TaggedBootDevicesTest-292780470 None] Volume volume-84d8c368-fc65-4b1d-bfa0-8dcd9af9fee2 (84d8c368-fc65-4b1d-bfa0-8dcd9af9fee2): created successfully Dec 25 21:28:35.527959 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5193ad2e-7cad-4b93-bc70-f17ad7696a9d tempest-TaggedBootDevicesTest-292780470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4ed2705-0c80-4728-b295-bb9dc6c01384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:35.529999 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5193ad2e-7cad-4b93-bc70-f17ad7696a9d tempest-TaggedBootDevicesTest-292780470 None] Flow 'volume_create_manager' (7d044359-d2b5-40e5-b8fe-3094b66e7b9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:28:35.535764 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-0feb6ac3-ed46-4fcc-bc3b-653d98bc95ee tempest-VolumesCloneTest-843094097 None] Created volume successfully. Dec 25 21:28:35.607542 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-5193ad2e-7cad-4b93-bc70-f17ad7696a9d tempest-TaggedBootDevicesTest-292780470 None] Created volume successfully. Dec 25 21:28:36.093978 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-2c823181-c17a-454f-b03b-9adb9cbd3949 tempest-BackendsCapabilitiesAdminTestsJSON-783464744 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:87776a25-e9df-4e62-b76f-cf87ba918901:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=129926) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4733}} Dec 25 21:28:36.130338 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-00cd79d8-ac9c-41c0-8354-bdae09756493 tempest-BackendsCapabilitiesAdminTestsJSON-783464744 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:87776a25-e9df-4e62-b76f-cf87ba918901:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=129926) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4733}} Dec 25 21:28:36.830871 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-119a37c7-a8e9-4ab7-8143-78407745a82d tempest-VolumesCloneTest-843094097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:28:36.836451 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-119a37c7-a8e9-4ab7-8143-78407745a82d tempest-VolumesCloneTest-843094097 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:28:36.837842 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-119a37c7-a8e9-4ab7-8143-78407745a82d tempest-VolumesCloneTest-843094097 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:28:36.889399 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-119a37c7-a8e9-4ab7-8143-78407745a82d tempest-VolumesCloneTest-843094097 None] Flow 'volume_create_manager' (578c0db2-c1ec-4965-a5e5-0ebc41130d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:28:36.896685 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-119a37c7-a8e9-4ab7-8143-78407745a82d tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8999d6bf-3af8-42cc-b9cf-febb24c0c035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:36.909176 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-119a37c7-a8e9-4ab7-8143-78407745a82d tempest-VolumesCloneTest-843094097 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:28:36.936389 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-119a37c7-a8e9-4ab7-8143-78407745a82d tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8999d6bf-3af8-42cc-b9cf-febb24c0c035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-251289108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8fe7b755-b7d9-4adf-8eca-42efb756a97f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d33281b0c4c402eacd641a45e81edd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:28:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=28588cfc-c902-47ec-a542-1e57bbcf9098,status='creating',terminated_at=None,updated_at=2021-12-25T21:28:37Z,use_quota=True,user_id='ebf61af4a7d6490ca760c131cfa5cf8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:36.942645 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-119a37c7-a8e9-4ab7-8143-78407745a82d tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad663911-d8ff-46d3-af93-ae10171e6fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:36.952988 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-119a37c7-a8e9-4ab7-8143-78407745a82d tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad663911-d8ff-46d3-af93-ae10171e6fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:36.955409 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-119a37c7-a8e9-4ab7-8143-78407745a82d tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5105d02-fa5d-4bad-91a3-78fd12684c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:36.994131 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-119a37c7-a8e9-4ab7-8143-78407745a82d tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5105d02-fa5d-4bad-91a3-78fd12684c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8fe7b755-b7d9-4adf-8eca-42efb756a97f', 'volume_name': 'volume-8fe7b755-b7d9-4adf-8eca-42efb756a97f', 'volume_size': 2, 'source_volid': '28588cfc-c902-47ec-a542-1e57bbcf9098', 'source_volstatus': 'available'}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:37.000028 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-119a37c7-a8e9-4ab7-8143-78407745a82d tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b2be31-8d08-4344-a24b-af800c778cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:37.002954 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-119a37c7-a8e9-4ab7-8143-78407745a82d tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b2be31-8d08-4344-a24b-af800c778cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:37.010034 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-119a37c7-a8e9-4ab7-8143-78407745a82d tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52106956-2b6c-4519-84d2-19b2fb540085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:37.012275 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-119a37c7-a8e9-4ab7-8143-78407745a82d tempest-VolumesCloneTest-843094097 None] Volume 8fe7b755-b7d9-4adf-8eca-42efb756a97f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8fe7b755-b7d9-4adf-8eca-42efb756a97f', 'volume_size': 2, 'source_volid': '28588cfc-c902-47ec-a542-1e57bbcf9098', 'source_volstatus': 'available'} Dec 25 21:28:37.030294 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-119a37c7-a8e9-4ab7-8143-78407745a82d tempest-VolumesCloneTest-843094097 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:28:37.320537 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-119a37c7-a8e9-4ab7-8143-78407745a82d tempest-VolumesCloneTest-843094097 None] creating snapshot='volume-8fe7b755-b7d9-4adf-8eca-42efb756a97f.clone_snap' {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 25 21:28:39.815495 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-119a37c7-a8e9-4ab7-8143-78407745a82d tempest-VolumesCloneTest-843094097 None] cloning 'volume-28588cfc-c902-47ec-a542-1e57bbcf9098@volume-8fe7b755-b7d9-4adf-8eca-42efb756a97f.clone_snap' to 'volume-8fe7b755-b7d9-4adf-8eca-42efb756a97f' {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 25 21:28:41.958935 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-119a37c7-a8e9-4ab7-8143-78407745a82d tempest-VolumesCloneTest-843094097 None] Volume volume-28588cfc-c902-47ec-a542-1e57bbcf9098 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:28:41.960229 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-119a37c7-a8e9-4ab7-8143-78407745a82d tempest-VolumesCloneTest-843094097 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:28:41.960801 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-119a37c7-a8e9-4ab7-8143-78407745a82d tempest-VolumesCloneTest-843094097 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:28:42.702696 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-119a37c7-a8e9-4ab7-8143-78407745a82d tempest-VolumesCloneTest-843094097 None] resize volume 'volume-8fe7b755-b7d9-4adf-8eca-42efb756a97f' from 1 to 2 {{(pid=129926) _extend_if_required /opt/stack/cinder/cinder/volume/drivers/rbd.py:694}} Dec 25 21:28:42.702696 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-119a37c7-a8e9-4ab7-8143-78407745a82d tempest-VolumesCloneTest-843094097 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:28:43.321025 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-dbcc56f9-5a0f-492b-bca8-95341310ef6b tempest-GroupsV314Test-641327080 None] volume is a clone so cleaning references {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 25 21:28:43.559289 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-dbcc56f9-5a0f-492b-bca8-95341310ef6b tempest-GroupsV314Test-641327080 None] Volume volume-692b5026-7577-41a7-aa69-91d6f8ebac8a is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:28:43.565215 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-dbcc56f9-5a0f-492b-bca8-95341310ef6b tempest-GroupsV314Test-641327080 None] deleting parent snapshot volume-704ead87-ef4a-49a9-b1ee-dfab4b99a4f4.clone_snap {{(pid=129926) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 25 21:28:47.647766 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-dbcc56f9-5a0f-492b-bca8-95341310ef6b tempest-GroupsV314Test-641327080 None] Created reservations ['b6dda7a4-dc2f-47d2-83a8-3fa81d58325b'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:28:47.682986 ncdv-master-1 cinder-volume[129926]: WARNING cinder.quota [None req-dbcc56f9-5a0f-492b-bca8-95341310ef6b tempest-GroupsV314Test-641327080 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-884316301 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-884316301, it is now deprecated. Please use the default quota class for default quota. Dec 25 21:28:47.683944 ncdv-master-1 cinder-volume[129926]: WARNING cinder.quota [None req-dbcc56f9-5a0f-492b-bca8-95341310ef6b tempest-GroupsV314Test-641327080 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-884316301 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-884316301, it is now deprecated. Please use the default quota class for default quota. Dec 25 21:28:47.790154 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-dbcc56f9-5a0f-492b-bca8-95341310ef6b tempest-GroupsV314Test-641327080 None] Created reservations ['15917fb5-8652-4fcc-bb00-670ebcfe34ea', 'f7fbec85-3465-4c12-81af-64041e58dfc9', 'd31eae31-b2b1-42bf-a8e1-ce77481bc8f0', '1da5954f-38a0-4d3d-a920-4ab5576e4f31'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:28:48.087370 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-119a37c7-a8e9-4ab7-8143-78407745a82d tempest-VolumesCloneTest-843094097 None] clone created successfully {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 25 21:28:48.087370 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-119a37c7-a8e9-4ab7-8143-78407745a82d tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52106956-2b6c-4519-84d2-19b2fb540085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fe7b755-b7d9-4adf-8eca-42efb756a97f', 'volume_size': 2, 'source_volid': '28588cfc-c902-47ec-a542-1e57bbcf9098', 'source_volstatus': 'available'}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:48.089899 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-119a37c7-a8e9-4ab7-8143-78407745a82d tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebb994c7-72af-4d79-9175-2d3a52c655d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:48.185368 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-dbcc56f9-5a0f-492b-bca8-95341310ef6b tempest-GroupsV314Test-641327080 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:28:48.289545 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-dbcc56f9-5a0f-492b-bca8-95341310ef6b tempest-GroupsV314Test-641327080 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:28:48.347552 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-dbcc56f9-5a0f-492b-bca8-95341310ef6b tempest-GroupsV314Test-641327080 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:28:48.351836 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-119a37c7-a8e9-4ab7-8143-78407745a82d tempest-VolumesCloneTest-843094097 None] Volume volume-8fe7b755-b7d9-4adf-8eca-42efb756a97f (8fe7b755-b7d9-4adf-8eca-42efb756a97f): created successfully Dec 25 21:28:48.355655 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-119a37c7-a8e9-4ab7-8143-78407745a82d tempest-VolumesCloneTest-843094097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebb994c7-72af-4d79-9175-2d3a52c655d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:48.361601 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-119a37c7-a8e9-4ab7-8143-78407745a82d tempest-VolumesCloneTest-843094097 None] Flow 'volume_create_manager' (578c0db2-c1ec-4965-a5e5-0ebc41130d43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:28:48.369652 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-dbcc56f9-5a0f-492b-bca8-95341310ef6b tempest-GroupsV314Test-641327080 None] Delete group completed successfully. Dec 25 21:28:48.458600 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-119a37c7-a8e9-4ab7-8143-78407745a82d tempest-VolumesCloneTest-843094097 None] Created volume successfully. Dec 25 21:28:48.829955 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-00ebc39a-cb17-4a31-858f-f03bf778ebd4 tempest-VolumesCloneTest-843094097 None] Lock "b'cinder-8fe7b755-b7d9-4adf-8eca-42efb756a97f-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:28:48.993288 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-00ebc39a-cb17-4a31-858f-f03bf778ebd4 tempest-VolumesCloneTest-843094097 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:28:49.329017 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-00ebc39a-cb17-4a31-858f-f03bf778ebd4 tempest-VolumesCloneTest-843094097 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:28:49.656800 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-00ebc39a-cb17-4a31-858f-f03bf778ebd4 tempest-VolumesCloneTest-843094097 None] deleting rbd volume volume-8fe7b755-b7d9-4adf-8eca-42efb756a97f {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:28:49.723130 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-008155b1-e5b1-4ef6-bf42-53343f71cb90 tempest-GroupsV314Test-641327080 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:28:49.946386 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-008155b1-e5b1-4ef6-bf42-53343f71cb90 tempest-GroupsV314Test-641327080 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:28:49.946940 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-008155b1-e5b1-4ef6-bf42-53343f71cb90 tempest-GroupsV314Test-641327080 None] Volume volume-692b5026-7577-41a7-aa69-91d6f8ebac8a is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:28:50.221917 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-008155b1-e5b1-4ef6-bf42-53343f71cb90 tempest-GroupsV314Test-641327080 None] deleting rbd volume volume-692b5026-7577-41a7-aa69-91d6f8ebac8a {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:28:50.239615 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-5a4bb210-f475-4cb8-beb4-a21c32391c32 tempest-GroupsTest-732789418 None] Group tempest-Group1-1243242775: creating Dec 25 21:28:50.307359 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-5a4bb210-f475-4cb8-beb4-a21c32391c32 tempest-GroupsTest-732789418 None] Group tempest-Group1-1243242775: created successfully Dec 25 21:28:50.316840 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-5a4bb210-f475-4cb8-beb4-a21c32391c32 tempest-GroupsTest-732789418 None] Create group completed successfully. Dec 25 21:28:51.343296 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-60280169-f97a-4a5a-9771-62e057834436 tempest-GroupsTest-732789418 None] Group tempest-Group2-1884096193: creating Dec 25 21:28:51.500114 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-60280169-f97a-4a5a-9771-62e057834436 tempest-GroupsTest-732789418 None] Group tempest-Group2-1884096193: created successfully Dec 25 21:28:51.508079 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-60280169-f97a-4a5a-9771-62e057834436 tempest-GroupsTest-732789418 None] Create group completed successfully. Dec 25 21:28:53.557956 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5aa4669-50cd-4611-855e-a8fb90dc08e1 tempest-GroupsTest-732789418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:28:53.561956 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-e5aa4669-50cd-4611-855e-a8fb90dc08e1 tempest-GroupsTest-732789418 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:28:53.564240 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-e5aa4669-50cd-4611-855e-a8fb90dc08e1 tempest-GroupsTest-732789418 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:28:53.579575 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e5aa4669-50cd-4611-855e-a8fb90dc08e1 tempest-GroupsTest-732789418 None] Flow 'volume_create_manager' (10901035-4e55-4536-a4cc-3ffbe5d4c295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:28:53.583781 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e5aa4669-50cd-4611-855e-a8fb90dc08e1 tempest-GroupsTest-732789418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b24ce43-9ebe-43df-961e-74b64724a97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:53.592000 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-e5aa4669-50cd-4611-855e-a8fb90dc08e1 tempest-GroupsTest-732789418 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:28:53.607240 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e5aa4669-50cd-4611-855e-a8fb90dc08e1 tempest-GroupsTest-732789418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b24ce43-9ebe-43df-961e-74b64724a97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-317138526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1ad6d925-f8e5-4931-82a7-7db7e8471091,host='ncdv-master-1@ceph#ceph',id=813e670c-b87c-4c7a-97a7-544d8eae8510,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8575c4332583463384501df8336e3599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:28:53Z,use_quota=True,user_id='359a08e577f445c3bc3a843845b9ec0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54c786ae-bfe8-40bd-8cd5-4d131de0c926),volume_type_id=54c786ae-bfe8-40bd-8cd5-4d131de0c926)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:53.610865 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e5aa4669-50cd-4611-855e-a8fb90dc08e1 tempest-GroupsTest-732789418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (798afd09-61e5-428b-9631-d47450315fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:53.613415 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e5aa4669-50cd-4611-855e-a8fb90dc08e1 tempest-GroupsTest-732789418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (798afd09-61e5-428b-9631-d47450315fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:53.616606 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e5aa4669-50cd-4611-855e-a8fb90dc08e1 tempest-GroupsTest-732789418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (690803b7-756a-4d52-ab57-4037554aa926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:53.622420 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e5aa4669-50cd-4611-855e-a8fb90dc08e1 tempest-GroupsTest-732789418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (690803b7-756a-4d52-ab57-4037554aa926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '813e670c-b87c-4c7a-97a7-544d8eae8510', 'volume_name': 'volume-813e670c-b87c-4c7a-97a7-544d8eae8510', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:53.623041 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e5aa4669-50cd-4611-855e-a8fb90dc08e1 tempest-GroupsTest-732789418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8e0a12c-3297-4dbe-9bec-45fff80e56d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:53.625713 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e5aa4669-50cd-4611-855e-a8fb90dc08e1 tempest-GroupsTest-732789418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8e0a12c-3297-4dbe-9bec-45fff80e56d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:53.628325 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e5aa4669-50cd-4611-855e-a8fb90dc08e1 tempest-GroupsTest-732789418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3274e16-9f98-4cc1-a794-9fe492aed1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:53.629988 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-e5aa4669-50cd-4611-855e-a8fb90dc08e1 tempest-GroupsTest-732789418 None] Volume 813e670c-b87c-4c7a-97a7-544d8eae8510: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-813e670c-b87c-4c7a-97a7-544d8eae8510', 'volume_size': 1} Dec 25 21:28:53.630602 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e5aa4669-50cd-4611-855e-a8fb90dc08e1 tempest-GroupsTest-732789418 None] creating volume 'volume-813e670c-b87c-4c7a-97a7-544d8eae8510' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:28:53.631725 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e5aa4669-50cd-4611-855e-a8fb90dc08e1 tempest-GroupsTest-732789418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:28:54.501885 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e5aa4669-50cd-4611-855e-a8fb90dc08e1 tempest-GroupsTest-732789418 None] extra_specs: {} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:28:54.502418 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e5aa4669-50cd-4611-855e-a8fb90dc08e1 tempest-GroupsTest-732789418 None] extra_specs: {} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:28:54.505419 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e5aa4669-50cd-4611-855e-a8fb90dc08e1 tempest-GroupsTest-732789418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3274e16-9f98-4cc1-a794-9fe492aed1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-813e670c-b87c-4c7a-97a7-544d8eae8510', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:54.508722 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e5aa4669-50cd-4611-855e-a8fb90dc08e1 tempest-GroupsTest-732789418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (766e969e-fcad-4e6a-b967-650abb9ee11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:28:54.581336 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-e5aa4669-50cd-4611-855e-a8fb90dc08e1 tempest-GroupsTest-732789418 None] Volume volume-813e670c-b87c-4c7a-97a7-544d8eae8510 (813e670c-b87c-4c7a-97a7-544d8eae8510): created successfully Dec 25 21:28:54.584795 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e5aa4669-50cd-4611-855e-a8fb90dc08e1 tempest-GroupsTest-732789418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (766e969e-fcad-4e6a-b967-650abb9ee11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:28:54.590393 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e5aa4669-50cd-4611-855e-a8fb90dc08e1 tempest-GroupsTest-732789418 None] Flow 'volume_create_manager' (10901035-4e55-4536-a4cc-3ffbe5d4c295) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:28:54.666500 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-e5aa4669-50cd-4611-855e-a8fb90dc08e1 tempest-GroupsTest-732789418 None] Created volume successfully. Dec 25 21:28:56.356376 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-2f9c9176-887b-438e-981d-d141e25e1a54 tempest-GroupsTest-732789418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:28:56.809470 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-2f9c9176-887b-438e-981d-d141e25e1a54 tempest-GroupsTest-732789418 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:28:56.809810 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-2f9c9176-887b-438e-981d-d141e25e1a54 tempest-GroupsTest-732789418 None] Volume volume-813e670c-b87c-4c7a-97a7-544d8eae8510 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:28:57.190592 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-2f9c9176-887b-438e-981d-d141e25e1a54 tempest-GroupsTest-732789418 None] deleting rbd volume volume-813e670c-b87c-4c7a-97a7-544d8eae8510 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:28:57.270769 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-fcf3f658-34ea-41d8-822d-0e301f82560e req-061251b6-18ef-41d5-afce-b9b8dc0a44e0 tempest-TaggedBootDevicesTest-292780470 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:28:58.058471 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-fcf3f658-34ea-41d8-822d-0e301f82560e req-061251b6-18ef-41d5-afce-b9b8dc0a44e0 tempest-TaggedBootDevicesTest-292780470 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.788s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:28:58.059300 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-fcf3f658-34ea-41d8-822d-0e301f82560e req-061251b6-18ef-41d5-afce-b9b8dc0a44e0 tempest-TaggedBootDevicesTest-292780470 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-6c571104-d681-49c0-b0ed-045a03bd3bba', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': '6c571104-d681-49c0-b0ed-045a03bd3bba', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 21:28:58.123877 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-fcf3f658-34ea-41d8-822d-0e301f82560e req-061251b6-18ef-41d5-afce-b9b8dc0a44e0 tempest-TaggedBootDevicesTest-292780470 None] Connection info returned from driver {'name': 'volumes/volume-6c571104-d681-49c0-b0ed-045a03bd3bba', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '6c571104-d681-49c0-b0ed-045a03bd3bba', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '49a7aaa3-7313-427a-8a09-f50e0d213090'} {{(pid=129926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 25 21:28:58.220755 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-fcf3f658-34ea-41d8-822d-0e301f82560e req-061251b6-18ef-41d5-afce-b9b8dc0a44e0 tempest-TaggedBootDevicesTest-292780470 None] attachment_update completed successfully. Dec 25 21:28:58.627131 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-00ebc39a-cb17-4a31-858f-f03bf778ebd4 tempest-VolumesCloneTest-843094097 None] volume is a clone so cleaning references {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 25 21:28:59.033154 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-00ebc39a-cb17-4a31-858f-f03bf778ebd4 tempest-VolumesCloneTest-843094097 None] Volume volume-28588cfc-c902-47ec-a542-1e57bbcf9098 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:28:59.034127 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-00ebc39a-cb17-4a31-858f-f03bf778ebd4 tempest-VolumesCloneTest-843094097 None] deleting parent snapshot volume-8fe7b755-b7d9-4adf-8eca-42efb756a97f.clone_snap {{(pid=129926) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 25 21:29:04.085750 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-fcf3f658-34ea-41d8-822d-0e301f82560e req-14aa83b7-54da-40e5-8714-25f447ec9142 tempest-TaggedBootDevicesTest-292780470 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:29:04.139175 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-00ebc39a-cb17-4a31-858f-f03bf778ebd4 tempest-VolumesCloneTest-843094097 None] Created reservations ['569ede8d-569d-45c2-8d72-b2287d50d950', '2d9501a8-97f5-497a-9159-ab11cbb68b7e', '10b85de3-0c7d-45ff-89fb-7ddcf00ffab8', '0c71524e-f98c-4685-92af-c5ed2de3f12c'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:29:04.354003 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-00ebc39a-cb17-4a31-858f-f03bf778ebd4 tempest-VolumesCloneTest-843094097 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:29:04.405327 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-00ebc39a-cb17-4a31-858f-f03bf778ebd4 tempest-VolumesCloneTest-843094097 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:29:04.475828 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-00ebc39a-cb17-4a31-858f-f03bf778ebd4 tempest-VolumesCloneTest-843094097 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:29:04.486890 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-00ebc39a-cb17-4a31-858f-f03bf778ebd4 tempest-VolumesCloneTest-843094097 None] Deleted volume successfully. Dec 25 21:29:04.592163 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-008155b1-e5b1-4ef6-bf42-53343f71cb90 tempest-GroupsV314Test-641327080 None] Created reservations ['fd9b29c0-d1b3-4731-858a-a8fe91d96965'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:29:04.614133 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-00ebc39a-cb17-4a31-858f-f03bf778ebd4 tempest-VolumesCloneTest-843094097 None] Lock "b'cinder-8fe7b755-b7d9-4adf-8eca-42efb756a97f-delete_volume'" released by "delete_volume" :: held 15.784s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:29:04.806548 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-008155b1-e5b1-4ef6-bf42-53343f71cb90 tempest-GroupsV314Test-641327080 None] Created reservations ['42ec7897-73a6-489e-a36c-fafd3e80da89', '3a0fa309-cbd4-454f-9240-8fc1f39f58c4', 'c64f51d1-9bc5-4091-a729-1c26401d20bb', '917bcc66-406f-4526-a0ed-ec7444aaff1e'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:29:05.191301 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-fcf3f658-34ea-41d8-822d-0e301f82560e req-14aa83b7-54da-40e5-8714-25f447ec9142 tempest-TaggedBootDevicesTest-292780470 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.106s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:29:05.192210 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-fcf3f658-34ea-41d8-822d-0e301f82560e req-14aa83b7-54da-40e5-8714-25f447ec9142 tempest-TaggedBootDevicesTest-292780470 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e7976291-a452-4d2e-b90b-b00735370896', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': 'e7976291-a452-4d2e-b90b-b00735370896', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 21:29:05.321354 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-fcf3f658-34ea-41d8-822d-0e301f82560e req-14aa83b7-54da-40e5-8714-25f447ec9142 tempest-TaggedBootDevicesTest-292780470 None] Connection info returned from driver {'name': 'volumes/volume-e7976291-a452-4d2e-b90b-b00735370896', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e7976291-a452-4d2e-b90b-b00735370896', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '5633c375-2d75-41fa-801c-c34a1daebe0c'} {{(pid=129926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 25 21:29:05.414331 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-008155b1-e5b1-4ef6-bf42-53343f71cb90 tempest-GroupsV314Test-641327080 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:29:05.488854 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-008155b1-e5b1-4ef6-bf42-53343f71cb90 tempest-GroupsV314Test-641327080 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:29:05.562089 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-008155b1-e5b1-4ef6-bf42-53343f71cb90 tempest-GroupsV314Test-641327080 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:29:05.567419 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-008155b1-e5b1-4ef6-bf42-53343f71cb90 tempest-GroupsV314Test-641327080 None] Delete group completed successfully. Dec 25 21:29:05.594402 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-66b097c1-4814-4fa8-bf08-0dbdc98972f0 tempest-VolumesCloneTest-843094097 None] Lock "b'cinder-28588cfc-c902-47ec-a542-1e57bbcf9098-delete_volume'" acquired by "delete_volume" :: waited 0.212s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:29:05.703850 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-fcf3f658-34ea-41d8-822d-0e301f82560e req-14aa83b7-54da-40e5-8714-25f447ec9142 tempest-TaggedBootDevicesTest-292780470 None] attachment_update completed successfully. Dec 25 21:29:05.734891 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-2f9c9176-887b-438e-981d-d141e25e1a54 tempest-GroupsTest-732789418 None] Created reservations ['2a835b65-f685-4b1b-b1e4-8c74b06e5655'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:29:05.773638 ncdv-master-1 cinder-volume[129926]: WARNING cinder.quota [None req-2f9c9176-887b-438e-981d-d141e25e1a54 tempest-GroupsTest-732789418 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1553094947 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1553094947, it is now deprecated. Please use the default quota class for default quota. Dec 25 21:29:05.777913 ncdv-master-1 cinder-volume[129926]: WARNING cinder.quota [None req-2f9c9176-887b-438e-981d-d141e25e1a54 tempest-GroupsTest-732789418 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1553094947 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1553094947, it is now deprecated. Please use the default quota class for default quota. Dec 25 21:29:05.820398 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-66b097c1-4814-4fa8-bf08-0dbdc98972f0 tempest-VolumesCloneTest-843094097 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:29:06.281328 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-66b097c1-4814-4fa8-bf08-0dbdc98972f0 tempest-VolumesCloneTest-843094097 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:29:06.281916 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-66b097c1-4814-4fa8-bf08-0dbdc98972f0 tempest-VolumesCloneTest-843094097 None] Volume volume-28588cfc-c902-47ec-a542-1e57bbcf9098 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:29:06.767721 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-66b097c1-4814-4fa8-bf08-0dbdc98972f0 tempest-VolumesCloneTest-843094097 None] deleting rbd volume volume-28588cfc-c902-47ec-a542-1e57bbcf9098 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:29:06.774619 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-2f9c9176-887b-438e-981d-d141e25e1a54 tempest-GroupsTest-732789418 None] Created reservations ['eb820ec3-8994-4e1f-aa8e-cdacec229aa7', 'b4d8e4d5-cc5b-4c29-a4ce-5794468201e8', 'e517aeec-f6af-4cb9-ab57-59d40f73f931', '3387588c-d5b0-44d2-9d6b-84b7220bb46d'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:29:07.301560 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-fcf3f658-34ea-41d8-822d-0e301f82560e req-696f0360-68f3-4827-82e0-71f2622edd68 tempest-TaggedBootDevicesTest-292780470 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:29:07.475527 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-2f9c9176-887b-438e-981d-d141e25e1a54 tempest-GroupsTest-732789418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:29:07.515847 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-2f9c9176-887b-438e-981d-d141e25e1a54 tempest-GroupsTest-732789418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:29:07.594324 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-2f9c9176-887b-438e-981d-d141e25e1a54 tempest-GroupsTest-732789418 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:29:07.598977 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-2f9c9176-887b-438e-981d-d141e25e1a54 tempest-GroupsTest-732789418 None] Delete group completed successfully. Dec 25 21:29:07.702318 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-f78950a3-1c61-482f-8850-e22c99b9cd9b tempest-AttachVolumeShelveTestJSON-1279821748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:29:07.706862 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-f78950a3-1c61-482f-8850-e22c99b9cd9b tempest-AttachVolumeShelveTestJSON-1279821748 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:29:07.707362 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-f78950a3-1c61-482f-8850-e22c99b9cd9b tempest-AttachVolumeShelveTestJSON-1279821748 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:29:07.729213 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f78950a3-1c61-482f-8850-e22c99b9cd9b tempest-AttachVolumeShelveTestJSON-1279821748 None] Flow 'volume_create_manager' (532c5daa-cef6-4af8-a456-4351af8f66fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:29:07.733304 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f78950a3-1c61-482f-8850-e22c99b9cd9b tempest-AttachVolumeShelveTestJSON-1279821748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99e5c593-10da-4ee9-bcfd-ec6db8486894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:29:07.739444 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-f78950a3-1c61-482f-8850-e22c99b9cd9b tempest-AttachVolumeShelveTestJSON-1279821748 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:29:07.752565 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f78950a3-1c61-482f-8850-e22c99b9cd9b tempest-AttachVolumeShelveTestJSON-1279821748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99e5c593-10da-4ee9-bcfd-ec6db8486894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-304568913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=06661aab-01cf-4a95-94d1-d80c006009d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0560c323ec8e41b3bc05939e12e049d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:29:07Z,use_quota=True,user_id='517838d2d4a942bfa8b332c767c60904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:29:07.758468 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f78950a3-1c61-482f-8850-e22c99b9cd9b tempest-AttachVolumeShelveTestJSON-1279821748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (536add27-3dd5-4338-9c02-514c8106994b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:29:07.758468 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f78950a3-1c61-482f-8850-e22c99b9cd9b tempest-AttachVolumeShelveTestJSON-1279821748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (536add27-3dd5-4338-9c02-514c8106994b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:29:07.759910 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f78950a3-1c61-482f-8850-e22c99b9cd9b tempest-AttachVolumeShelveTestJSON-1279821748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57b8bd35-c536-405e-8619-59537ac87f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:29:07.762230 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f78950a3-1c61-482f-8850-e22c99b9cd9b tempest-AttachVolumeShelveTestJSON-1279821748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57b8bd35-c536-405e-8619-59537ac87f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06661aab-01cf-4a95-94d1-d80c006009d6', 'volume_name': 'volume-06661aab-01cf-4a95-94d1-d80c006009d6', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:29:07.764512 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f78950a3-1c61-482f-8850-e22c99b9cd9b tempest-AttachVolumeShelveTestJSON-1279821748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65ac5546-dccc-444f-a8c0-7f4e976fd901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:29:07.767337 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f78950a3-1c61-482f-8850-e22c99b9cd9b tempest-AttachVolumeShelveTestJSON-1279821748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65ac5546-dccc-444f-a8c0-7f4e976fd901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:29:07.769565 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f78950a3-1c61-482f-8850-e22c99b9cd9b tempest-AttachVolumeShelveTestJSON-1279821748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a07b42d-338f-4a66-b777-d350a27e7209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:29:07.770441 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-f78950a3-1c61-482f-8850-e22c99b9cd9b tempest-AttachVolumeShelveTestJSON-1279821748 None] Volume 06661aab-01cf-4a95-94d1-d80c006009d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06661aab-01cf-4a95-94d1-d80c006009d6', 'volume_size': 1} Dec 25 21:29:07.770845 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f78950a3-1c61-482f-8850-e22c99b9cd9b tempest-AttachVolumeShelveTestJSON-1279821748 None] creating volume 'volume-06661aab-01cf-4a95-94d1-d80c006009d6' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:29:07.771824 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f78950a3-1c61-482f-8850-e22c99b9cd9b tempest-AttachVolumeShelveTestJSON-1279821748 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:29:08.279722 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-e9d05df9-5c37-4d1e-95c4-304ead7a215a tempest-GroupsTest-732789418 None] Created reservations ['07e0b8bb-f6dc-4801-967f-f0aa5f65186b'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:29:08.297479 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-fcf3f658-34ea-41d8-822d-0e301f82560e req-696f0360-68f3-4827-82e0-71f2622edd68 tempest-TaggedBootDevicesTest-292780470 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.994s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:29:08.299826 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-fcf3f658-34ea-41d8-822d-0e301f82560e req-696f0360-68f3-4827-82e0-71f2622edd68 tempest-TaggedBootDevicesTest-292780470 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-84d8c368-fc65-4b1d-bfa0-8dcd9af9fee2', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': '84d8c368-fc65-4b1d-bfa0-8dcd9af9fee2', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 21:29:08.425916 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-fcf3f658-34ea-41d8-822d-0e301f82560e req-696f0360-68f3-4827-82e0-71f2622edd68 tempest-TaggedBootDevicesTest-292780470 None] Connection info returned from driver {'name': 'volumes/volume-84d8c368-fc65-4b1d-bfa0-8dcd9af9fee2', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '84d8c368-fc65-4b1d-bfa0-8dcd9af9fee2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a2267fda-c974-4109-9037-b92a9c3e6de4'} {{(pid=129926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 25 21:29:08.523983 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e9d05df9-5c37-4d1e-95c4-304ead7a215a tempest-GroupsTest-732789418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:29:08.654182 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e9d05df9-5c37-4d1e-95c4-304ead7a215a tempest-GroupsTest-732789418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:29:08.703006 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-e9d05df9-5c37-4d1e-95c4-304ead7a215a tempest-GroupsTest-732789418 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:29:08.707201 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-e9d05df9-5c37-4d1e-95c4-304ead7a215a tempest-GroupsTest-732789418 None] Delete group completed successfully. Dec 25 21:29:08.727590 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-fcf3f658-34ea-41d8-822d-0e301f82560e req-696f0360-68f3-4827-82e0-71f2622edd68 tempest-TaggedBootDevicesTest-292780470 None] attachment_update completed successfully. Dec 25 21:29:09.058413 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f78950a3-1c61-482f-8850-e22c99b9cd9b tempest-AttachVolumeShelveTestJSON-1279821748 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:29:09.064185 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f78950a3-1c61-482f-8850-e22c99b9cd9b tempest-AttachVolumeShelveTestJSON-1279821748 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:29:09.064185 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f78950a3-1c61-482f-8850-e22c99b9cd9b tempest-AttachVolumeShelveTestJSON-1279821748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a07b42d-338f-4a66-b777-d350a27e7209) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06661aab-01cf-4a95-94d1-d80c006009d6', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:29:09.068898 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f78950a3-1c61-482f-8850-e22c99b9cd9b tempest-AttachVolumeShelveTestJSON-1279821748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a022509-977c-4a04-a1eb-a9bfcd399f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:29:09.146606 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-f78950a3-1c61-482f-8850-e22c99b9cd9b tempest-AttachVolumeShelveTestJSON-1279821748 None] Volume volume-06661aab-01cf-4a95-94d1-d80c006009d6 (06661aab-01cf-4a95-94d1-d80c006009d6): created successfully Dec 25 21:29:09.149471 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f78950a3-1c61-482f-8850-e22c99b9cd9b tempest-AttachVolumeShelveTestJSON-1279821748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a022509-977c-4a04-a1eb-a9bfcd399f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:29:09.155620 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f78950a3-1c61-482f-8850-e22c99b9cd9b tempest-AttachVolumeShelveTestJSON-1279821748 None] Flow 'volume_create_manager' (532c5daa-cef6-4af8-a456-4351af8f66fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:29:09.215967 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-f78950a3-1c61-482f-8850-e22c99b9cd9b tempest-AttachVolumeShelveTestJSON-1279821748 None] Created volume successfully. Dec 25 21:29:10.846715 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-09025289-3c5a-4ac9-b23b-c72ac8f39faf tempest-GroupsTest-732789418 None] Group tempest-GroupsTest-Group-574780220: creating Dec 25 21:29:11.018476 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-09025289-3c5a-4ac9-b23b-c72ac8f39faf tempest-GroupsTest-732789418 None] Group tempest-GroupsTest-Group-574780220: created successfully Dec 25 21:29:11.033086 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-09025289-3c5a-4ac9-b23b-c72ac8f39faf tempest-GroupsTest-732789418 None] Create group completed successfully. Dec 25 21:29:13.124729 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-7236c9fc-a770-4130-8646-286969475dcd tempest-GroupsTest-732789418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:29:13.136824 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-7236c9fc-a770-4130-8646-286969475dcd tempest-GroupsTest-732789418 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:29:13.136824 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-7236c9fc-a770-4130-8646-286969475dcd tempest-GroupsTest-732789418 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:29:13.156325 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-7236c9fc-a770-4130-8646-286969475dcd tempest-GroupsTest-732789418 None] Flow 'volume_create_manager' (2074de14-75b3-4ef6-8519-d09ab66260c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:29:13.164436 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-7236c9fc-a770-4130-8646-286969475dcd tempest-GroupsTest-732789418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ff8b896-c96e-4360-89ea-b7c47983ad30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:29:13.188488 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-7236c9fc-a770-4130-8646-286969475dcd tempest-GroupsTest-732789418 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:29:13.219512 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-7236c9fc-a770-4130-8646-286969475dcd tempest-GroupsTest-732789418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ff8b896-c96e-4360-89ea-b7c47983ad30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-984226570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=df400246-90b4-4f7e-83fb-7c4af12a2577,host='ncdv-master-1@ceph#ceph',id=619df53a-d21d-4efc-8dd5-5f5fc20cfc23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8575c4332583463384501df8336e3599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:29:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:29:13Z,use_quota=True,user_id='359a08e577f445c3bc3a843845b9ec0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8e91f44-26bb-464c-bd38-11410fd876f5),volume_type_id=b8e91f44-26bb-464c-bd38-11410fd876f5)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:29:13.227602 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-7236c9fc-a770-4130-8646-286969475dcd tempest-GroupsTest-732789418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2033b3d-736c-44b8-ba1f-510a20e115f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:29:13.235610 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-7236c9fc-a770-4130-8646-286969475dcd tempest-GroupsTest-732789418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2033b3d-736c-44b8-ba1f-510a20e115f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:29:13.238868 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-7236c9fc-a770-4130-8646-286969475dcd tempest-GroupsTest-732789418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51a012ae-5b0a-42a5-ae60-6159ed99f3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:29:13.241476 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-7236c9fc-a770-4130-8646-286969475dcd tempest-GroupsTest-732789418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51a012ae-5b0a-42a5-ae60-6159ed99f3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '619df53a-d21d-4efc-8dd5-5f5fc20cfc23', 'volume_name': 'volume-619df53a-d21d-4efc-8dd5-5f5fc20cfc23', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:29:13.245618 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-7236c9fc-a770-4130-8646-286969475dcd tempest-GroupsTest-732789418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a688eed-2351-4668-82af-5df55e5acf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:29:13.261220 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-7236c9fc-a770-4130-8646-286969475dcd tempest-GroupsTest-732789418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a688eed-2351-4668-82af-5df55e5acf2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:29:13.261220 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-7236c9fc-a770-4130-8646-286969475dcd tempest-GroupsTest-732789418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c65046d7-f566-43f6-85b3-7ca11c9a4568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:29:13.261942 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-7236c9fc-a770-4130-8646-286969475dcd tempest-GroupsTest-732789418 None] Volume 619df53a-d21d-4efc-8dd5-5f5fc20cfc23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-619df53a-d21d-4efc-8dd5-5f5fc20cfc23', 'volume_size': 1} Dec 25 21:29:13.265406 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7236c9fc-a770-4130-8646-286969475dcd tempest-GroupsTest-732789418 None] creating volume 'volume-619df53a-d21d-4efc-8dd5-5f5fc20cfc23' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:29:13.266669 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7236c9fc-a770-4130-8646-286969475dcd tempest-GroupsTest-732789418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:29:14.518201 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7236c9fc-a770-4130-8646-286969475dcd tempest-GroupsTest-732789418 None] extra_specs: {} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:29:14.519355 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7236c9fc-a770-4130-8646-286969475dcd tempest-GroupsTest-732789418 None] extra_specs: {} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:29:14.522099 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-7236c9fc-a770-4130-8646-286969475dcd tempest-GroupsTest-732789418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c65046d7-f566-43f6-85b3-7ca11c9a4568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-619df53a-d21d-4efc-8dd5-5f5fc20cfc23', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:29:14.525448 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-7236c9fc-a770-4130-8646-286969475dcd tempest-GroupsTest-732789418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fc46e82-6db3-40c8-815f-9e81d1ca2e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:29:14.657808 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-7236c9fc-a770-4130-8646-286969475dcd tempest-GroupsTest-732789418 None] Volume volume-619df53a-d21d-4efc-8dd5-5f5fc20cfc23 (619df53a-d21d-4efc-8dd5-5f5fc20cfc23): created successfully Dec 25 21:29:14.662349 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-7236c9fc-a770-4130-8646-286969475dcd tempest-GroupsTest-732789418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fc46e82-6db3-40c8-815f-9e81d1ca2e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:29:14.663061 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-7236c9fc-a770-4130-8646-286969475dcd tempest-GroupsTest-732789418 None] Flow 'volume_create_manager' (2074de14-75b3-4ef6-8519-d09ab66260c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:29:14.762521 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-7236c9fc-a770-4130-8646-286969475dcd tempest-GroupsTest-732789418 None] Created volume successfully. Dec 25 21:29:15.807079 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-66b097c1-4814-4fa8-bf08-0dbdc98972f0 tempest-VolumesCloneTest-843094097 None] Created reservations ['f2cbe48b-23a5-4fee-aa7e-30c71ba35a54', '1abe4fbf-e2ab-4ca5-ad1f-3d555e306030', '43993efd-c2b7-409b-a899-d4b7949647c9', '3151cc7b-cadd-48a3-91cc-15aae9485714'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:29:16.077660 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-66b097c1-4814-4fa8-bf08-0dbdc98972f0 tempest-VolumesCloneTest-843094097 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:29:16.202759 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-66b097c1-4814-4fa8-bf08-0dbdc98972f0 tempest-VolumesCloneTest-843094097 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:29:16.266872 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-66b097c1-4814-4fa8-bf08-0dbdc98972f0 tempest-VolumesCloneTest-843094097 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:29:16.271572 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-66b097c1-4814-4fa8-bf08-0dbdc98972f0 tempest-VolumesCloneTest-843094097 None] Deleted volume successfully. Dec 25 21:29:16.351012 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-66b097c1-4814-4fa8-bf08-0dbdc98972f0 tempest-VolumesCloneTest-843094097 None] Lock "b'cinder-28588cfc-c902-47ec-a542-1e57bbcf9098-delete_volume'" released by "delete_volume" :: held 10.752s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:29:16.373726 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-27b561ed-2d05-49a9-bd4c-62970133918a tempest-GroupsTest-732789418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:29:16.378208 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-27b561ed-2d05-49a9-bd4c-62970133918a tempest-GroupsTest-732789418 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:29:16.379712 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-27b561ed-2d05-49a9-bd4c-62970133918a tempest-GroupsTest-732789418 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:29:16.408015 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-27b561ed-2d05-49a9-bd4c-62970133918a tempest-GroupsTest-732789418 None] Flow 'volume_create_manager' (5ed53600-856f-4518-95a4-21f3da6c4bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:29:16.414135 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-27b561ed-2d05-49a9-bd4c-62970133918a tempest-GroupsTest-732789418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (218a0aab-87ec-4d04-bcd4-9800500b5b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:29:16.429678 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-27b561ed-2d05-49a9-bd4c-62970133918a tempest-GroupsTest-732789418 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:29:16.467276 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-27b561ed-2d05-49a9-bd4c-62970133918a tempest-GroupsTest-732789418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (218a0aab-87ec-4d04-bcd4-9800500b5b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:29:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-1126380420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=df400246-90b4-4f7e-83fb-7c4af12a2577,host='ncdv-master-1@ceph#ceph',id=ab091d0f-7c2c-449c-a270-c19843d08233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8575c4332583463384501df8336e3599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:29:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:29:16Z,use_quota=True,user_id='359a08e577f445c3bc3a843845b9ec0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8e91f44-26bb-464c-bd38-11410fd876f5),volume_type_id=b8e91f44-26bb-464c-bd38-11410fd876f5)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:29:16.469984 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-27b561ed-2d05-49a9-bd4c-62970133918a tempest-GroupsTest-732789418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf50d137-8916-405d-bcfa-f1cfede837de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:29:16.473859 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-27b561ed-2d05-49a9-bd4c-62970133918a tempest-GroupsTest-732789418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf50d137-8916-405d-bcfa-f1cfede837de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:29:16.477603 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-27b561ed-2d05-49a9-bd4c-62970133918a tempest-GroupsTest-732789418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9840473-95c3-4548-aded-df07680931e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:29:16.481705 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-27b561ed-2d05-49a9-bd4c-62970133918a tempest-GroupsTest-732789418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9840473-95c3-4548-aded-df07680931e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab091d0f-7c2c-449c-a270-c19843d08233', 'volume_name': 'volume-ab091d0f-7c2c-449c-a270-c19843d08233', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:29:16.484726 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-27b561ed-2d05-49a9-bd4c-62970133918a tempest-GroupsTest-732789418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91d20b39-737a-4af7-8a4a-29bc33e8c48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:29:16.487036 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-27b561ed-2d05-49a9-bd4c-62970133918a tempest-GroupsTest-732789418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91d20b39-737a-4af7-8a4a-29bc33e8c48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:29:16.489546 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-27b561ed-2d05-49a9-bd4c-62970133918a tempest-GroupsTest-732789418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43e4e595-7c0e-4b28-b81b-2fde21c7cae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:29:16.490421 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-27b561ed-2d05-49a9-bd4c-62970133918a tempest-GroupsTest-732789418 None] Volume ab091d0f-7c2c-449c-a270-c19843d08233: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab091d0f-7c2c-449c-a270-c19843d08233', 'volume_size': 1} Dec 25 21:29:16.491008 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-27b561ed-2d05-49a9-bd4c-62970133918a tempest-GroupsTest-732789418 None] creating volume 'volume-ab091d0f-7c2c-449c-a270-c19843d08233' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:29:16.491826 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-27b561ed-2d05-49a9-bd4c-62970133918a tempest-GroupsTest-732789418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:29:17.202778 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-ca902e37-05f7-429e-9384-a1f55b3e1455 tempest-VolumesCloneTest-843094097 None] Lock "b'cinder-4aebfc13-7c5d-4bfd-ab8f-3812fd99e521-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:29:17.363634 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ca902e37-05f7-429e-9384-a1f55b3e1455 tempest-VolumesCloneTest-843094097 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:29:17.620728 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ca902e37-05f7-429e-9384-a1f55b3e1455 tempest-VolumesCloneTest-843094097 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:29:17.944672 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ca902e37-05f7-429e-9384-a1f55b3e1455 tempest-VolumesCloneTest-843094097 None] deleting rbd volume volume-4aebfc13-7c5d-4bfd-ab8f-3812fd99e521 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:29:17.957680 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-27b561ed-2d05-49a9-bd4c-62970133918a tempest-GroupsTest-732789418 None] extra_specs: {} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:29:17.959167 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-27b561ed-2d05-49a9-bd4c-62970133918a tempest-GroupsTest-732789418 None] extra_specs: {} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:29:17.961937 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-27b561ed-2d05-49a9-bd4c-62970133918a tempest-GroupsTest-732789418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43e4e595-7c0e-4b28-b81b-2fde21c7cae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab091d0f-7c2c-449c-a270-c19843d08233', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:29:17.965386 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-27b561ed-2d05-49a9-bd4c-62970133918a tempest-GroupsTest-732789418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99ed3be4-5ad1-41ae-9bfa-9e7dee210011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:29:18.091146 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-27b561ed-2d05-49a9-bd4c-62970133918a tempest-GroupsTest-732789418 None] Volume volume-ab091d0f-7c2c-449c-a270-c19843d08233 (ab091d0f-7c2c-449c-a270-c19843d08233): created successfully Dec 25 21:29:18.093184 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-27b561ed-2d05-49a9-bd4c-62970133918a tempest-GroupsTest-732789418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99ed3be4-5ad1-41ae-9bfa-9e7dee210011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:29:18.099389 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-27b561ed-2d05-49a9-bd4c-62970133918a tempest-GroupsTest-732789418 None] Flow 'volume_create_manager' (5ed53600-856f-4518-95a4-21f3da6c4bf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:29:18.251657 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-27b561ed-2d05-49a9-bd4c-62970133918a tempest-GroupsTest-732789418 None] Created volume successfully. Dec 25 21:29:18.935553 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-13ab4a61-4de3-4e14-bdfa-a86ed45bd0d6 tempest-GroupsTest-732789418 None] Update group completed successfully. Dec 25 21:29:20.635015 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-37682533-53c8-4e5b-a615-0c6bde8a3e47 tempest-GroupsTest-732789418 None] Update group completed successfully. Dec 25 21:29:22.168491 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-2bd16f67-0b14-4b7a-b571-2d1f550973ee tempest-GroupsTest-732789418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:29:22.459265 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-2bd16f67-0b14-4b7a-b571-2d1f550973ee tempest-GroupsTest-732789418 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:29:22.459575 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-2bd16f67-0b14-4b7a-b571-2d1f550973ee tempest-GroupsTest-732789418 None] Volume volume-619df53a-d21d-4efc-8dd5-5f5fc20cfc23 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:29:22.698551 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-2bd16f67-0b14-4b7a-b571-2d1f550973ee tempest-GroupsTest-732789418 None] deleting rbd volume volume-619df53a-d21d-4efc-8dd5-5f5fc20cfc23 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:29:26.088266 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-e61c2e6d-7350-4064-8187-ebf57ea4958f tempest-VolumeSnapshotQuotasNegativeTestJSON-964998318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:29:26.095996 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-e61c2e6d-7350-4064-8187-ebf57ea4958f tempest-VolumeSnapshotQuotasNegativeTestJSON-964998318 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:29:26.096822 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-e61c2e6d-7350-4064-8187-ebf57ea4958f tempest-VolumeSnapshotQuotasNegativeTestJSON-964998318 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:29:26.126867 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e61c2e6d-7350-4064-8187-ebf57ea4958f tempest-VolumeSnapshotQuotasNegativeTestJSON-964998318 None] Flow 'volume_create_manager' (24e0efff-6af8-4258-af43-f23b885467c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:29:26.132737 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e61c2e6d-7350-4064-8187-ebf57ea4958f tempest-VolumeSnapshotQuotasNegativeTestJSON-964998318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f212c0a-ccd5-4497-a934-aa1bcac2047d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:29:26.147143 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-e61c2e6d-7350-4064-8187-ebf57ea4958f tempest-VolumeSnapshotQuotasNegativeTestJSON-964998318 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:29:26.172194 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e61c2e6d-7350-4064-8187-ebf57ea4958f tempest-VolumeSnapshotQuotasNegativeTestJSON-964998318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f212c0a-ccd5-4497-a934-aa1bcac2047d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1527295433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5aaff7d8-8536-4ba8-878e-89fb82df0d25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a699909695048b89c32adc2939a97f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:29:26Z,use_quota=True,user_id='3717a4bd457f409eb3350766e001093b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:29:26.188831 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e61c2e6d-7350-4064-8187-ebf57ea4958f tempest-VolumeSnapshotQuotasNegativeTestJSON-964998318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f80e3643-0515-414e-8698-768d458f7a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:29:26.194794 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e61c2e6d-7350-4064-8187-ebf57ea4958f tempest-VolumeSnapshotQuotasNegativeTestJSON-964998318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f80e3643-0515-414e-8698-768d458f7a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:29:26.204021 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e61c2e6d-7350-4064-8187-ebf57ea4958f tempest-VolumeSnapshotQuotasNegativeTestJSON-964998318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0689d2be-4ecc-4818-b92c-157bccd54494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:29:26.210710 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e61c2e6d-7350-4064-8187-ebf57ea4958f tempest-VolumeSnapshotQuotasNegativeTestJSON-964998318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0689d2be-4ecc-4818-b92c-157bccd54494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5aaff7d8-8536-4ba8-878e-89fb82df0d25', 'volume_name': 'volume-5aaff7d8-8536-4ba8-878e-89fb82df0d25', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:29:26.217526 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e61c2e6d-7350-4064-8187-ebf57ea4958f tempest-VolumeSnapshotQuotasNegativeTestJSON-964998318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6df84a6a-6987-434c-a940-d433978f6a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:29:26.224592 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e61c2e6d-7350-4064-8187-ebf57ea4958f tempest-VolumeSnapshotQuotasNegativeTestJSON-964998318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6df84a6a-6987-434c-a940-d433978f6a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:29:26.232174 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e61c2e6d-7350-4064-8187-ebf57ea4958f tempest-VolumeSnapshotQuotasNegativeTestJSON-964998318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4877c6cf-b693-464f-ad56-23268aa71293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:29:26.235894 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-e61c2e6d-7350-4064-8187-ebf57ea4958f tempest-VolumeSnapshotQuotasNegativeTestJSON-964998318 None] Volume 5aaff7d8-8536-4ba8-878e-89fb82df0d25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5aaff7d8-8536-4ba8-878e-89fb82df0d25', 'volume_size': 1} Dec 25 21:29:26.236851 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e61c2e6d-7350-4064-8187-ebf57ea4958f tempest-VolumeSnapshotQuotasNegativeTestJSON-964998318 None] creating volume 'volume-5aaff7d8-8536-4ba8-878e-89fb82df0d25' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:29:26.240183 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e61c2e6d-7350-4064-8187-ebf57ea4958f tempest-VolumeSnapshotQuotasNegativeTestJSON-964998318 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:29:26.919039 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ca902e37-05f7-429e-9384-a1f55b3e1455 tempest-VolumesCloneTest-843094097 None] volume is a clone so cleaning references {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 25 21:29:27.199109 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ca902e37-05f7-429e-9384-a1f55b3e1455 tempest-VolumesCloneTest-843094097 None] deleting parent snapshot volume-4aebfc13-7c5d-4bfd-ab8f-3812fd99e521.clone_snap {{(pid=129926) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 25 21:29:32.046594 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:29:32.047428 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:29:32.136453 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:29:32.205953 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:29:32.226239 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e61c2e6d-7350-4064-8187-ebf57ea4958f tempest-VolumeSnapshotQuotasNegativeTestJSON-964998318 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:29:32.226857 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e61c2e6d-7350-4064-8187-ebf57ea4958f tempest-VolumeSnapshotQuotasNegativeTestJSON-964998318 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:29:32.230506 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e61c2e6d-7350-4064-8187-ebf57ea4958f tempest-VolumeSnapshotQuotasNegativeTestJSON-964998318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4877c6cf-b693-464f-ad56-23268aa71293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5aaff7d8-8536-4ba8-878e-89fb82df0d25', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:29:32.240343 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e61c2e6d-7350-4064-8187-ebf57ea4958f tempest-VolumeSnapshotQuotasNegativeTestJSON-964998318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53c2e9f9-f660-41ff-a13f-5a54bb5b0d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:29:32.257748 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-2bd16f67-0b14-4b7a-b571-2d1f550973ee tempest-GroupsTest-732789418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:29:32.601248 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-2bd16f67-0b14-4b7a-b571-2d1f550973ee tempest-GroupsTest-732789418 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:29:32.601795 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-2bd16f67-0b14-4b7a-b571-2d1f550973ee tempest-GroupsTest-732789418 None] Volume volume-ab091d0f-7c2c-449c-a270-c19843d08233 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:29:32.800696 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-2bd16f67-0b14-4b7a-b571-2d1f550973ee tempest-GroupsTest-732789418 None] deleting rbd volume volume-ab091d0f-7c2c-449c-a270-c19843d08233 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:29:32.956368 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-e61c2e6d-7350-4064-8187-ebf57ea4958f tempest-VolumeSnapshotQuotasNegativeTestJSON-964998318 None] Volume volume-5aaff7d8-8536-4ba8-878e-89fb82df0d25 (5aaff7d8-8536-4ba8-878e-89fb82df0d25): created successfully Dec 25 21:29:32.959841 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e61c2e6d-7350-4064-8187-ebf57ea4958f tempest-VolumeSnapshotQuotasNegativeTestJSON-964998318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53c2e9f9-f660-41ff-a13f-5a54bb5b0d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:29:32.965061 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e61c2e6d-7350-4064-8187-ebf57ea4958f tempest-VolumeSnapshotQuotasNegativeTestJSON-964998318 None] Flow 'volume_create_manager' (24e0efff-6af8-4258-af43-f23b885467c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:29:33.014984 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-ca902e37-05f7-429e-9384-a1f55b3e1455 tempest-VolumesCloneTest-843094097 None] Created reservations ['d6db9e89-a673-4475-b96a-6834c2c82709', 'bf4ae4e4-5076-40c2-8930-5350f7aad6ee', '92b037cf-9562-4490-aaef-f49d529e3dcf', 'd4c7def2-a0fb-4855-8e1d-63d0bdfa2d97'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:29:33.098749 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-e61c2e6d-7350-4064-8187-ebf57ea4958f tempest-VolumeSnapshotQuotasNegativeTestJSON-964998318 None] Created volume successfully. Dec 25 21:29:33.269069 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ca902e37-05f7-429e-9384-a1f55b3e1455 tempest-VolumesCloneTest-843094097 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:29:33.347915 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ca902e37-05f7-429e-9384-a1f55b3e1455 tempest-VolumesCloneTest-843094097 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:29:33.436297 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-ca902e37-05f7-429e-9384-a1f55b3e1455 tempest-VolumesCloneTest-843094097 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:29:33.441882 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-ca902e37-05f7-429e-9384-a1f55b3e1455 tempest-VolumesCloneTest-843094097 None] Deleted volume successfully. Dec 25 21:29:33.591369 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-ca902e37-05f7-429e-9384-a1f55b3e1455 tempest-VolumesCloneTest-843094097 None] Lock "b'cinder-4aebfc13-7c5d-4bfd-ab8f-3812fd99e521-delete_volume'" released by "delete_volume" :: held 16.389s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:29:34.048660 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-e9911a9c-68b6-42f7-9355-2c95ccbf98b8 tempest-VolumesCloneTest-843094097 None] Lock "b'cinder-8e11017c-7649-4b11-8607-8f99ddd48c83-delete_volume'" acquired by "delete_volume" :: waited 0.036s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:29:34.243153 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e9911a9c-68b6-42f7-9355-2c95ccbf98b8 tempest-VolumesCloneTest-843094097 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:29:34.542385 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e9911a9c-68b6-42f7-9355-2c95ccbf98b8 tempest-VolumesCloneTest-843094097 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:29:34.816139 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e9911a9c-68b6-42f7-9355-2c95ccbf98b8 tempest-VolumesCloneTest-843094097 None] deleting rbd volume volume-8e11017c-7649-4b11-8607-8f99ddd48c83 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:29:34.970717 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-936b1353-6c98-4e27-bb23-8c12030ed9df tempest-VolumeSnapshotQuotasNegativeTestJSON-964998318 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:29:39.334546 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-936b1353-6c98-4e27-bb23-8c12030ed9df tempest-VolumeSnapshotQuotasNegativeTestJSON-964998318 None] Create snapshot completed successfully Dec 25 21:29:41.009625 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-76248014-48e9-4d70-b62c-212b1f251f9f tempest-VolumeSnapshotQuotasNegativeTestJSON-964998318 None] Lock "b'cinder-fc9c84dc-a60d-4b66-9e70-599d5a1e6983-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.019s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:29:41.013377 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-76248014-48e9-4d70-b62c-212b1f251f9f tempest-VolumeSnapshotQuotasNegativeTestJSON-964998318 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:29:41.751004 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-2bd16f67-0b14-4b7a-b571-2d1f550973ee tempest-GroupsTest-732789418 None] Created reservations ['8eece423-4b1e-4be2-8cdb-737b7a2fbced'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:29:41.791522 ncdv-master-1 cinder-volume[129926]: WARNING cinder.quota [None req-2bd16f67-0b14-4b7a-b571-2d1f550973ee tempest-GroupsTest-732789418 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-717967028 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-717967028, it is now deprecated. Please use the default quota class for default quota. Dec 25 21:29:41.797009 ncdv-master-1 cinder-volume[129926]: WARNING cinder.quota [None req-2bd16f67-0b14-4b7a-b571-2d1f550973ee tempest-GroupsTest-732789418 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-717967028 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-717967028, it is now deprecated. Please use the default quota class for default quota. Dec 25 21:29:41.938245 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-2bd16f67-0b14-4b7a-b571-2d1f550973ee tempest-GroupsTest-732789418 None] Created reservations ['23a38cde-192e-490b-97eb-96fc21526996', '7a7de712-ec16-433a-b8dc-528b12b891c1', '05630120-66e1-4c68-b97f-3aff5fc13603', 'b4c69540-bf62-4275-b343-5cf36954fed2'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:29:42.355373 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-2bd16f67-0b14-4b7a-b571-2d1f550973ee tempest-GroupsTest-732789418 None] Created reservations ['1949ce64-3e8f-46a8-8f85-a4436cd5789a', '60079a0e-4543-487e-9ebf-b77ef84e4ecb', '4b40196f-007d-4631-9710-8fa13f7bc726', '3eac4846-02d4-43e7-b2f7-1982b7cf20d3'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:29:43.030056 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-2bd16f67-0b14-4b7a-b571-2d1f550973ee tempest-GroupsTest-732789418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:29:43.114214 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-2bd16f67-0b14-4b7a-b571-2d1f550973ee tempest-GroupsTest-732789418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:29:43.258775 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-2bd16f67-0b14-4b7a-b571-2d1f550973ee tempest-GroupsTest-732789418 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:29:43.271825 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-2bd16f67-0b14-4b7a-b571-2d1f550973ee tempest-GroupsTest-732789418 None] Delete group completed successfully. Dec 25 21:29:43.779633 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e9911a9c-68b6-42f7-9355-2c95ccbf98b8 tempest-VolumesCloneTest-843094097 None] volume is a clone so cleaning references {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 25 21:29:44.009257 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e9911a9c-68b6-42f7-9355-2c95ccbf98b8 tempest-VolumesCloneTest-843094097 None] deleting parent snapshot volume-8e11017c-7649-4b11-8607-8f99ddd48c83.clone_snap {{(pid=129926) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 25 21:29:48.891962 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-e9911a9c-68b6-42f7-9355-2c95ccbf98b8 tempest-VolumesCloneTest-843094097 None] Created reservations ['0da12086-00e1-4940-9d0d-26321ec6aaa6', 'f2f44f60-b236-41da-b573-791660668f94', '9938ed5b-8471-471b-b8a7-bc03b3c55fb2', '2080c64d-6e4a-4d78-b285-c08e9013c0cc'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:29:49.127472 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e9911a9c-68b6-42f7-9355-2c95ccbf98b8 tempest-VolumesCloneTest-843094097 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:29:49.183836 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e9911a9c-68b6-42f7-9355-2c95ccbf98b8 tempest-VolumesCloneTest-843094097 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:29:49.222699 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-e9911a9c-68b6-42f7-9355-2c95ccbf98b8 tempest-VolumesCloneTest-843094097 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:29:49.227296 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-e9911a9c-68b6-42f7-9355-2c95ccbf98b8 tempest-VolumesCloneTest-843094097 None] Deleted volume successfully. Dec 25 21:29:49.338609 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-e9911a9c-68b6-42f7-9355-2c95ccbf98b8 tempest-VolumesCloneTest-843094097 None] Lock "b'cinder-8e11017c-7649-4b11-8607-8f99ddd48c83-delete_volume'" released by "delete_volume" :: held 15.291s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:29:49.519026 ncdv-master-1 cinder-volume[129926]: WARNING cinder.quota [None req-76248014-48e9-4d70-b62c-212b1f251f9f tempest-VolumeSnapshotQuotasNegativeTestJSON-964998318 None] Deprecated: Default quota for resource: snapshots_ceph is set by the default quota flag: quota_snapshots_ceph, it is now deprecated. Please use the default quota class for default quota. Dec 25 21:29:49.612274 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-76248014-48e9-4d70-b62c-212b1f251f9f tempest-VolumeSnapshotQuotasNegativeTestJSON-964998318 None] Created reservations ['3b7ffd16-7f77-4789-a6e4-895092e9bc2f', '967fd054-abfe-4880-8b8b-87197ae70403', 'cc428d59-f62c-48e3-bfc1-6aecc53e7958', '9b12d4ae-09c3-4bd0-9593-c802f6a6543b'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:29:49.931327 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-76248014-48e9-4d70-b62c-212b1f251f9f tempest-VolumeSnapshotQuotasNegativeTestJSON-964998318 None] Delete snapshot completed successfully. Dec 25 21:29:49.936637 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-76248014-48e9-4d70-b62c-212b1f251f9f tempest-VolumeSnapshotQuotasNegativeTestJSON-964998318 None] Lock "b'cinder-fc9c84dc-a60d-4b66-9e70-599d5a1e6983-delete_snapshot'" released by "delete_snapshot" :: held 8.929s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:29:50.683910 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-ffa69bce-5f94-4649-837e-4f4ec1306975 tempest-VolumeSnapshotQuotasNegativeTestJSON-964998318 None] Lock "b'cinder-5aaff7d8-8536-4ba8-878e-89fb82df0d25-delete_volume'" acquired by "delete_volume" :: waited 0.032s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:29:50.847609 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ffa69bce-5f94-4649-837e-4f4ec1306975 tempest-VolumeSnapshotQuotasNegativeTestJSON-964998318 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:29:51.137912 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ffa69bce-5f94-4649-837e-4f4ec1306975 tempest-VolumeSnapshotQuotasNegativeTestJSON-964998318 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:29:51.142049 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ffa69bce-5f94-4649-837e-4f4ec1306975 tempest-VolumeSnapshotQuotasNegativeTestJSON-964998318 None] Volume volume-5aaff7d8-8536-4ba8-878e-89fb82df0d25 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:29:51.465556 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ffa69bce-5f94-4649-837e-4f4ec1306975 tempest-VolumeSnapshotQuotasNegativeTestJSON-964998318 None] deleting rbd volume volume-5aaff7d8-8536-4ba8-878e-89fb82df0d25 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:29:52.402010 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-e52a4e65-6533-47ea-bfb0-c0111bf8b9d1 tempest-SnapshotsActionsTest-723692985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:29:52.410735 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-e52a4e65-6533-47ea-bfb0-c0111bf8b9d1 tempest-SnapshotsActionsTest-723692985 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:29:52.410735 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-e52a4e65-6533-47ea-bfb0-c0111bf8b9d1 tempest-SnapshotsActionsTest-723692985 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:29:52.419329 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e52a4e65-6533-47ea-bfb0-c0111bf8b9d1 tempest-SnapshotsActionsTest-723692985 None] Flow 'volume_create_manager' (b55687f7-538c-47a4-9777-883c0a156e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:29:52.422868 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e52a4e65-6533-47ea-bfb0-c0111bf8b9d1 tempest-SnapshotsActionsTest-723692985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5394c7a0-8104-4689-84d4-a82668766db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:29:52.429280 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-e52a4e65-6533-47ea-bfb0-c0111bf8b9d1 tempest-SnapshotsActionsTest-723692985 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:29:52.446751 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e52a4e65-6533-47ea-bfb0-c0111bf8b9d1 tempest-SnapshotsActionsTest-723692985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5394c7a0-8104-4689-84d4-a82668766db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-961744371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=10480c31-8c99-47d4-856f-72a6c5843700,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13413b6e22ac4d319f142d01c6f58fbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:29:52Z,use_quota=True,user_id='2ce1d9a465f54f46af59b1089007008c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:29:52.449389 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e52a4e65-6533-47ea-bfb0-c0111bf8b9d1 tempest-SnapshotsActionsTest-723692985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6209e70-88eb-41c5-97aa-f891c5a82f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:29:52.451534 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e52a4e65-6533-47ea-bfb0-c0111bf8b9d1 tempest-SnapshotsActionsTest-723692985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6209e70-88eb-41c5-97aa-f891c5a82f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:29:52.453948 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e52a4e65-6533-47ea-bfb0-c0111bf8b9d1 tempest-SnapshotsActionsTest-723692985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (036ba117-005a-419c-a728-044a992f37e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:29:52.456159 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e52a4e65-6533-47ea-bfb0-c0111bf8b9d1 tempest-SnapshotsActionsTest-723692985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (036ba117-005a-419c-a728-044a992f37e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10480c31-8c99-47d4-856f-72a6c5843700', 'volume_name': 'volume-10480c31-8c99-47d4-856f-72a6c5843700', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:29:52.458559 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e52a4e65-6533-47ea-bfb0-c0111bf8b9d1 tempest-SnapshotsActionsTest-723692985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (900b51b4-48db-483e-a2ad-fbbc16b804c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:29:52.460698 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e52a4e65-6533-47ea-bfb0-c0111bf8b9d1 tempest-SnapshotsActionsTest-723692985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (900b51b4-48db-483e-a2ad-fbbc16b804c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:29:52.463040 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e52a4e65-6533-47ea-bfb0-c0111bf8b9d1 tempest-SnapshotsActionsTest-723692985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66dd1c88-dc0b-4279-ac65-001f5c3ebecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:29:52.463870 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-e52a4e65-6533-47ea-bfb0-c0111bf8b9d1 tempest-SnapshotsActionsTest-723692985 None] Volume 10480c31-8c99-47d4-856f-72a6c5843700: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10480c31-8c99-47d4-856f-72a6c5843700', 'volume_size': 1} Dec 25 21:29:52.464458 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e52a4e65-6533-47ea-bfb0-c0111bf8b9d1 tempest-SnapshotsActionsTest-723692985 None] creating volume 'volume-10480c31-8c99-47d4-856f-72a6c5843700' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:29:52.465466 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e52a4e65-6533-47ea-bfb0-c0111bf8b9d1 tempest-SnapshotsActionsTest-723692985 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:29:53.843039 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e52a4e65-6533-47ea-bfb0-c0111bf8b9d1 tempest-SnapshotsActionsTest-723692985 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:29:53.843494 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e52a4e65-6533-47ea-bfb0-c0111bf8b9d1 tempest-SnapshotsActionsTest-723692985 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:29:53.847136 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e52a4e65-6533-47ea-bfb0-c0111bf8b9d1 tempest-SnapshotsActionsTest-723692985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66dd1c88-dc0b-4279-ac65-001f5c3ebecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10480c31-8c99-47d4-856f-72a6c5843700', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:29:53.848931 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e52a4e65-6533-47ea-bfb0-c0111bf8b9d1 tempest-SnapshotsActionsTest-723692985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66be60db-5c99-4096-814b-93afb42a2a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:29:53.973214 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-e52a4e65-6533-47ea-bfb0-c0111bf8b9d1 tempest-SnapshotsActionsTest-723692985 None] Volume volume-10480c31-8c99-47d4-856f-72a6c5843700 (10480c31-8c99-47d4-856f-72a6c5843700): created successfully Dec 25 21:29:53.975568 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e52a4e65-6533-47ea-bfb0-c0111bf8b9d1 tempest-SnapshotsActionsTest-723692985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66be60db-5c99-4096-814b-93afb42a2a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:29:53.987241 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e52a4e65-6533-47ea-bfb0-c0111bf8b9d1 tempest-SnapshotsActionsTest-723692985 None] Flow 'volume_create_manager' (b55687f7-538c-47a4-9777-883c0a156e0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:29:54.068514 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-e52a4e65-6533-47ea-bfb0-c0111bf8b9d1 tempest-SnapshotsActionsTest-723692985 None] Created volume successfully. Dec 25 21:29:55.121833 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0f65b6cd-2f1e-4096-90dc-b86e1200c674 tempest-SnapshotsActionsTest-723692985 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:29:56.612271 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-f1201edc-551e-491d-acb4-ae92ecc10fc4 req-cd14f358-57cc-4b21-bac0-a1be9424d0e6 tempest-AttachVolumeShelveTestJSON-1279821748 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:29:57.556129 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-f1201edc-551e-491d-acb4-ae92ecc10fc4 req-cd14f358-57cc-4b21-bac0-a1be9424d0e6 tempest-AttachVolumeShelveTestJSON-1279821748 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.943s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:29:57.556940 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-f1201edc-551e-491d-acb4-ae92ecc10fc4 req-cd14f358-57cc-4b21-bac0-a1be9424d0e6 tempest-AttachVolumeShelveTestJSON-1279821748 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-06661aab-01cf-4a95-94d1-d80c006009d6', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': '06661aab-01cf-4a95-94d1-d80c006009d6', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 21:29:57.687464 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-f1201edc-551e-491d-acb4-ae92ecc10fc4 req-cd14f358-57cc-4b21-bac0-a1be9424d0e6 tempest-AttachVolumeShelveTestJSON-1279821748 None] Connection info returned from driver {'name': 'volumes/volume-06661aab-01cf-4a95-94d1-d80c006009d6', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '06661aab-01cf-4a95-94d1-d80c006009d6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f69b3648-597c-4bbf-85e6-d0076984ec14'} {{(pid=129926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 25 21:29:57.821430 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-f1201edc-551e-491d-acb4-ae92ecc10fc4 req-cd14f358-57cc-4b21-bac0-a1be9424d0e6 tempest-AttachVolumeShelveTestJSON-1279821748 None] attachment_update completed successfully. Dec 25 21:29:59.019666 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aa670b9-0074-4d77-bd14-6e2f19071b80 tempest-VolumesSnapshotNegativeTestJSON-115552986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:29:59.025337 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-1aa670b9-0074-4d77-bd14-6e2f19071b80 tempest-VolumesSnapshotNegativeTestJSON-115552986 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:29:59.025992 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-1aa670b9-0074-4d77-bd14-6e2f19071b80 tempest-VolumesSnapshotNegativeTestJSON-115552986 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:29:59.041891 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-1aa670b9-0074-4d77-bd14-6e2f19071b80 tempest-VolumesSnapshotNegativeTestJSON-115552986 None] Flow 'volume_create_manager' (96022a00-ed5d-40a7-996a-99a42e40b8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:29:59.045375 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-1aa670b9-0074-4d77-bd14-6e2f19071b80 tempest-VolumesSnapshotNegativeTestJSON-115552986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a3599b7-a019-4fa8-a7a1-ccf105727023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:29:59.052209 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-1aa670b9-0074-4d77-bd14-6e2f19071b80 tempest-VolumesSnapshotNegativeTestJSON-115552986 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:29:59.066337 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-1aa670b9-0074-4d77-bd14-6e2f19071b80 tempest-VolumesSnapshotNegativeTestJSON-115552986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a3599b7-a019-4fa8-a7a1-ccf105727023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1319005196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=31483f5e-54b0-4aa4-a448-9a9351b631a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0b810d510e4022906978eed80e7346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:29:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:29:59Z,use_quota=True,user_id='f3183f288efa402aa0d44bbe35b35d2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:29:59.069194 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-1aa670b9-0074-4d77-bd14-6e2f19071b80 tempest-VolumesSnapshotNegativeTestJSON-115552986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3388559f-4728-437a-8b05-af61f28ee68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:29:59.072331 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-1aa670b9-0074-4d77-bd14-6e2f19071b80 tempest-VolumesSnapshotNegativeTestJSON-115552986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3388559f-4728-437a-8b05-af61f28ee68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:29:59.076922 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-1aa670b9-0074-4d77-bd14-6e2f19071b80 tempest-VolumesSnapshotNegativeTestJSON-115552986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f9849e-5510-4cd2-a37e-e040e38fb75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:29:59.078262 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-1aa670b9-0074-4d77-bd14-6e2f19071b80 tempest-VolumesSnapshotNegativeTestJSON-115552986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f9849e-5510-4cd2-a37e-e040e38fb75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31483f5e-54b0-4aa4-a448-9a9351b631a7', 'volume_name': 'volume-31483f5e-54b0-4aa4-a448-9a9351b631a7', 'volume_size': 2}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:29:59.080818 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-1aa670b9-0074-4d77-bd14-6e2f19071b80 tempest-VolumesSnapshotNegativeTestJSON-115552986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0718c772-00a5-41a8-af33-896b2ec77011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:29:59.083397 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-1aa670b9-0074-4d77-bd14-6e2f19071b80 tempest-VolumesSnapshotNegativeTestJSON-115552986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0718c772-00a5-41a8-af33-896b2ec77011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:29:59.086438 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-1aa670b9-0074-4d77-bd14-6e2f19071b80 tempest-VolumesSnapshotNegativeTestJSON-115552986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3bc0e47-765a-486f-8a57-118095922278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:29:59.087972 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-1aa670b9-0074-4d77-bd14-6e2f19071b80 tempest-VolumesSnapshotNegativeTestJSON-115552986 None] Volume 31483f5e-54b0-4aa4-a448-9a9351b631a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31483f5e-54b0-4aa4-a448-9a9351b631a7', 'volume_size': 2} Dec 25 21:29:59.097641 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-1aa670b9-0074-4d77-bd14-6e2f19071b80 tempest-VolumesSnapshotNegativeTestJSON-115552986 None] creating volume 'volume-31483f5e-54b0-4aa4-a448-9a9351b631a7' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:29:59.100304 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-1aa670b9-0074-4d77-bd14-6e2f19071b80 tempest-VolumesSnapshotNegativeTestJSON-115552986 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:29:59.460966 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-0f65b6cd-2f1e-4096-90dc-b86e1200c674 tempest-SnapshotsActionsTest-723692985 None] Create snapshot completed successfully Dec 25 21:29:59.634377 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-ffa69bce-5f94-4649-837e-4f4ec1306975 tempest-VolumeSnapshotQuotasNegativeTestJSON-964998318 None] Created reservations ['8e3798cb-039a-4cae-a20b-403875e378d9', 'd01b416b-935d-4c1e-ae9a-085b04bf3b24', '45f7e840-c9c1-494e-94eb-17a031f72847', '0ee8557c-2d68-4e64-a16d-8f289ab4415f'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:29:59.914762 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ffa69bce-5f94-4649-837e-4f4ec1306975 tempest-VolumeSnapshotQuotasNegativeTestJSON-964998318 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:29:59.974862 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ffa69bce-5f94-4649-837e-4f4ec1306975 tempest-VolumeSnapshotQuotasNegativeTestJSON-964998318 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:30:00.029111 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-ffa69bce-5f94-4649-837e-4f4ec1306975 tempest-VolumeSnapshotQuotasNegativeTestJSON-964998318 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:30:00.034845 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-ffa69bce-5f94-4649-837e-4f4ec1306975 tempest-VolumeSnapshotQuotasNegativeTestJSON-964998318 None] Deleted volume successfully. Dec 25 21:30:00.063974 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-1aa670b9-0074-4d77-bd14-6e2f19071b80 tempest-VolumesSnapshotNegativeTestJSON-115552986 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:30:00.065872 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-1aa670b9-0074-4d77-bd14-6e2f19071b80 tempest-VolumesSnapshotNegativeTestJSON-115552986 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:30:00.067153 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-1aa670b9-0074-4d77-bd14-6e2f19071b80 tempest-VolumesSnapshotNegativeTestJSON-115552986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3bc0e47-765a-486f-8a57-118095922278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31483f5e-54b0-4aa4-a448-9a9351b631a7', 'volume_size': 2}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:30:00.070175 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-1aa670b9-0074-4d77-bd14-6e2f19071b80 tempest-VolumesSnapshotNegativeTestJSON-115552986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e4abf36-7c83-4d3c-88dd-a412b9894d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:30:00.155886 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-ffa69bce-5f94-4649-837e-4f4ec1306975 tempest-VolumeSnapshotQuotasNegativeTestJSON-964998318 None] Lock "b'cinder-5aaff7d8-8536-4ba8-878e-89fb82df0d25-delete_volume'" released by "delete_volume" :: held 9.475s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:30:00.179719 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-1aa670b9-0074-4d77-bd14-6e2f19071b80 tempest-VolumesSnapshotNegativeTestJSON-115552986 None] Volume volume-31483f5e-54b0-4aa4-a448-9a9351b631a7 (31483f5e-54b0-4aa4-a448-9a9351b631a7): created successfully Dec 25 21:30:00.182047 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-1aa670b9-0074-4d77-bd14-6e2f19071b80 tempest-VolumesSnapshotNegativeTestJSON-115552986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e4abf36-7c83-4d3c-88dd-a412b9894d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:30:00.185697 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-1aa670b9-0074-4d77-bd14-6e2f19071b80 tempest-VolumesSnapshotNegativeTestJSON-115552986 None] Flow 'volume_create_manager' (96022a00-ed5d-40a7-996a-99a42e40b8a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:30:00.330535 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-1aa670b9-0074-4d77-bd14-6e2f19071b80 tempest-VolumesSnapshotNegativeTestJSON-115552986 None] Created volume successfully. Dec 25 21:30:01.577743 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f67cf888-1ca7-4e0b-97fd-e182589540fd tempest-SnapshotsActionsTest-723692985 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:30:02.438755 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-65f7b31d-74b1-4315-8788-1fe94b8d23b4 tempest-VolumesSnapshotNegativeTestJSON-115552986 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:30:05.636081 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-f67cf888-1ca7-4e0b-97fd-e182589540fd tempest-SnapshotsActionsTest-723692985 None] Create snapshot completed successfully Dec 25 21:30:05.692127 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-65f7b31d-74b1-4315-8788-1fe94b8d23b4 tempest-VolumesSnapshotNegativeTestJSON-115552986 None] Create snapshot completed successfully Dec 25 21:30:06.947985 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-69e3a642-deef-4a85-8f27-fd6d347c153f tempest-VolumesSnapshotNegativeTestJSON-115552986 None] Lock "b'cinder-599ee49e-e56c-48d5-a328-ac2aded153a0-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.018s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:30:06.953451 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-69e3a642-deef-4a85-8f27-fd6d347c153f tempest-VolumesSnapshotNegativeTestJSON-115552986 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:30:07.241083 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-26b31442-ef33-46f5-aa5f-41ee96f0ccf8 tempest-SnapshotsActionsTest-1308552767 None] Lock "b'cinder-27547eaa-29ad-44f5-a286-0203dc1e3fc8-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.018s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:30:07.242437 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-26b31442-ef33-46f5-aa5f-41ee96f0ccf8 tempest-SnapshotsActionsTest-1308552767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:30:10.112868 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-69e3a642-deef-4a85-8f27-fd6d347c153f tempest-VolumesSnapshotNegativeTestJSON-115552986 None] Created reservations ['c16f7b17-de83-438a-94b2-bbc80237f3ee', 'acf8a93a-1ed1-4935-bb46-aa2847c405fd', '1fb3e273-2cea-4227-a9f5-05480478dcc3', 'ebdc1952-caa9-4680-af71-e4afa77616a0'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:30:10.322418 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-69e3a642-deef-4a85-8f27-fd6d347c153f tempest-VolumesSnapshotNegativeTestJSON-115552986 None] Delete snapshot completed successfully. Dec 25 21:30:10.326945 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-69e3a642-deef-4a85-8f27-fd6d347c153f tempest-VolumesSnapshotNegativeTestJSON-115552986 None] Lock "b'cinder-599ee49e-e56c-48d5-a328-ac2aded153a0-delete_snapshot'" released by "delete_snapshot" :: held 3.379s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:30:11.447557 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-7a389b1f-db18-42ca-9d6e-e6ce95dd4f25 tempest-VolumesSnapshotNegativeTestJSON-115552986 None] Lock "b'cinder-31483f5e-54b0-4aa4-a448-9a9351b631a7-delete_volume'" acquired by "delete_volume" :: waited 0.047s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:30:11.509578 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-26b31442-ef33-46f5-aa5f-41ee96f0ccf8 tempest-SnapshotsActionsTest-1308552767 None] Created reservations ['82039e5d-2293-47b4-9784-7c1cabd77f10', '56a1cf14-d01a-44f2-81d2-3142267f31d7', '44c131e0-7503-4f44-ba51-dbc1aa703374', '66e0f468-9ad2-4f7d-947a-18cd179d4cb8'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:30:11.558428 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7a389b1f-db18-42ca-9d6e-e6ce95dd4f25 tempest-VolumesSnapshotNegativeTestJSON-115552986 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:30:11.702555 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7a389b1f-db18-42ca-9d6e-e6ce95dd4f25 tempest-VolumesSnapshotNegativeTestJSON-115552986 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:30:11.703266 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7a389b1f-db18-42ca-9d6e-e6ce95dd4f25 tempest-VolumesSnapshotNegativeTestJSON-115552986 None] Volume volume-31483f5e-54b0-4aa4-a448-9a9351b631a7 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:30:11.880280 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7a389b1f-db18-42ca-9d6e-e6ce95dd4f25 tempest-VolumesSnapshotNegativeTestJSON-115552986 None] deleting rbd volume volume-31483f5e-54b0-4aa4-a448-9a9351b631a7 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:30:11.994454 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-26b31442-ef33-46f5-aa5f-41ee96f0ccf8 tempest-SnapshotsActionsTest-1308552767 None] Delete snapshot completed successfully. Dec 25 21:30:12.019276 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-26b31442-ef33-46f5-aa5f-41ee96f0ccf8 tempest-SnapshotsActionsTest-1308552767 None] Lock "b'cinder-27547eaa-29ad-44f5-a286-0203dc1e3fc8-delete_snapshot'" released by "delete_snapshot" :: held 4.773s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:30:13.638107 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-c14ca506-0505-43ad-b089-132a52679e9a tempest-SnapshotsActionsTest-723692985 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:30:15.144612 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa9325c5-61ae-4ae6-aaa9-8c6c5ef7f42c tempest-SnapshotMetadataTestJSON-1780512977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:30:15.150663 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-aa9325c5-61ae-4ae6-aaa9-8c6c5ef7f42c tempest-SnapshotMetadataTestJSON-1780512977 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:30:15.151385 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-aa9325c5-61ae-4ae6-aaa9-8c6c5ef7f42c tempest-SnapshotMetadataTestJSON-1780512977 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:30:15.177754 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-aa9325c5-61ae-4ae6-aaa9-8c6c5ef7f42c tempest-SnapshotMetadataTestJSON-1780512977 None] Flow 'volume_create_manager' (53d529b5-0e34-4177-b96e-33574907ba03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:30:15.182439 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-aa9325c5-61ae-4ae6-aaa9-8c6c5ef7f42c tempest-SnapshotMetadataTestJSON-1780512977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19c61760-d38a-4dec-81ee-d1501ebb2597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:30:15.192664 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-aa9325c5-61ae-4ae6-aaa9-8c6c5ef7f42c tempest-SnapshotMetadataTestJSON-1780512977 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:30:15.237703 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-aa9325c5-61ae-4ae6-aaa9-8c6c5ef7f42c tempest-SnapshotMetadataTestJSON-1780512977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19c61760-d38a-4dec-81ee-d1501ebb2597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-84881367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e96a9218-fd11-432d-9a6e-bc0d256d79f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed7adc4401942fb9b231240f1d89feb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:30:15Z,use_quota=True,user_id='ceabeb375f8a45a6a40f08410b3b957d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:30:15.241986 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-aa9325c5-61ae-4ae6-aaa9-8c6c5ef7f42c tempest-SnapshotMetadataTestJSON-1780512977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f824eac8-d710-4936-9d70-d86e04f844e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:30:15.244149 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-aa9325c5-61ae-4ae6-aaa9-8c6c5ef7f42c tempest-SnapshotMetadataTestJSON-1780512977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f824eac8-d710-4936-9d70-d86e04f844e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:30:15.248528 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-aa9325c5-61ae-4ae6-aaa9-8c6c5ef7f42c tempest-SnapshotMetadataTestJSON-1780512977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b693e911-0ac7-4bec-839f-098b9a1a12c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:30:15.251230 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-aa9325c5-61ae-4ae6-aaa9-8c6c5ef7f42c tempest-SnapshotMetadataTestJSON-1780512977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b693e911-0ac7-4bec-839f-098b9a1a12c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e96a9218-fd11-432d-9a6e-bc0d256d79f0', 'volume_name': 'volume-e96a9218-fd11-432d-9a6e-bc0d256d79f0', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:30:15.254254 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-aa9325c5-61ae-4ae6-aaa9-8c6c5ef7f42c tempest-SnapshotMetadataTestJSON-1780512977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea2cf2ca-877b-40b2-95bc-4c6e94557c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:30:15.257495 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-aa9325c5-61ae-4ae6-aaa9-8c6c5ef7f42c tempest-SnapshotMetadataTestJSON-1780512977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea2cf2ca-877b-40b2-95bc-4c6e94557c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:30:15.260202 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-aa9325c5-61ae-4ae6-aaa9-8c6c5ef7f42c tempest-SnapshotMetadataTestJSON-1780512977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b20f859b-4c2c-432f-b31c-3e0c98e0bcff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:30:15.264076 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-aa9325c5-61ae-4ae6-aaa9-8c6c5ef7f42c tempest-SnapshotMetadataTestJSON-1780512977 None] Volume e96a9218-fd11-432d-9a6e-bc0d256d79f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e96a9218-fd11-432d-9a6e-bc0d256d79f0', 'volume_size': 1} Dec 25 21:30:15.265170 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-aa9325c5-61ae-4ae6-aaa9-8c6c5ef7f42c tempest-SnapshotMetadataTestJSON-1780512977 None] creating volume 'volume-e96a9218-fd11-432d-9a6e-bc0d256d79f0' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:30:15.273600 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-aa9325c5-61ae-4ae6-aaa9-8c6c5ef7f42c tempest-SnapshotMetadataTestJSON-1780512977 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:30:17.215709 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-aa9325c5-61ae-4ae6-aaa9-8c6c5ef7f42c tempest-SnapshotMetadataTestJSON-1780512977 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:30:17.216979 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-aa9325c5-61ae-4ae6-aaa9-8c6c5ef7f42c tempest-SnapshotMetadataTestJSON-1780512977 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:30:17.219375 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-aa9325c5-61ae-4ae6-aaa9-8c6c5ef7f42c tempest-SnapshotMetadataTestJSON-1780512977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b20f859b-4c2c-432f-b31c-3e0c98e0bcff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e96a9218-fd11-432d-9a6e-bc0d256d79f0', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:30:17.221995 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-aa9325c5-61ae-4ae6-aaa9-8c6c5ef7f42c tempest-SnapshotMetadataTestJSON-1780512977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5329302d-3a0e-4498-8493-000eb0f5cc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:30:17.314080 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-aa9325c5-61ae-4ae6-aaa9-8c6c5ef7f42c tempest-SnapshotMetadataTestJSON-1780512977 None] Volume volume-e96a9218-fd11-432d-9a6e-bc0d256d79f0 (e96a9218-fd11-432d-9a6e-bc0d256d79f0): created successfully Dec 25 21:30:17.316394 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-aa9325c5-61ae-4ae6-aaa9-8c6c5ef7f42c tempest-SnapshotMetadataTestJSON-1780512977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5329302d-3a0e-4498-8493-000eb0f5cc27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:30:17.320585 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-aa9325c5-61ae-4ae6-aaa9-8c6c5ef7f42c tempest-SnapshotMetadataTestJSON-1780512977 None] Flow 'volume_create_manager' (53d529b5-0e34-4177-b96e-33574907ba03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:30:17.400113 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-aa9325c5-61ae-4ae6-aaa9-8c6c5ef7f42c tempest-SnapshotMetadataTestJSON-1780512977 None] Created volume successfully. Dec 25 21:30:18.747886 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-c14ca506-0505-43ad-b089-132a52679e9a tempest-SnapshotsActionsTest-723692985 None] Create snapshot completed successfully Dec 25 21:30:18.890495 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-9f28480a-2fff-4084-a668-6ab707867987 tempest-SnapshotMetadataTestJSON-1780512977 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:30:19.881076 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-9d609bf5-7435-4c50-8703-cfb8af28072a tempest-SnapshotsActionsTest-1308552767 None] Lock "b'cinder-44e3f60b-e79c-4175-9654-473526ff6d9f-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:30:19.882581 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-9d609bf5-7435-4c50-8703-cfb8af28072a tempest-SnapshotsActionsTest-1308552767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:30:20.833765 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-7a389b1f-db18-42ca-9d6e-e6ce95dd4f25 tempest-VolumesSnapshotNegativeTestJSON-115552986 None] Created reservations ['109498b7-92d6-4e49-8794-23cc27848dc3', 'e3abacbf-5c90-4013-8b3e-92a3cc3f4450', '8f48faba-f1f0-4ad3-9697-073d0de8a8ab', '415640b4-f815-4106-82be-ca5623ef8729'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:30:21.051019 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7a389b1f-db18-42ca-9d6e-e6ce95dd4f25 tempest-VolumesSnapshotNegativeTestJSON-115552986 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:30:21.077004 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7a389b1f-db18-42ca-9d6e-e6ce95dd4f25 tempest-VolumesSnapshotNegativeTestJSON-115552986 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:30:21.104282 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-7a389b1f-db18-42ca-9d6e-e6ce95dd4f25 tempest-VolumesSnapshotNegativeTestJSON-115552986 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:30:21.112634 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-7a389b1f-db18-42ca-9d6e-e6ce95dd4f25 tempest-VolumesSnapshotNegativeTestJSON-115552986 None] Deleted volume successfully. Dec 25 21:30:21.194453 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-7a389b1f-db18-42ca-9d6e-e6ce95dd4f25 tempest-VolumesSnapshotNegativeTestJSON-115552986 None] Lock "b'cinder-31483f5e-54b0-4aa4-a448-9a9351b631a7-delete_volume'" released by "delete_volume" :: held 9.748s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:30:22.856821 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-9f28480a-2fff-4084-a668-6ab707867987 tempest-SnapshotMetadataTestJSON-1780512977 None] Create snapshot completed successfully Dec 25 21:30:24.416101 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-9d609bf5-7435-4c50-8703-cfb8af28072a tempest-SnapshotsActionsTest-1308552767 None] Created reservations ['72cdce0b-4be1-4207-91ef-4fcf6f1214ef', 'ba567447-673a-48a0-8d43-44f88d10f3d2', 'a7b957c8-3dd1-4e12-a2bc-fba69857496e', '8957949c-8aa6-408d-a3e7-20cc1bd66af0'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:30:24.656823 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-9d609bf5-7435-4c50-8703-cfb8af28072a tempest-SnapshotsActionsTest-1308552767 None] Delete snapshot completed successfully. Dec 25 21:30:24.662022 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-9d609bf5-7435-4c50-8703-cfb8af28072a tempest-SnapshotsActionsTest-1308552767 None] Lock "b'cinder-44e3f60b-e79c-4175-9654-473526ff6d9f-delete_snapshot'" released by "delete_snapshot" :: held 4.781s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:30:25.368694 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-a0bb10ca-803e-4bba-9f6f-4466098a855e req-010e4f31-7996-49b8-a8a6-a9d415d2780f tempest-TaggedBootDevicesTest_v242-1707178338 None] Terminate volume connection completed successfully. Dec 25 21:30:25.369235 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-a0bb10ca-803e-4bba-9f6f-4466098a855e req-010e4f31-7996-49b8-a8a6-a9d415d2780f tempest-TaggedBootDevicesTest_v242-1707178338 None] Deleting attachment af2f8811-0d29-4a13-9517-01abed54df95. {{(pid=129926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 25 21:30:25.990640 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-a0bb10ca-803e-4bba-9f6f-4466098a855e req-f36b3e42-4b6e-48da-a4f8-5fcd092fcfaf tempest-TaggedBootDevicesTest_v242-1707178338 None] Terminate volume connection completed successfully. Dec 25 21:30:25.994899 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-a0bb10ca-803e-4bba-9f6f-4466098a855e req-f36b3e42-4b6e-48da-a4f8-5fcd092fcfaf tempest-TaggedBootDevicesTest_v242-1707178338 None] Deleting attachment ec35d1c4-7e6c-4694-a1d7-5596ebe1a219. {{(pid=129926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 25 21:30:26.182247 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-eb7d012f-ba0a-4736-9d52-7dc9be113cd1 tempest-SnapshotsActionsTest-723692985 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:30:26.698825 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-a0bb10ca-803e-4bba-9f6f-4466098a855e req-e5d92a38-7ded-4308-bd84-e969d8f79bbc tempest-TaggedBootDevicesTest_v242-1707178338 None] Terminate volume connection completed successfully. Dec 25 21:30:26.699247 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-a0bb10ca-803e-4bba-9f6f-4466098a855e req-e5d92a38-7ded-4308-bd84-e969d8f79bbc tempest-TaggedBootDevicesTest_v242-1707178338 None] Deleting attachment add0d839-bd2b-4398-a3f2-c5ae6a804f79. {{(pid=129926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 25 21:30:26.703582 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-f8a1d134-bc78-45e9-bde4-194d7121f6df tempest-SnapshotMetadataTestJSON-1780512977 None] Lock "b'cinder-e4919950-8743-4122-b07d-1b9ceaf771ec-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.034s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:30:26.705211 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f8a1d134-bc78-45e9-bde4-194d7121f6df tempest-SnapshotMetadataTestJSON-1780512977 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:30:29.925668 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-eb7d012f-ba0a-4736-9d52-7dc9be113cd1 tempest-SnapshotsActionsTest-723692985 None] Create snapshot completed successfully Dec 25 21:30:30.593050 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-55ca4516-e32d-4711-8298-646baf9c1514 tempest-SnapshotsActionsTest-1308552767 None] Lock "b'cinder-0b09811f-6f0b-4b61-8015-2892cb7b4e13-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.026s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:30:30.606049 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-55ca4516-e32d-4711-8298-646baf9c1514 tempest-SnapshotsActionsTest-1308552767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:30:32.049652 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:30:32.052174 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:30:32.116475 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:30:32.180503 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:30:32.365254 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-f8a1d134-bc78-45e9-bde4-194d7121f6df tempest-SnapshotMetadataTestJSON-1780512977 None] Created reservations ['5a298ea2-a9ab-4ea9-8b2f-1aaaad156584', '0ace8206-c640-4f9a-a45c-c55c4888967e', '14b281c6-4501-48b4-8cec-bf53e17d915a', 'b9d042db-7cc0-4438-9fa2-9264d670a89a'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:30:32.554312 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-f8a1d134-bc78-45e9-bde4-194d7121f6df tempest-SnapshotMetadataTestJSON-1780512977 None] Delete snapshot completed successfully. Dec 25 21:30:32.560600 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-f8a1d134-bc78-45e9-bde4-194d7121f6df tempest-SnapshotMetadataTestJSON-1780512977 None] Lock "b'cinder-e4919950-8743-4122-b07d-1b9ceaf771ec-delete_snapshot'" released by "delete_snapshot" :: held 5.857s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:30:33.140232 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-b154c450-4eac-4dc0-8d97-2c376f6b640b tempest-SnapshotMetadataTestJSON-1780512977 None] Lock "b'cinder-e96a9218-fd11-432d-9a6e-bc0d256d79f0-delete_volume'" acquired by "delete_volume" :: waited 0.026s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:30:33.296647 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b154c450-4eac-4dc0-8d97-2c376f6b640b tempest-SnapshotMetadataTestJSON-1780512977 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:30:33.582582 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b154c450-4eac-4dc0-8d97-2c376f6b640b tempest-SnapshotMetadataTestJSON-1780512977 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:30:33.583083 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b154c450-4eac-4dc0-8d97-2c376f6b640b tempest-SnapshotMetadataTestJSON-1780512977 None] Volume volume-e96a9218-fd11-432d-9a6e-bc0d256d79f0 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:30:33.693577 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b154c450-4eac-4dc0-8d97-2c376f6b640b tempest-SnapshotMetadataTestJSON-1780512977 None] deleting rbd volume volume-e96a9218-fd11-432d-9a6e-bc0d256d79f0 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:30:34.576759 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-55ca4516-e32d-4711-8298-646baf9c1514 tempest-SnapshotsActionsTest-1308552767 None] Created reservations ['4c83e3a3-4167-4aaf-9087-930c435fe1e9', '43d8ba72-d9f6-4250-aefa-fae763b455a4', '69a2018c-e070-4053-85a2-ddbe47b90b59', '06403be1-a065-4a9d-80f6-ff05c5a8d5dd'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:30:34.637877 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-68c2171e-ec59-4c40-bd52-a815d89aa028 tempest-TaggedBootDevicesTest_v242-1707178338 None] Lock "b'cinder-15822ef8-a596-47a7-bea5-391cbe2651d7-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:30:34.793767 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-68c2171e-ec59-4c40-bd52-a815d89aa028 tempest-TaggedBootDevicesTest_v242-1707178338 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:30:35.095926 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-68c2171e-ec59-4c40-bd52-a815d89aa028 tempest-TaggedBootDevicesTest_v242-1707178338 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:30:35.096391 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-68c2171e-ec59-4c40-bd52-a815d89aa028 tempest-TaggedBootDevicesTest_v242-1707178338 None] Volume volume-15822ef8-a596-47a7-bea5-391cbe2651d7 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:30:35.367880 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-68c2171e-ec59-4c40-bd52-a815d89aa028 tempest-TaggedBootDevicesTest_v242-1707178338 None] deleting rbd volume volume-15822ef8-a596-47a7-bea5-391cbe2651d7 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:30:35.375191 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-55ca4516-e32d-4711-8298-646baf9c1514 tempest-SnapshotsActionsTest-1308552767 None] Delete snapshot completed successfully. Dec 25 21:30:35.386037 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-55ca4516-e32d-4711-8298-646baf9c1514 tempest-SnapshotsActionsTest-1308552767 None] Lock "b'cinder-0b09811f-6f0b-4b61-8015-2892cb7b4e13-delete_snapshot'" released by "delete_snapshot" :: held 4.793s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:30:35.800962 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-4254c747-da23-48c8-bb2e-4aff87ce710d tempest-SnapshotsActionsTest-723692985 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:30:39.633658 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-4254c747-da23-48c8-bb2e-4aff87ce710d tempest-SnapshotsActionsTest-723692985 None] Create snapshot completed successfully Dec 25 21:30:40.082476 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-e2c82af9-d30f-4f72-ad30-b2bac16d4e28 tempest-SnapshotsActionsTest-1308552767 None] Lock "b'cinder-d01e9b48-c136-44e1-ae09-19d101d80724-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:30:40.084429 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e2c82af9-d30f-4f72-ad30-b2bac16d4e28 tempest-SnapshotsActionsTest-1308552767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:30:41.541925 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-b154c450-4eac-4dc0-8d97-2c376f6b640b tempest-SnapshotMetadataTestJSON-1780512977 None] Created reservations ['764983cd-bebe-4fe5-bf87-f2aaa6109677', '0b4caed8-8b56-4e20-95ee-17da323a29a7', '046d32ff-dd5d-4d20-9349-e3d931f3cd22', '116ba3ad-fb61-4e2f-9795-e65567c91bdd'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:30:41.735979 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b154c450-4eac-4dc0-8d97-2c376f6b640b tempest-SnapshotMetadataTestJSON-1780512977 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:30:41.796203 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b154c450-4eac-4dc0-8d97-2c376f6b640b tempest-SnapshotMetadataTestJSON-1780512977 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:30:41.839723 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-b154c450-4eac-4dc0-8d97-2c376f6b640b tempest-SnapshotMetadataTestJSON-1780512977 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:30:41.853862 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-b154c450-4eac-4dc0-8d97-2c376f6b640b tempest-SnapshotMetadataTestJSON-1780512977 None] Deleted volume successfully. Dec 25 21:30:42.022701 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-b154c450-4eac-4dc0-8d97-2c376f6b640b tempest-SnapshotMetadataTestJSON-1780512977 None] Lock "b'cinder-e96a9218-fd11-432d-9a6e-bc0d256d79f0-delete_volume'" released by "delete_volume" :: held 8.883s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:30:43.708808 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-68c2171e-ec59-4c40-bd52-a815d89aa028 tempest-TaggedBootDevicesTest_v242-1707178338 None] Created reservations ['8af241cc-d5f8-474e-82bc-a5ac23b21120', 'e32bdc09-93f0-4cce-a6dc-7fb41e11a0d6', '2949fc62-118e-4e50-b0e2-b82f31ec457c', 'fc5d644e-e6f7-4eab-8ad4-131950e126a9'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:30:44.038991 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-68c2171e-ec59-4c40-bd52-a815d89aa028 tempest-TaggedBootDevicesTest_v242-1707178338 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:30:44.117373 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-68c2171e-ec59-4c40-bd52-a815d89aa028 tempest-TaggedBootDevicesTest_v242-1707178338 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:30:44.197202 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-68c2171e-ec59-4c40-bd52-a815d89aa028 tempest-TaggedBootDevicesTest_v242-1707178338 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:30:44.202603 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-68c2171e-ec59-4c40-bd52-a815d89aa028 tempest-TaggedBootDevicesTest_v242-1707178338 None] Deleted volume successfully. Dec 25 21:30:44.279331 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-68c2171e-ec59-4c40-bd52-a815d89aa028 tempest-TaggedBootDevicesTest_v242-1707178338 None] Lock "b'cinder-15822ef8-a596-47a7-bea5-391cbe2651d7-delete_volume'" released by "delete_volume" :: held 9.641s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:30:44.672234 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-a0cc6a2e-a528-44d6-a0a4-78f5ceea52c1 tempest-TaggedBootDevicesTest_v242-1707178338 None] Lock "b'cinder-801c9bae-0e8c-4c69-99a2-93bfda7668af-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:30:44.837051 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a0cc6a2e-a528-44d6-a0a4-78f5ceea52c1 tempest-TaggedBootDevicesTest_v242-1707178338 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:30:45.163672 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a0cc6a2e-a528-44d6-a0a4-78f5ceea52c1 tempest-TaggedBootDevicesTest_v242-1707178338 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:30:45.164773 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a0cc6a2e-a528-44d6-a0a4-78f5ceea52c1 tempest-TaggedBootDevicesTest_v242-1707178338 None] Volume volume-801c9bae-0e8c-4c69-99a2-93bfda7668af is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:30:45.321077 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a0cc6a2e-a528-44d6-a0a4-78f5ceea52c1 tempest-TaggedBootDevicesTest_v242-1707178338 None] deleting rbd volume volume-801c9bae-0e8c-4c69-99a2-93bfda7668af {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:30:45.535739 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-e2c82af9-d30f-4f72-ad30-b2bac16d4e28 tempest-SnapshotsActionsTest-1308552767 None] Created reservations ['6aad01d3-424c-4bff-8cbc-201c610a5b95', '4f0eb8b4-a18e-4036-ae22-1564b7bd8c32', 'b0f173c7-6412-419e-8f73-f748fa4e3b0e', 'cce6c1b5-42e3-4b9f-86c8-384412f1508a'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:30:45.781519 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-e2c82af9-d30f-4f72-ad30-b2bac16d4e28 tempest-SnapshotsActionsTest-1308552767 None] Delete snapshot completed successfully. Dec 25 21:30:45.790294 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-e2c82af9-d30f-4f72-ad30-b2bac16d4e28 tempest-SnapshotsActionsTest-1308552767 None] Lock "b'cinder-d01e9b48-c136-44e1-ae09-19d101d80724-delete_snapshot'" released by "delete_snapshot" :: held 5.708s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:30:48.061097 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-af00a898-201f-430d-9cb0-a97b9f77ba78 tempest-SnapshotsActionsTest-723692985 None] Lock "b'cinder-c5a75274-e747-4dd0-937a-f1d13341cbf0-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.021s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:30:48.064527 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-af00a898-201f-430d-9cb0-a97b9f77ba78 tempest-SnapshotsActionsTest-723692985 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:30:51.587778 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-b75c0f91-7737-4720-a098-605c880a2f1b tempest-VolumesDeleteCascade-183328448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:30:51.591979 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-b75c0f91-7737-4720-a098-605c880a2f1b tempest-VolumesDeleteCascade-183328448 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:30:51.592893 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-b75c0f91-7737-4720-a098-605c880a2f1b tempest-VolumesDeleteCascade-183328448 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:30:51.609301 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b75c0f91-7737-4720-a098-605c880a2f1b tempest-VolumesDeleteCascade-183328448 None] Flow 'volume_create_manager' (261b4def-c0aa-46c6-a3ae-24bd29a93a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:30:51.613934 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b75c0f91-7737-4720-a098-605c880a2f1b tempest-VolumesDeleteCascade-183328448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d50a48cb-4af5-470b-a7f3-da4756948f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:30:51.631975 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-b75c0f91-7737-4720-a098-605c880a2f1b tempest-VolumesDeleteCascade-183328448 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:30:51.645666 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b75c0f91-7737-4720-a098-605c880a2f1b tempest-VolumesDeleteCascade-183328448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d50a48cb-4af5-470b-a7f3-da4756948f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-542615146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=381eb2bd-5ba6-4c05-91ff-978607ac6a78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8f250b16290406fa59b0ad0129cee20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:30:51Z,use_quota=True,user_id='51b86762a6184cb29595cdcf520b4851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:30:51.648493 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b75c0f91-7737-4720-a098-605c880a2f1b tempest-VolumesDeleteCascade-183328448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (082ed195-9772-488f-aaa2-0ea148705fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:30:51.650744 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b75c0f91-7737-4720-a098-605c880a2f1b tempest-VolumesDeleteCascade-183328448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (082ed195-9772-488f-aaa2-0ea148705fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:30:51.653140 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b75c0f91-7737-4720-a098-605c880a2f1b tempest-VolumesDeleteCascade-183328448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b278003-de1f-45fb-b13c-9344651fb18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:30:51.655951 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b75c0f91-7737-4720-a098-605c880a2f1b tempest-VolumesDeleteCascade-183328448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b278003-de1f-45fb-b13c-9344651fb18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '381eb2bd-5ba6-4c05-91ff-978607ac6a78', 'volume_name': 'volume-381eb2bd-5ba6-4c05-91ff-978607ac6a78', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:30:51.658293 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b75c0f91-7737-4720-a098-605c880a2f1b tempest-VolumesDeleteCascade-183328448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faaec13b-7db9-4350-a379-1988abda0dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:30:51.660421 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b75c0f91-7737-4720-a098-605c880a2f1b tempest-VolumesDeleteCascade-183328448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faaec13b-7db9-4350-a379-1988abda0dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:30:51.662654 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b75c0f91-7737-4720-a098-605c880a2f1b tempest-VolumesDeleteCascade-183328448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca2cf8d6-abaf-4a5e-a2fb-f349003c7b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:30:51.663450 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-b75c0f91-7737-4720-a098-605c880a2f1b tempest-VolumesDeleteCascade-183328448 None] Volume 381eb2bd-5ba6-4c05-91ff-978607ac6a78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-381eb2bd-5ba6-4c05-91ff-978607ac6a78', 'volume_size': 1} Dec 25 21:30:51.663841 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b75c0f91-7737-4720-a098-605c880a2f1b tempest-VolumesDeleteCascade-183328448 None] creating volume 'volume-381eb2bd-5ba6-4c05-91ff-978607ac6a78' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:30:51.664831 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b75c0f91-7737-4720-a098-605c880a2f1b tempest-VolumesDeleteCascade-183328448 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:30:52.352345 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-af00a898-201f-430d-9cb0-a97b9f77ba78 tempest-SnapshotsActionsTest-723692985 None] Created reservations ['cc6bd638-a65f-4782-9862-3bd52bf3dec0', '7b1486e0-435a-4792-b720-75f44074e49e', '4218c9f1-cb53-410e-b9bc-80ad10566c38', 'c16c932e-5ac7-4f84-91b8-f90b49106c53'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:30:52.615369 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-af00a898-201f-430d-9cb0-a97b9f77ba78 tempest-SnapshotsActionsTest-723692985 None] Delete snapshot completed successfully. Dec 25 21:30:52.620412 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-af00a898-201f-430d-9cb0-a97b9f77ba78 tempest-SnapshotsActionsTest-723692985 None] Lock "b'cinder-c5a75274-e747-4dd0-937a-f1d13341cbf0-delete_snapshot'" released by "delete_snapshot" :: held 4.559s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:30:52.703961 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b75c0f91-7737-4720-a098-605c880a2f1b tempest-VolumesDeleteCascade-183328448 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:30:52.704727 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b75c0f91-7737-4720-a098-605c880a2f1b tempest-VolumesDeleteCascade-183328448 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:30:52.708654 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b75c0f91-7737-4720-a098-605c880a2f1b tempest-VolumesDeleteCascade-183328448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca2cf8d6-abaf-4a5e-a2fb-f349003c7b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-381eb2bd-5ba6-4c05-91ff-978607ac6a78', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:30:52.712348 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b75c0f91-7737-4720-a098-605c880a2f1b tempest-VolumesDeleteCascade-183328448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2598067d-2146-4010-aa64-70f4f2d2ae7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:30:52.798227 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-b75c0f91-7737-4720-a098-605c880a2f1b tempest-VolumesDeleteCascade-183328448 None] Volume volume-381eb2bd-5ba6-4c05-91ff-978607ac6a78 (381eb2bd-5ba6-4c05-91ff-978607ac6a78): created successfully Dec 25 21:30:52.800658 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b75c0f91-7737-4720-a098-605c880a2f1b tempest-VolumesDeleteCascade-183328448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2598067d-2146-4010-aa64-70f4f2d2ae7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:30:52.807080 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b75c0f91-7737-4720-a098-605c880a2f1b tempest-VolumesDeleteCascade-183328448 None] Flow 'volume_create_manager' (261b4def-c0aa-46c6-a3ae-24bd29a93a9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:30:52.906882 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-b75c0f91-7737-4720-a098-605c880a2f1b tempest-VolumesDeleteCascade-183328448 None] Created volume successfully. Dec 25 21:30:53.106695 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-a0cc6a2e-a528-44d6-a0a4-78f5ceea52c1 tempest-TaggedBootDevicesTest_v242-1707178338 None] Created reservations ['1a68e56b-5eef-4416-8650-7255ba27f6e9', 'fc49ef99-524d-4d40-b3b4-1cbd07d89b6a', '47ac90c9-9e1e-4551-b508-9ea6affbcf8a', '3fb1b21c-e468-4bd3-adfa-53ecd9fe5f5c'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:30:53.406988 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a0cc6a2e-a528-44d6-a0a4-78f5ceea52c1 tempest-TaggedBootDevicesTest_v242-1707178338 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:30:53.480364 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a0cc6a2e-a528-44d6-a0a4-78f5ceea52c1 tempest-TaggedBootDevicesTest_v242-1707178338 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:30:53.553713 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a0cc6a2e-a528-44d6-a0a4-78f5ceea52c1 tempest-TaggedBootDevicesTest_v242-1707178338 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:30:53.562157 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-a0cc6a2e-a528-44d6-a0a4-78f5ceea52c1 tempest-TaggedBootDevicesTest_v242-1707178338 None] Deleted volume successfully. Dec 25 21:30:53.653746 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-a0cc6a2e-a528-44d6-a0a4-78f5ceea52c1 tempest-TaggedBootDevicesTest_v242-1707178338 None] Lock "b'cinder-801c9bae-0e8c-4c69-99a2-93bfda7668af-delete_volume'" released by "delete_volume" :: held 8.982s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:30:53.717155 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-3854d3f3-95d0-4340-b52c-04bfcf888c45 tempest-SnapshotsActionsTest-723692985 None] Lock "b'cinder-10480c31-8c99-47d4-856f-72a6c5843700-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:30:53.862050 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-3854d3f3-95d0-4340-b52c-04bfcf888c45 tempest-SnapshotsActionsTest-723692985 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:30:54.080210 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-3854d3f3-95d0-4340-b52c-04bfcf888c45 tempest-SnapshotsActionsTest-723692985 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:30:54.081368 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-3854d3f3-95d0-4340-b52c-04bfcf888c45 tempest-SnapshotsActionsTest-723692985 None] Volume volume-10480c31-8c99-47d4-856f-72a6c5843700 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:30:54.519057 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-3854d3f3-95d0-4340-b52c-04bfcf888c45 tempest-SnapshotsActionsTest-723692985 None] deleting rbd volume volume-10480c31-8c99-47d4-856f-72a6c5843700 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:30:54.578064 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-62527153-fc17-4699-8579-ba003c186410 tempest-TaggedBootDevicesTest_v242-1707178338 None] Lock "b'cinder-a5c1ad6f-a4c5-4f08-a59c-fa1afed02065-delete_volume'" acquired by "delete_volume" :: waited 0.038s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:30:54.703276 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-62527153-fc17-4699-8579-ba003c186410 tempest-TaggedBootDevicesTest_v242-1707178338 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:30:55.042599 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-62527153-fc17-4699-8579-ba003c186410 tempest-TaggedBootDevicesTest_v242-1707178338 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:30:55.347340 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-62527153-fc17-4699-8579-ba003c186410 tempest-TaggedBootDevicesTest_v242-1707178338 None] deleting rbd volume volume-a5c1ad6f-a4c5-4f08-a59c-fa1afed02065 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:30:55.373377 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-117bb70e-b3ab-4c24-9150-bec5650b078c tempest-VolumesDeleteCascade-183328448 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:30:59.514149 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-117bb70e-b3ab-4c24-9150-bec5650b078c tempest-VolumesDeleteCascade-183328448 None] Create snapshot completed successfully Dec 25 21:31:00.137546 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-053b1072-2585-472b-93b0-686f64b0d98d req-efd38be4-4f3d-4125-89c6-5a7c74b8f2f3 tempest-AttachVolumeShelveTestJSON-1279821748 None] Terminate volume connection completed successfully. Dec 25 21:31:00.139645 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-053b1072-2585-472b-93b0-686f64b0d98d req-efd38be4-4f3d-4125-89c6-5a7c74b8f2f3 tempest-AttachVolumeShelveTestJSON-1279821748 None] Deleting attachment f69b3648-597c-4bbf-85e6-d0076984ec14. {{(pid=129926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 25 21:31:00.466689 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-31435c31-2594-4f0c-b477-2cffb9e39e13 tempest-VolumesDeleteCascade-183328448 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:31:03.284924 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-3854d3f3-95d0-4340-b52c-04bfcf888c45 tempest-SnapshotsActionsTest-723692985 None] Created reservations ['523debc4-a33a-41fd-997c-5ee1aa2b6998', 'f4746515-3ffc-43cd-a41a-4d9996b26e86', '4faa072a-04d4-43b3-bd81-a1ecbd2c6a92', 'ae9a51ba-68f2-4891-b0fc-4e07578d6e88'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:31:03.677935 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-3854d3f3-95d0-4340-b52c-04bfcf888c45 tempest-SnapshotsActionsTest-723692985 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:31:03.777327 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-3854d3f3-95d0-4340-b52c-04bfcf888c45 tempest-SnapshotsActionsTest-723692985 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:31:03.833001 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-3854d3f3-95d0-4340-b52c-04bfcf888c45 tempest-SnapshotsActionsTest-723692985 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:31:03.837715 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-3854d3f3-95d0-4340-b52c-04bfcf888c45 tempest-SnapshotsActionsTest-723692985 None] Deleted volume successfully. Dec 25 21:31:03.960739 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-3854d3f3-95d0-4340-b52c-04bfcf888c45 tempest-SnapshotsActionsTest-723692985 None] Lock "b'cinder-10480c31-8c99-47d4-856f-72a6c5843700-delete_volume'" released by "delete_volume" :: held 10.236s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:31:04.197952 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-31435c31-2594-4f0c-b477-2cffb9e39e13 tempest-VolumesDeleteCascade-183328448 None] Create snapshot completed successfully Dec 25 21:31:04.582057 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-62527153-fc17-4699-8579-ba003c186410 tempest-TaggedBootDevicesTest_v242-1707178338 None] volume is a clone so cleaning references {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 25 21:31:04.895223 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-62527153-fc17-4699-8579-ba003c186410 tempest-TaggedBootDevicesTest_v242-1707178338 None] deleting parent snapshot volume-a5c1ad6f-a4c5-4f08-a59c-fa1afed02065.clone_snap {{(pid=129926) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 25 21:31:08.027974 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-7cba3770-5ca7-46c9-a7ec-7fa376e302c3 tempest-VolumesDeleteCascade-183328448 None] Lock "b'cinder-381eb2bd-5ba6-4c05-91ff-978607ac6a78-delete_volume'" acquired by "delete_volume" :: waited 0.028s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:31:08.171993 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-7cba3770-5ca7-46c9-a7ec-7fa376e302c3 tempest-VolumesDeleteCascade-183328448 None] Performing cascade delete. {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/manager.py:959}} Dec 25 21:31:08.212259 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-7cba3770-5ca7-46c9-a7ec-7fa376e302c3 tempest-VolumesDeleteCascade-183328448 None] Lock "b'cinder-8340d2cb-8d21-459f-a35e-e080f72a94c3-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.024s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:31:08.229660 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7cba3770-5ca7-46c9-a7ec-7fa376e302c3 tempest-VolumesDeleteCascade-183328448 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:31:08.489948 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-62527153-fc17-4699-8579-ba003c186410 tempest-TaggedBootDevicesTest_v242-1707178338 None] Created reservations ['71ac94cf-6add-4381-924c-f91126ccd203', 'e0c04761-0a57-49e0-8bcf-bd03ed43831d', '92533708-d71b-45ae-be87-5bafe2dfb914', '6309f10d-38bb-483a-99c4-b52a19dd2c1d'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:31:08.677713 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-62527153-fc17-4699-8579-ba003c186410 tempest-TaggedBootDevicesTest_v242-1707178338 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:31:08.725444 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-62527153-fc17-4699-8579-ba003c186410 tempest-TaggedBootDevicesTest_v242-1707178338 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:31:08.790415 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-62527153-fc17-4699-8579-ba003c186410 tempest-TaggedBootDevicesTest_v242-1707178338 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:31:08.804415 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-62527153-fc17-4699-8579-ba003c186410 tempest-TaggedBootDevicesTest_v242-1707178338 None] Deleted volume successfully. Dec 25 21:31:08.881486 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-62527153-fc17-4699-8579-ba003c186410 tempest-TaggedBootDevicesTest_v242-1707178338 None] Lock "b'cinder-a5c1ad6f-a4c5-4f08-a59c-fa1afed02065-delete_volume'" released by "delete_volume" :: held 14.303s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:31:12.169697 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-7cba3770-5ca7-46c9-a7ec-7fa376e302c3 tempest-VolumesDeleteCascade-183328448 None] Created reservations ['e12f3a09-35ef-4ea9-b611-282625181f2d', 'bc954208-6c8b-400f-8920-3f7fcf7e6ec2', '932b3e81-337d-4631-850b-60a3280407eb', '1e2820f3-56b8-495f-a347-9157b5321816'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:31:12.374386 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-7cba3770-5ca7-46c9-a7ec-7fa376e302c3 tempest-VolumesDeleteCascade-183328448 None] Delete snapshot completed successfully. Dec 25 21:31:12.380618 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-7cba3770-5ca7-46c9-a7ec-7fa376e302c3 tempest-VolumesDeleteCascade-183328448 None] Lock "b'cinder-8340d2cb-8d21-459f-a35e-e080f72a94c3-delete_snapshot'" released by "delete_snapshot" :: held 4.168s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:31:12.392713 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-7cba3770-5ca7-46c9-a7ec-7fa376e302c3 tempest-VolumesDeleteCascade-183328448 None] Lock "b'cinder-8c0201ef-8cd4-4002-acbf-43cfbc1bf90e-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:31:12.417603 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7cba3770-5ca7-46c9-a7ec-7fa376e302c3 tempest-VolumesDeleteCascade-183328448 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:31:17.031805 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-7cba3770-5ca7-46c9-a7ec-7fa376e302c3 tempest-VolumesDeleteCascade-183328448 None] Created reservations ['1c8f9abf-8f57-4987-8c31-e42b215ea4a7', '924678f4-dc6a-4d01-b261-54ece92840a7', 'c8e082ea-5117-4ff0-8e13-8cd3a2138340', '50cda0d2-2fd3-41ad-8db7-ee09fc460395'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:31:17.271647 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-7cba3770-5ca7-46c9-a7ec-7fa376e302c3 tempest-VolumesDeleteCascade-183328448 None] Delete snapshot completed successfully. Dec 25 21:31:17.281145 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-7cba3770-5ca7-46c9-a7ec-7fa376e302c3 tempest-VolumesDeleteCascade-183328448 None] Lock "b'cinder-8c0201ef-8cd4-4002-acbf-43cfbc1bf90e-delete_snapshot'" released by "delete_snapshot" :: held 4.886s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:31:17.281145 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-7cba3770-5ca7-46c9-a7ec-7fa376e302c3 tempest-VolumesDeleteCascade-183328448 None] Snapshots deleted, issuing volume delete {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/manager.py:974}} Dec 25 21:31:17.281145 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7cba3770-5ca7-46c9-a7ec-7fa376e302c3 tempest-VolumesDeleteCascade-183328448 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:31:17.590639 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7cba3770-5ca7-46c9-a7ec-7fa376e302c3 tempest-VolumesDeleteCascade-183328448 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:31:17.591205 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7cba3770-5ca7-46c9-a7ec-7fa376e302c3 tempest-VolumesDeleteCascade-183328448 None] Volume volume-381eb2bd-5ba6-4c05-91ff-978607ac6a78 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:31:18.163077 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7cba3770-5ca7-46c9-a7ec-7fa376e302c3 tempest-VolumesDeleteCascade-183328448 None] deleting rbd volume volume-381eb2bd-5ba6-4c05-91ff-978607ac6a78 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:31:21.147757 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-0084b23f-37c3-4e09-a273-f9c514d12eea tempest-VolumesActionsTest-1540518602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:31:21.152660 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-0084b23f-37c3-4e09-a273-f9c514d12eea tempest-VolumesActionsTest-1540518602 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:31:21.154050 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-0084b23f-37c3-4e09-a273-f9c514d12eea tempest-VolumesActionsTest-1540518602 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:31:21.211800 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0084b23f-37c3-4e09-a273-f9c514d12eea tempest-VolumesActionsTest-1540518602 None] Flow 'volume_create_manager' (927b888e-a429-4d2b-8820-d5be52c8bbd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:31:21.215710 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0084b23f-37c3-4e09-a273-f9c514d12eea tempest-VolumesActionsTest-1540518602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41ea57ca-6163-4b8d-8bdf-5bb9b7ca96ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:31:21.224564 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-0084b23f-37c3-4e09-a273-f9c514d12eea tempest-VolumesActionsTest-1540518602 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:31:21.245393 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0084b23f-37c3-4e09-a273-f9c514d12eea tempest-VolumesActionsTest-1540518602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41ea57ca-6163-4b8d-8bdf-5bb9b7ca96ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:31:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1066721292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=41f6d481-75b9-4ac9-aa97-c3a0f02dd0cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ece5e5ef72d4614b89456ee37fe94f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:31:21Z,use_quota=True,user_id='0af5c61e37b747608ee6af2f8f75f412',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:31:21.250373 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0084b23f-37c3-4e09-a273-f9c514d12eea tempest-VolumesActionsTest-1540518602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcc90521-e2a0-4f0a-9228-e0526f3fca85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:31:21.253734 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0084b23f-37c3-4e09-a273-f9c514d12eea tempest-VolumesActionsTest-1540518602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcc90521-e2a0-4f0a-9228-e0526f3fca85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:31:21.259452 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0084b23f-37c3-4e09-a273-f9c514d12eea tempest-VolumesActionsTest-1540518602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdde1665-275e-48ce-806c-7fd68a966a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:31:21.260760 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0084b23f-37c3-4e09-a273-f9c514d12eea tempest-VolumesActionsTest-1540518602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdde1665-275e-48ce-806c-7fd68a966a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41f6d481-75b9-4ac9-aa97-c3a0f02dd0cc', 'volume_name': 'volume-41f6d481-75b9-4ac9-aa97-c3a0f02dd0cc', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:31:21.263823 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0084b23f-37c3-4e09-a273-f9c514d12eea tempest-VolumesActionsTest-1540518602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1c536b5-fac1-4ea6-bec6-7959a19a635c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:31:21.266668 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0084b23f-37c3-4e09-a273-f9c514d12eea tempest-VolumesActionsTest-1540518602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1c536b5-fac1-4ea6-bec6-7959a19a635c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:31:21.270734 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0084b23f-37c3-4e09-a273-f9c514d12eea tempest-VolumesActionsTest-1540518602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c1bb6d2-549f-4fd7-bcd0-60bc9d5e5e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:31:21.273611 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-0084b23f-37c3-4e09-a273-f9c514d12eea tempest-VolumesActionsTest-1540518602 None] Volume 41f6d481-75b9-4ac9-aa97-c3a0f02dd0cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41f6d481-75b9-4ac9-aa97-c3a0f02dd0cc', 'volume_size': 1} Dec 25 21:31:21.274010 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0084b23f-37c3-4e09-a273-f9c514d12eea tempest-VolumesActionsTest-1540518602 None] creating volume 'volume-41f6d481-75b9-4ac9-aa97-c3a0f02dd0cc' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:31:21.277505 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0084b23f-37c3-4e09-a273-f9c514d12eea tempest-VolumesActionsTest-1540518602 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:31:22.802009 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0084b23f-37c3-4e09-a273-f9c514d12eea tempest-VolumesActionsTest-1540518602 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:31:22.805280 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0084b23f-37c3-4e09-a273-f9c514d12eea tempest-VolumesActionsTest-1540518602 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:31:22.805280 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0084b23f-37c3-4e09-a273-f9c514d12eea tempest-VolumesActionsTest-1540518602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c1bb6d2-549f-4fd7-bcd0-60bc9d5e5e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41f6d481-75b9-4ac9-aa97-c3a0f02dd0cc', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:31:22.806556 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0084b23f-37c3-4e09-a273-f9c514d12eea tempest-VolumesActionsTest-1540518602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (836f0dda-3be9-4896-8fff-567ab5fd3033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:31:22.864739 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-0084b23f-37c3-4e09-a273-f9c514d12eea tempest-VolumesActionsTest-1540518602 None] Volume volume-41f6d481-75b9-4ac9-aa97-c3a0f02dd0cc (41f6d481-75b9-4ac9-aa97-c3a0f02dd0cc): created successfully Dec 25 21:31:22.867038 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0084b23f-37c3-4e09-a273-f9c514d12eea tempest-VolumesActionsTest-1540518602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (836f0dda-3be9-4896-8fff-567ab5fd3033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:31:22.870587 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0084b23f-37c3-4e09-a273-f9c514d12eea tempest-VolumesActionsTest-1540518602 None] Flow 'volume_create_manager' (927b888e-a429-4d2b-8820-d5be52c8bbd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:31:22.962660 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-0084b23f-37c3-4e09-a273-f9c514d12eea tempest-VolumesActionsTest-1540518602 None] Created volume successfully. Dec 25 21:31:25.419374 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-7cba3770-5ca7-46c9-a7ec-7fa376e302c3 tempest-VolumesDeleteCascade-183328448 None] Created reservations ['91e1111e-1c91-4c4d-afa2-7d1a3ccb7f2a', 'f1f2c7c5-a525-4c71-8519-4c8916c32ffe', 'e617db84-a8cb-4786-bedf-82b592685ad2', 'c807f47d-3405-4525-9e6c-2db892673259'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:31:25.631574 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7cba3770-5ca7-46c9-a7ec-7fa376e302c3 tempest-VolumesDeleteCascade-183328448 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:31:25.714045 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7cba3770-5ca7-46c9-a7ec-7fa376e302c3 tempest-VolumesDeleteCascade-183328448 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:31:25.847923 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-7cba3770-5ca7-46c9-a7ec-7fa376e302c3 tempest-VolumesDeleteCascade-183328448 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:31:25.857438 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-7cba3770-5ca7-46c9-a7ec-7fa376e302c3 tempest-VolumesDeleteCascade-183328448 None] Deleted volume successfully. Dec 25 21:31:25.986758 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-7cba3770-5ca7-46c9-a7ec-7fa376e302c3 tempest-VolumesDeleteCascade-183328448 None] Lock "b'cinder-381eb2bd-5ba6-4c05-91ff-978607ac6a78-delete_volume'" released by "delete_volume" :: held 17.957s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:31:31.724490 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-93826e5b-ec21-44dd-98f0-87a27549dafd tempest-VolumesNegativeTest-763913042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:31:31.732121 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-93826e5b-ec21-44dd-98f0-87a27549dafd tempest-VolumesNegativeTest-763913042 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:31:31.734314 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-93826e5b-ec21-44dd-98f0-87a27549dafd tempest-VolumesNegativeTest-763913042 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:31:31.752246 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-93826e5b-ec21-44dd-98f0-87a27549dafd tempest-VolumesNegativeTest-763913042 None] Flow 'volume_create_manager' (fa5612a6-627e-418e-898e-bae1916c250a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:31:31.755793 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-93826e5b-ec21-44dd-98f0-87a27549dafd tempest-VolumesNegativeTest-763913042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd9fa5e6-9fc8-472b-a1aa-c4241e523fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:31:31.762654 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-93826e5b-ec21-44dd-98f0-87a27549dafd tempest-VolumesNegativeTest-763913042 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:31:31.780027 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-93826e5b-ec21-44dd-98f0-87a27549dafd tempest-VolumesNegativeTest-763913042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd9fa5e6-9fc8-472b-a1aa-c4241e523fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-51797637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b1a60fbc-e864-4975-9321-44e85c28435b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b4189d0115b4d849f8f9bce9deef49f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:31:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:31:32Z,use_quota=True,user_id='c2b731b2ca634360afda4cfc55acc81f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:31:31.784666 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-93826e5b-ec21-44dd-98f0-87a27549dafd tempest-VolumesNegativeTest-763913042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90fa3d9c-bea8-4a57-9f85-58f102cb3165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:31:31.787986 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-93826e5b-ec21-44dd-98f0-87a27549dafd tempest-VolumesNegativeTest-763913042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90fa3d9c-bea8-4a57-9f85-58f102cb3165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:31:31.790788 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-93826e5b-ec21-44dd-98f0-87a27549dafd tempest-VolumesNegativeTest-763913042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aff0f25-59da-4f6d-a677-5ab4ef131061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:31:31.793486 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-93826e5b-ec21-44dd-98f0-87a27549dafd tempest-VolumesNegativeTest-763913042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aff0f25-59da-4f6d-a677-5ab4ef131061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1a60fbc-e864-4975-9321-44e85c28435b', 'volume_name': 'volume-b1a60fbc-e864-4975-9321-44e85c28435b', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:31:31.796240 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-93826e5b-ec21-44dd-98f0-87a27549dafd tempest-VolumesNegativeTest-763913042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d27011ad-5f6a-4ff8-969f-d74fddba75e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:31:31.798705 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-93826e5b-ec21-44dd-98f0-87a27549dafd tempest-VolumesNegativeTest-763913042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d27011ad-5f6a-4ff8-969f-d74fddba75e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:31:31.802267 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-93826e5b-ec21-44dd-98f0-87a27549dafd tempest-VolumesNegativeTest-763913042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05d1972c-2ab1-47d4-9fe8-839db8f9ade6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:31:31.803332 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-93826e5b-ec21-44dd-98f0-87a27549dafd tempest-VolumesNegativeTest-763913042 None] Volume b1a60fbc-e864-4975-9321-44e85c28435b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1a60fbc-e864-4975-9321-44e85c28435b', 'volume_size': 1} Dec 25 21:31:31.803882 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-93826e5b-ec21-44dd-98f0-87a27549dafd tempest-VolumesNegativeTest-763913042 None] creating volume 'volume-b1a60fbc-e864-4975-9321-44e85c28435b' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:31:31.805115 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-93826e5b-ec21-44dd-98f0-87a27549dafd tempest-VolumesNegativeTest-763913042 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:31:32.051124 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:31:32.052424 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:31:32.089761 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:31:32.148070 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:31:32.758045 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-93826e5b-ec21-44dd-98f0-87a27549dafd tempest-VolumesNegativeTest-763913042 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:31:32.759062 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-93826e5b-ec21-44dd-98f0-87a27549dafd tempest-VolumesNegativeTest-763913042 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:31:32.762035 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-93826e5b-ec21-44dd-98f0-87a27549dafd tempest-VolumesNegativeTest-763913042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05d1972c-2ab1-47d4-9fe8-839db8f9ade6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1a60fbc-e864-4975-9321-44e85c28435b', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:31:32.766815 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-93826e5b-ec21-44dd-98f0-87a27549dafd tempest-VolumesNegativeTest-763913042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb8111c7-8604-4133-bac1-ec5142f5e3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:31:32.871353 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-93826e5b-ec21-44dd-98f0-87a27549dafd tempest-VolumesNegativeTest-763913042 None] Volume volume-b1a60fbc-e864-4975-9321-44e85c28435b (b1a60fbc-e864-4975-9321-44e85c28435b): created successfully Dec 25 21:31:32.873385 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-93826e5b-ec21-44dd-98f0-87a27549dafd tempest-VolumesNegativeTest-763913042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb8111c7-8604-4133-bac1-ec5142f5e3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:31:32.876561 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-93826e5b-ec21-44dd-98f0-87a27549dafd tempest-VolumesNegativeTest-763913042 None] Flow 'volume_create_manager' (fa5612a6-627e-418e-898e-bae1916c250a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:31:33.024566 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-93826e5b-ec21-44dd-98f0-87a27549dafd tempest-VolumesNegativeTest-763913042 None] Created volume successfully. Dec 25 21:31:35.321079 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f78efa5-f2a2-4cf6-8027-05ef20b9a21e tempest-TestVolumeBootPattern-1499667379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:31:35.325565 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-0f78efa5-f2a2-4cf6-8027-05ef20b9a21e tempest-TestVolumeBootPattern-1499667379 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:31:35.326122 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-0f78efa5-f2a2-4cf6-8027-05ef20b9a21e tempest-TestVolumeBootPattern-1499667379 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:31:35.355446 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0f78efa5-f2a2-4cf6-8027-05ef20b9a21e tempest-TestVolumeBootPattern-1499667379 None] Flow 'volume_create_manager' (2566e067-618e-4d7b-b75d-0ad1ae3b0c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:31:35.378004 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0f78efa5-f2a2-4cf6-8027-05ef20b9a21e tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6785d81a-10a9-4e2d-9e7e-6fa8d2472a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:31:35.386141 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-0f78efa5-f2a2-4cf6-8027-05ef20b9a21e tempest-TestVolumeBootPattern-1499667379 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:31:35.405214 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0f78efa5-f2a2-4cf6-8027-05ef20b9a21e tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6785d81a-10a9-4e2d-9e7e-6fa8d2472a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1840809257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d3859288-1717-450f-aa47-2e8e44a2382e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c77dc74a46d64a67991d82bf12adb1dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:31:35Z,use_quota=True,user_id='171c198b6b734cd698b3c1eaf76a0234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:31:35.408790 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0f78efa5-f2a2-4cf6-8027-05ef20b9a21e tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c29420f-6048-4cd5-b0d8-3bd143546039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:31:35.411401 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0f78efa5-f2a2-4cf6-8027-05ef20b9a21e tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c29420f-6048-4cd5-b0d8-3bd143546039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:31:35.414878 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0f78efa5-f2a2-4cf6-8027-05ef20b9a21e tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9485655a-f373-43e6-9131-eb08c204b86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:31:35.584192 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0f78efa5-f2a2-4cf6-8027-05ef20b9a21e tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9485655a-f373-43e6-9131-eb08c204b86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd3859288-1717-450f-aa47-2e8e44a2382e', 'volume_name': 'volume-d3859288-1717-450f-aa47-2e8e44a2382e', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:31:35.588061 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0f78efa5-f2a2-4cf6-8027-05ef20b9a21e tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cabdc71-faad-46d7-a7d5-71e306113709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:31:35.600468 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0f78efa5-f2a2-4cf6-8027-05ef20b9a21e tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cabdc71-faad-46d7-a7d5-71e306113709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:31:35.604053 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0f78efa5-f2a2-4cf6-8027-05ef20b9a21e tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (593d81f9-06b3-4568-81f5-28a5f3635829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:31:35.606007 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-0f78efa5-f2a2-4cf6-8027-05ef20b9a21e tempest-TestVolumeBootPattern-1499667379 None] Volume d3859288-1717-450f-aa47-2e8e44a2382e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d3859288-1717-450f-aa47-2e8e44a2382e', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 25 21:31:35.612117 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f78efa5-f2a2-4cf6-8027-05ef20b9a21e tempest-TestVolumeBootPattern-1499667379 None] Cloning d3859288-1717-450f-aa47-2e8e44a2382e from image aca914d0-5f7b-465f-a024-75efa27d7291 at location (None, None). {{(pid=129926) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Dec 25 21:31:35.637362 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-0f78efa5-f2a2-4cf6-8027-05ef20b9a21e tempest-TestVolumeBootPattern-1499667379 None] Lock "b'cinder-aca914d0-5f7b-465f-a024-75efa27d7291'" acquired by "_prepare_image_cache_entry" :: waited 0.028s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:31:35.791091 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-0f78efa5-f2a2-4cf6-8027-05ef20b9a21e tempest-TestVolumeBootPattern-1499667379 None] Found image-volume cache entry: {'id': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'volume_id': '058f5fb3-51e4-40e3-9c98-542207f1fc1f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31), 'last_used': datetime.datetime(2021, 12, 25, 21, 31, 35, 650139)}. {{(pid=129926) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 25 21:31:35.791675 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-0f78efa5-f2a2-4cf6-8027-05ef20b9a21e tempest-TestVolumeBootPattern-1499667379 None] Image-volume cache entry image_update_at = 2021-12-25 20:58:31+00:00, requested image updated_at = 2021-12-25 20:58:31+00:00. {{(pid=129926) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 25 21:31:35.794567 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f78efa5-f2a2-4cf6-8027-05ef20b9a21e tempest-TestVolumeBootPattern-1499667379 None] Found cache entry for image = aca914d0-5f7b-465f-a024-75efa27d7291 on host ncdv-master-1@ceph#ceph. {{(pid=129926) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Dec 25 21:31:35.797849 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-0f78efa5-f2a2-4cf6-8027-05ef20b9a21e tempest-TestVolumeBootPattern-1499667379 None] Lock "b'cinder-aca914d0-5f7b-465f-a024-75efa27d7291'" released by "_prepare_image_cache_entry" :: held 0.162s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:31:35.799953 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f78efa5-f2a2-4cf6-8027-05ef20b9a21e tempest-TestVolumeBootPattern-1499667379 None] Attempting to retrieve cache entry for image = aca914d0-5f7b-465f-a024-75efa27d7291 on host ncdv-master-1@ceph#ceph. {{(pid=129926) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Dec 25 21:31:35.819705 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-0f78efa5-f2a2-4cf6-8027-05ef20b9a21e tempest-TestVolumeBootPattern-1499667379 None] Found image-volume cache entry: {'id': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'volume_id': '058f5fb3-51e4-40e3-9c98-542207f1fc1f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31), 'last_used': datetime.datetime(2021, 12, 25, 21, 31, 35, 814188)}. {{(pid=129926) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 25 21:31:35.820395 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-0f78efa5-f2a2-4cf6-8027-05ef20b9a21e tempest-TestVolumeBootPattern-1499667379 None] Image-volume cache entry image_update_at = 2021-12-25 20:58:31+00:00, requested image updated_at = 2021-12-25 20:58:31+00:00. {{(pid=129926) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 25 21:31:35.823306 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f78efa5-f2a2-4cf6-8027-05ef20b9a21e tempest-TestVolumeBootPattern-1499667379 None] Creating from source image-volume 058f5fb3-51e4-40e3-9c98-542207f1fc1f {{(pid=129926) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Dec 25 21:31:35.857569 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0f78efa5-f2a2-4cf6-8027-05ef20b9a21e tempest-TestVolumeBootPattern-1499667379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:31:36.237388 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0f78efa5-f2a2-4cf6-8027-05ef20b9a21e tempest-TestVolumeBootPattern-1499667379 None] creating snapshot='volume-d3859288-1717-450f-aa47-2e8e44a2382e.clone_snap' {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 25 21:31:38.459830 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0f78efa5-f2a2-4cf6-8027-05ef20b9a21e tempest-TestVolumeBootPattern-1499667379 None] cloning 'volume-058f5fb3-51e4-40e3-9c98-542207f1fc1f@volume-d3859288-1717-450f-aa47-2e8e44a2382e.clone_snap' to 'volume-d3859288-1717-450f-aa47-2e8e44a2382e' {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 25 21:31:40.698151 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0f78efa5-f2a2-4cf6-8027-05ef20b9a21e tempest-TestVolumeBootPattern-1499667379 None] Volume volume-98b6d31e-e760-499e-8962-7b22479c1e9a.deleted is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:31:40.700152 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0f78efa5-f2a2-4cf6-8027-05ef20b9a21e tempest-TestVolumeBootPattern-1499667379 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:31:40.700747 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0f78efa5-f2a2-4cf6-8027-05ef20b9a21e tempest-TestVolumeBootPattern-1499667379 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:31:41.498344 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0f78efa5-f2a2-4cf6-8027-05ef20b9a21e tempest-TestVolumeBootPattern-1499667379 None] clone created successfully {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 25 21:31:41.499102 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.volume_utils [None req-0f78efa5-f2a2-4cf6-8027-05ef20b9a21e tempest-TestVolumeBootPattern-1499667379 None] Marking volume d3859288-1717-450f-aa47-2e8e44a2382e as bootable. {{(pid=129926) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 25 21:31:41.660481 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f78efa5-f2a2-4cf6-8027-05ef20b9a21e tempest-TestVolumeBootPattern-1499667379 None] Copying metadata from image aca914d0-5f7b-465f-a024-75efa27d7291 to d3859288-1717-450f-aa47-2e8e44a2382e. {{(pid=129926) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Dec 25 21:31:41.661170 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f78efa5-f2a2-4cf6-8027-05ef20b9a21e tempest-TestVolumeBootPattern-1499667379 None] Creating volume glance metadata for volume d3859288-1717-450f-aa47-2e8e44a2382e backed by image aca914d0-5f7b-465f-a024-75efa27d7291 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129926) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Dec 25 21:31:41.981379 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0f78efa5-f2a2-4cf6-8027-05ef20b9a21e tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (593d81f9-06b3-4568-81f5-28a5f3635829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3859288-1717-450f-aa47-2e8e44a2382e', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:31:41.984550 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0f78efa5-f2a2-4cf6-8027-05ef20b9a21e tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21c91e41-7534-4e69-9407-06e967204848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:31:42.054635 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-0f78efa5-f2a2-4cf6-8027-05ef20b9a21e tempest-TestVolumeBootPattern-1499667379 None] Volume volume-d3859288-1717-450f-aa47-2e8e44a2382e (d3859288-1717-450f-aa47-2e8e44a2382e): created successfully Dec 25 21:31:42.066248 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0f78efa5-f2a2-4cf6-8027-05ef20b9a21e tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21c91e41-7534-4e69-9407-06e967204848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:31:42.078314 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0f78efa5-f2a2-4cf6-8027-05ef20b9a21e tempest-TestVolumeBootPattern-1499667379 None] Flow 'volume_create_manager' (2566e067-618e-4d7b-b75d-0ad1ae3b0c3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:31:42.183006 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-0f78efa5-f2a2-4cf6-8027-05ef20b9a21e tempest-TestVolumeBootPattern-1499667379 None] Created volume successfully. Dec 25 21:31:43.344912 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-4cd6cd63-fec7-4034-8802-c13473a45ab5 tempest-TestVolumeBootPattern-1499667379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:31:46.900435 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-df9f1a3d-5338-4404-9908-cd97d1509d67 tempest-VolumesActionsTest-1540518602 None] Lock "b'cinder-41f6d481-75b9-4ac9-aa97-c3a0f02dd0cc'" acquired by "attach_volume" :: waited 0.010s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:31:47.139565 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-df9f1a3d-5338-4404-9908-cd97d1509d67 tempest-VolumesActionsTest-1540518602 None] Attaching volume 41f6d481-75b9-4ac9-aa97-c3a0f02dd0cc to instance ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294 at mountpoint /dev/sdb on host None. Dec 25 21:31:47.249030 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-df9f1a3d-5338-4404-9908-cd97d1509d67 tempest-VolumesActionsTest-1540518602 None] Attach volume completed successfully. Dec 25 21:31:47.284634 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-df9f1a3d-5338-4404-9908-cd97d1509d67 tempest-VolumesActionsTest-1540518602 None] Lock "b'cinder-41f6d481-75b9-4ac9-aa97-c3a0f02dd0cc'" released by "attach_volume" :: held 0.384s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:31:47.457015 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-5e4e85a3-c0a0-4a08-b5b5-e536c47a1e49 tempest-VolumesActionsTest-1540518602 None] Lock "b'cinder-41f6d481-75b9-4ac9-aa97-c3a0f02dd0cc-detach_volume'" acquired by "detach_volume" :: waited 0.020s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:31:47.457737 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-5e4e85a3-c0a0-4a08-b5b5-e536c47a1e49 tempest-VolumesActionsTest-1540518602 None] Detaching volume 41f6d481-75b9-4ac9-aa97-c3a0f02dd0cc from instance ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294. Dec 25 21:31:47.615649 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-4cd6cd63-fec7-4034-8802-c13473a45ab5 tempest-TestVolumeBootPattern-1499667379 None] Create snapshot completed successfully Dec 25 21:31:47.700232 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-5e4e85a3-c0a0-4a08-b5b5-e536c47a1e49 tempest-VolumesActionsTest-1540518602 None] Detach volume completed successfully. Dec 25 21:31:47.708302 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-5e4e85a3-c0a0-4a08-b5b5-e536c47a1e49 tempest-VolumesActionsTest-1540518602 None] Lock "b'cinder-41f6d481-75b9-4ac9-aa97-c3a0f02dd0cc-detach_volume'" released by "detach_volume" :: held 0.252s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:31:53.591787 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e37ff85-d0e7-4c84-ad46-9dd517fd9b6e tempest-VolumeTypesTest-2133865962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:31:53.596256 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-5e37ff85-d0e7-4c84-ad46-9dd517fd9b6e tempest-VolumeTypesTest-2133865962 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:31:53.596755 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-5e37ff85-d0e7-4c84-ad46-9dd517fd9b6e tempest-VolumeTypesTest-2133865962 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:31:53.609744 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5e37ff85-d0e7-4c84-ad46-9dd517fd9b6e tempest-VolumeTypesTest-2133865962 None] Flow 'volume_create_manager' (36af8104-0982-4cb4-a66d-8b7873345d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:31:53.614575 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5e37ff85-d0e7-4c84-ad46-9dd517fd9b6e tempest-VolumeTypesTest-2133865962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68001306-ba47-423e-ac27-5c36c819aaf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:31:53.621098 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-5e37ff85-d0e7-4c84-ad46-9dd517fd9b6e tempest-VolumeTypesTest-2133865962 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:31:53.635211 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5e37ff85-d0e7-4c84-ad46-9dd517fd9b6e tempest-VolumeTypesTest-2133865962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68001306-ba47-423e-ac27-5c36c819aaf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:31:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-451443140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c0c4c54f-cea7-4051-8ddd-b0f16f025c2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed197c5baf3c48e6a12fd9ff053dff10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:31:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:31:53Z,use_quota=True,user_id='533e0f997248410b8a86adec8d647c67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d1ed154-ecdf-444a-b25b-9e36100ea38e),volume_type_id=9d1ed154-ecdf-444a-b25b-9e36100ea38e)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:31:53.637357 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5e37ff85-d0e7-4c84-ad46-9dd517fd9b6e tempest-VolumeTypesTest-2133865962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (660fc4d5-e6f3-4b32-9168-ed48c2e4f5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:31:53.640066 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5e37ff85-d0e7-4c84-ad46-9dd517fd9b6e tempest-VolumeTypesTest-2133865962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (660fc4d5-e6f3-4b32-9168-ed48c2e4f5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:31:53.644188 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5e37ff85-d0e7-4c84-ad46-9dd517fd9b6e tempest-VolumeTypesTest-2133865962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4566aec-8ce6-41d0-b77c-82b1ce4209ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:31:53.646695 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5e37ff85-d0e7-4c84-ad46-9dd517fd9b6e tempest-VolumeTypesTest-2133865962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4566aec-8ce6-41d0-b77c-82b1ce4209ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0c4c54f-cea7-4051-8ddd-b0f16f025c2c', 'volume_name': 'volume-c0c4c54f-cea7-4051-8ddd-b0f16f025c2c', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:31:53.649275 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5e37ff85-d0e7-4c84-ad46-9dd517fd9b6e tempest-VolumeTypesTest-2133865962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c39ca7e4-95de-4216-a37f-ff8dd3442797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:31:53.652167 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5e37ff85-d0e7-4c84-ad46-9dd517fd9b6e tempest-VolumeTypesTest-2133865962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c39ca7e4-95de-4216-a37f-ff8dd3442797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:31:53.654811 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5e37ff85-d0e7-4c84-ad46-9dd517fd9b6e tempest-VolumeTypesTest-2133865962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7bab708-bc14-4bf0-a7a0-f398f9f35533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:31:53.655833 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-5e37ff85-d0e7-4c84-ad46-9dd517fd9b6e tempest-VolumeTypesTest-2133865962 None] Volume c0c4c54f-cea7-4051-8ddd-b0f16f025c2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0c4c54f-cea7-4051-8ddd-b0f16f025c2c', 'volume_size': 1} Dec 25 21:31:53.656435 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-5e37ff85-d0e7-4c84-ad46-9dd517fd9b6e tempest-VolumeTypesTest-2133865962 None] creating volume 'volume-c0c4c54f-cea7-4051-8ddd-b0f16f025c2c' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:31:53.658709 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-5e37ff85-d0e7-4c84-ad46-9dd517fd9b6e tempest-VolumeTypesTest-2133865962 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:31:54.789968 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-5e37ff85-d0e7-4c84-ad46-9dd517fd9b6e tempest-VolumeTypesTest-2133865962 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:31:54.791398 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-5e37ff85-d0e7-4c84-ad46-9dd517fd9b6e tempest-VolumeTypesTest-2133865962 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:31:54.794268 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5e37ff85-d0e7-4c84-ad46-9dd517fd9b6e tempest-VolumeTypesTest-2133865962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7bab708-bc14-4bf0-a7a0-f398f9f35533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0c4c54f-cea7-4051-8ddd-b0f16f025c2c', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:31:54.798555 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5e37ff85-d0e7-4c84-ad46-9dd517fd9b6e tempest-VolumeTypesTest-2133865962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ee7a839-4502-48f6-a3fc-10bdd06b71d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:31:54.893554 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-5e37ff85-d0e7-4c84-ad46-9dd517fd9b6e tempest-VolumeTypesTest-2133865962 None] Volume volume-c0c4c54f-cea7-4051-8ddd-b0f16f025c2c (c0c4c54f-cea7-4051-8ddd-b0f16f025c2c): created successfully Dec 25 21:31:54.895680 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5e37ff85-d0e7-4c84-ad46-9dd517fd9b6e tempest-VolumeTypesTest-2133865962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ee7a839-4502-48f6-a3fc-10bdd06b71d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:31:54.899151 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5e37ff85-d0e7-4c84-ad46-9dd517fd9b6e tempest-VolumeTypesTest-2133865962 None] Flow 'volume_create_manager' (36af8104-0982-4cb4-a66d-8b7873345d7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:31:55.029501 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-5e37ff85-d0e7-4c84-ad46-9dd517fd9b6e tempest-VolumeTypesTest-2133865962 None] Created volume successfully. Dec 25 21:31:56.517733 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d req-97991cc4-8e1c-48e5-aa9c-5110d4e0381c tempest-TestVolumeBootPattern-1499667379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:31:56.521384 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d req-97991cc4-8e1c-48e5-aa9c-5110d4e0381c tempest-TestVolumeBootPattern-1499667379 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:31:56.522020 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d req-97991cc4-8e1c-48e5-aa9c-5110d4e0381c tempest-TestVolumeBootPattern-1499667379 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:31:56.559553 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d req-97991cc4-8e1c-48e5-aa9c-5110d4e0381c tempest-TestVolumeBootPattern-1499667379 None] Flow 'volume_create_manager' (318dbbce-6707-4d29-8102-de3f755a8836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:31:56.559553 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d req-97991cc4-8e1c-48e5-aa9c-5110d4e0381c tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96afc40a-7236-49e0-ab0d-a8b091efce68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:31:56.564794 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d req-97991cc4-8e1c-48e5-aa9c-5110d4e0381c tempest-TestVolumeBootPattern-1499667379 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:31:56.578550 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d req-97991cc4-8e1c-48e5-aa9c-5110d4e0381c tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96afc40a-7236-49e0-ab0d-a8b091efce68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:31:56Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=60287979-54be-4064-9dab-ee0d101371d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c77dc74a46d64a67991d82bf12adb1dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cc684306-48c1-4377-9775-39fc12aed847,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:31:56Z,use_quota=True,user_id='171c198b6b734cd698b3c1eaf76a0234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:31:56.582303 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d req-97991cc4-8e1c-48e5-aa9c-5110d4e0381c tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76b4f825-6c0c-4b66-ba03-db1396d09d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:31:56.588298 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d req-97991cc4-8e1c-48e5-aa9c-5110d4e0381c tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76b4f825-6c0c-4b66-ba03-db1396d09d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:31:56.588298 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d req-97991cc4-8e1c-48e5-aa9c-5110d4e0381c tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (277291a8-86cb-4042-b15d-2c9a49c135e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:31:56.589481 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d req-97991cc4-8e1c-48e5-aa9c-5110d4e0381c tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (277291a8-86cb-4042-b15d-2c9a49c135e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '60287979-54be-4064-9dab-ee0d101371d4', 'volume_name': 'volume-60287979-54be-4064-9dab-ee0d101371d4', 'volume_size': 1, 'snapshot_id': 'cc684306-48c1-4377-9775-39fc12aed847'}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:31:56.591878 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d req-97991cc4-8e1c-48e5-aa9c-5110d4e0381c tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be4bd881-d04a-4c10-9c70-51ecd2a88c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:31:56.594126 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d req-97991cc4-8e1c-48e5-aa9c-5110d4e0381c tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be4bd881-d04a-4c10-9c70-51ecd2a88c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:31:56.597290 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d req-97991cc4-8e1c-48e5-aa9c-5110d4e0381c tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9caef936-ceef-4dd7-aa0a-e7ef7098508e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:31:56.598242 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d req-97991cc4-8e1c-48e5-aa9c-5110d4e0381c tempest-TestVolumeBootPattern-1499667379 None] Volume 60287979-54be-4064-9dab-ee0d101371d4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-60287979-54be-4064-9dab-ee0d101371d4', 'volume_size': 1, 'snapshot_id': 'cc684306-48c1-4377-9775-39fc12aed847'} Dec 25 21:31:56.685340 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d req-97991cc4-8e1c-48e5-aa9c-5110d4e0381c tempest-TestVolumeBootPattern-1499667379 None] cloning volumes/volume-d3859288-1717-450f-aa47-2e8e44a2382e@snapshot-cc684306-48c1-4377-9775-39fc12aed847 to volume-60287979-54be-4064-9dab-ee0d101371d4 {{(pid=129926) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Dec 25 21:31:56.698961 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d req-97991cc4-8e1c-48e5-aa9c-5110d4e0381c tempest-TestVolumeBootPattern-1499667379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:31:56.783969 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d req-97991cc4-8e1c-48e5-aa9c-5110d4e0381c tempest-TestVolumeBootPattern-1499667379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:31:57.030442 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7c8d7fbb-39e4-43c0-9eb8-de6e447eaeb5 tempest-VolumeTypesTest-2133865962 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:31:57.081793 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7c8d7fbb-39e4-43c0-9eb8-de6e447eaeb5 tempest-VolumeTypesTest-2133865962 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:31:57.143367 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-7c8d7fbb-39e4-43c0-9eb8-de6e447eaeb5 tempest-VolumeTypesTest-2133865962 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:31:57.152969 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-7c8d7fbb-39e4-43c0-9eb8-de6e447eaeb5 tempest-VolumeTypesTest-2133865962 None] Retype volume completed successfully. Dec 25 21:31:58.943099 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d req-97991cc4-8e1c-48e5-aa9c-5110d4e0381c tempest-TestVolumeBootPattern-1499667379 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:31:58.943099 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d req-97991cc4-8e1c-48e5-aa9c-5110d4e0381c tempest-TestVolumeBootPattern-1499667379 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:31:58.974530 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d req-97991cc4-8e1c-48e5-aa9c-5110d4e0381c tempest-TestVolumeBootPattern-1499667379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:31:59.088689 ncdv-master-1 cinder-volume[129926]: WARNING cinder.volume.drivers.rbd [req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d req-97991cc4-8e1c-48e5-aa9c-5110d4e0381c tempest-TestVolumeBootPattern-1499667379 None] Not using v2 clone API, please upgrade to mimic+ and set the OSD minimum client compat version to mimic for better performance, fewer deletion issues Dec 25 21:31:59.126751 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.volume_utils [req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d req-97991cc4-8e1c-48e5-aa9c-5110d4e0381c tempest-TestVolumeBootPattern-1499667379 None] Marking volume 60287979-54be-4064-9dab-ee0d101371d4 as bootable. {{(pid=129926) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 25 21:31:59.182654 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d req-97991cc4-8e1c-48e5-aa9c-5110d4e0381c tempest-TestVolumeBootPattern-1499667379 None] Copying metadata from snapshot cc684306-48c1-4377-9775-39fc12aed847 to 60287979-54be-4064-9dab-ee0d101371d4. {{(pid=129926) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:422}} Dec 25 21:31:59.362290 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d req-97991cc4-8e1c-48e5-aa9c-5110d4e0381c tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9caef936-ceef-4dd7-aa0a-e7ef7098508e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60287979-54be-4064-9dab-ee0d101371d4', 'volume_size': 1, 'snapshot_id': 'cc684306-48c1-4377-9775-39fc12aed847'}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:31:59.365095 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d req-97991cc4-8e1c-48e5-aa9c-5110d4e0381c tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10bd09c3-94ec-4047-82ba-fbb81b2e99dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:31:59.502977 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d req-97991cc4-8e1c-48e5-aa9c-5110d4e0381c tempest-TestVolumeBootPattern-1499667379 None] Volume volume-60287979-54be-4064-9dab-ee0d101371d4 (60287979-54be-4064-9dab-ee0d101371d4): created successfully Dec 25 21:31:59.502977 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d req-97991cc4-8e1c-48e5-aa9c-5110d4e0381c tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10bd09c3-94ec-4047-82ba-fbb81b2e99dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:31:59.502977 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d req-97991cc4-8e1c-48e5-aa9c-5110d4e0381c tempest-TestVolumeBootPattern-1499667379 None] Flow 'volume_create_manager' (318dbbce-6707-4d29-8102-de3f755a8836) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:31:59.669891 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d req-97991cc4-8e1c-48e5-aa9c-5110d4e0381c tempest-TestVolumeBootPattern-1499667379 None] Created volume successfully. Dec 25 21:32:00.212969 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-737ae8e9-f09a-45ac-89fe-3533e589300b tempest-VolumeTypesTest-2133865962 None] Lock "b'cinder-c0c4c54f-cea7-4051-8ddd-b0f16f025c2c-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:32:00.324811 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-737ae8e9-f09a-45ac-89fe-3533e589300b tempest-VolumeTypesTest-2133865962 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:32:00.623699 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-737ae8e9-f09a-45ac-89fe-3533e589300b tempest-VolumeTypesTest-2133865962 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:32:00.624528 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-737ae8e9-f09a-45ac-89fe-3533e589300b tempest-VolumeTypesTest-2133865962 None] Volume volume-c0c4c54f-cea7-4051-8ddd-b0f16f025c2c is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:32:00.910829 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-737ae8e9-f09a-45ac-89fe-3533e589300b tempest-VolumeTypesTest-2133865962 None] deleting rbd volume volume-c0c4c54f-cea7-4051-8ddd-b0f16f025c2c {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:32:03.240658 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d req-91cad071-c271-4bbc-a855-94ddd6e4e5b0 tempest-TestVolumeBootPattern-1499667379 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:32:04.328528 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-f190de69-9b28-43cc-b30f-c891b8750870 tempest-VolumesNegativeTest-763913042 None] Lock "b'cinder-b1a60fbc-e864-4975-9321-44e85c28435b-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:32:04.435500 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d req-91cad071-c271-4bbc-a855-94ddd6e4e5b0 tempest-TestVolumeBootPattern-1499667379 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.195s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:32:04.436244 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d req-91cad071-c271-4bbc-a855-94ddd6e4e5b0 tempest-TestVolumeBootPattern-1499667379 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-60287979-54be-4064-9dab-ee0d101371d4', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': '60287979-54be-4064-9dab-ee0d101371d4', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 21:32:04.492728 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f190de69-9b28-43cc-b30f-c891b8750870 tempest-VolumesNegativeTest-763913042 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:32:04.957700 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f190de69-9b28-43cc-b30f-c891b8750870 tempest-VolumesNegativeTest-763913042 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:32:04.972368 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f190de69-9b28-43cc-b30f-c891b8750870 tempest-VolumesNegativeTest-763913042 None] Volume volume-b1a60fbc-e864-4975-9321-44e85c28435b is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:32:05.262394 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f190de69-9b28-43cc-b30f-c891b8750870 tempest-VolumesNegativeTest-763913042 None] deleting rbd volume volume-b1a60fbc-e864-4975-9321-44e85c28435b {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:32:05.362454 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d req-91cad071-c271-4bbc-a855-94ddd6e4e5b0 tempest-TestVolumeBootPattern-1499667379 None] Connection info returned from driver {'name': 'volumes/volume-60287979-54be-4064-9dab-ee0d101371d4', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '60287979-54be-4064-9dab-ee0d101371d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '377e018b-c708-4893-afe6-29884ccd250a'} {{(pid=129926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 25 21:32:05.522542 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d req-91cad071-c271-4bbc-a855-94ddd6e4e5b0 tempest-TestVolumeBootPattern-1499667379 None] attachment_update completed successfully. Dec 25 21:32:09.727949 ncdv-master-1 cinder-volume[129926]: WARNING cinder.quota [None req-737ae8e9-f09a-45ac-89fe-3533e589300b tempest-VolumeTypesTest-2133865962 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesTest-volume-type-100952230 is set by the default quota flag: quota_volumes_tempest-VolumeTypesTest-volume-type-100952230, it is now deprecated. Please use the default quota class for default quota. Dec 25 21:32:09.729590 ncdv-master-1 cinder-volume[129926]: WARNING cinder.quota [None req-737ae8e9-f09a-45ac-89fe-3533e589300b tempest-VolumeTypesTest-2133865962 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesTest-volume-type-100952230 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesTest-volume-type-100952230, it is now deprecated. Please use the default quota class for default quota. Dec 25 21:32:09.840584 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-737ae8e9-f09a-45ac-89fe-3533e589300b tempest-VolumeTypesTest-2133865962 None] Created reservations ['7b2a6365-805c-4358-9880-caf2668a24ef', '87bbf69b-33e2-4e64-9f41-1a540d664541', '968f20b3-8a5f-4be5-ad2c-83f35b8dafe2', 'e64745de-3926-40b7-ab59-b43d229db0fa'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:32:10.121462 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-737ae8e9-f09a-45ac-89fe-3533e589300b tempest-VolumeTypesTest-2133865962 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:32:10.213646 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-737ae8e9-f09a-45ac-89fe-3533e589300b tempest-VolumeTypesTest-2133865962 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:32:10.274041 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-737ae8e9-f09a-45ac-89fe-3533e589300b tempest-VolumeTypesTest-2133865962 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:32:10.279572 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-737ae8e9-f09a-45ac-89fe-3533e589300b tempest-VolumeTypesTest-2133865962 None] Deleted volume successfully. Dec 25 21:32:10.376283 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-737ae8e9-f09a-45ac-89fe-3533e589300b tempest-VolumeTypesTest-2133865962 None] Lock "b'cinder-c0c4c54f-cea7-4051-8ddd-b0f16f025c2c-delete_volume'" released by "delete_volume" :: held 10.163s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:32:13.728085 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-f190de69-9b28-43cc-b30f-c891b8750870 tempest-VolumesNegativeTest-763913042 None] Created reservations ['e9927de2-9fce-4ddc-a299-380dfab849be', '4262075c-c701-4257-afe5-f706fed66f39', 'a6fa8a42-607f-4e79-b884-142c4c54d39f', '826c48ab-262b-448c-b48b-c2c959f221ab'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:32:14.008244 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f190de69-9b28-43cc-b30f-c891b8750870 tempest-VolumesNegativeTest-763913042 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:32:14.063394 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f190de69-9b28-43cc-b30f-c891b8750870 tempest-VolumesNegativeTest-763913042 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:32:14.104505 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-f190de69-9b28-43cc-b30f-c891b8750870 tempest-VolumesNegativeTest-763913042 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:32:14.108735 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-f190de69-9b28-43cc-b30f-c891b8750870 tempest-VolumesNegativeTest-763913042 None] Deleted volume successfully. Dec 25 21:32:14.205310 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-f190de69-9b28-43cc-b30f-c891b8750870 tempest-VolumesNegativeTest-763913042 None] Lock "b'cinder-b1a60fbc-e864-4975-9321-44e85c28435b-delete_volume'" released by "delete_volume" :: held 9.877s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:32:19.355790 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-5f9397b6-d784-44d5-8028-3502dc89b53e tempest-VolumesActionsTest-1540518602 None] Lock "b'cinder-41f6d481-75b9-4ac9-aa97-c3a0f02dd0cc'" acquired by "attach_volume" :: waited 0.016s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:32:19.977921 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-5f9397b6-d784-44d5-8028-3502dc89b53e tempest-VolumesActionsTest-1540518602 None] Attaching volume 41f6d481-75b9-4ac9-aa97-c3a0f02dd0cc to instance c61d007c-5265-460b-989f-7006e9caeba7 at mountpoint /dev/sdb on host None. Dec 25 21:32:20.104422 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-5f9397b6-d784-44d5-8028-3502dc89b53e tempest-VolumesActionsTest-1540518602 None] Attach volume completed successfully. Dec 25 21:32:20.126802 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-5f9397b6-d784-44d5-8028-3502dc89b53e tempest-VolumesActionsTest-1540518602 None] Lock "b'cinder-41f6d481-75b9-4ac9-aa97-c3a0f02dd0cc'" released by "attach_volume" :: held 0.759s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:32:20.329422 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-1d972c1b-c8c3-4903-82ba-22df6f00dfcf tempest-VolumesActionsTest-1540518602 None] Lock "b'cinder-41f6d481-75b9-4ac9-aa97-c3a0f02dd0cc-detach_volume'" acquired by "detach_volume" :: waited 0.023s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:32:20.329933 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-1d972c1b-c8c3-4903-82ba-22df6f00dfcf tempest-VolumesActionsTest-1540518602 None] Detaching volume 41f6d481-75b9-4ac9-aa97-c3a0f02dd0cc from instance c61d007c-5265-460b-989f-7006e9caeba7. Dec 25 21:32:20.561676 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-1d972c1b-c8c3-4903-82ba-22df6f00dfcf tempest-VolumesActionsTest-1540518602 None] Detach volume completed successfully. Dec 25 21:32:20.581497 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-1d972c1b-c8c3-4903-82ba-22df6f00dfcf tempest-VolumesActionsTest-1540518602 None] Lock "b'cinder-41f6d481-75b9-4ac9-aa97-c3a0f02dd0cc-detach_volume'" released by "detach_volume" :: held 0.253s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:32:20.713865 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-98a39ba4-d012-4b2f-b39a-c8af532c8d35 req-380515ca-bc01-43da-bfe6-92ab4db235ad tempest-TestVolumeBootPattern-1499667379 None] Terminate volume connection completed successfully. Dec 25 21:32:20.714278 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-98a39ba4-d012-4b2f-b39a-c8af532c8d35 req-380515ca-bc01-43da-bfe6-92ab4db235ad tempest-TestVolumeBootPattern-1499667379 None] Deleting attachment 377e018b-c708-4893-afe6-29884ccd250a. {{(pid=129926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 25 21:32:21.168253 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [req-98a39ba4-d012-4b2f-b39a-c8af532c8d35 req-b4d5b36c-391d-42c6-a242-0c8b836dbba6 tempest-TestVolumeBootPattern-1499667379 None] Lock "b'cinder-60287979-54be-4064-9dab-ee0d101371d4-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:32:21.275240 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-98a39ba4-d012-4b2f-b39a-c8af532c8d35 req-b4d5b36c-391d-42c6-a242-0c8b836dbba6 tempest-TestVolumeBootPattern-1499667379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:32:21.668920 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-98a39ba4-d012-4b2f-b39a-c8af532c8d35 req-b4d5b36c-391d-42c6-a242-0c8b836dbba6 tempest-TestVolumeBootPattern-1499667379 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:32:21.997763 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-98a39ba4-d012-4b2f-b39a-c8af532c8d35 req-b4d5b36c-391d-42c6-a242-0c8b836dbba6 tempest-TestVolumeBootPattern-1499667379 None] deleting rbd volume volume-60287979-54be-4064-9dab-ee0d101371d4 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:32:27.059331 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [None req-2b363e56-3542-422c-a49e-76eb6d8edd15 tempest-VolumesActionsTest-1540518602 None] Running cmd (subprocess): rbd export --pool volumes volume-41f6d481-75b9-4ac9-aa97-c3a0f02dd0cc /opt/stack/data/cinder/conversion/volume-41f6d481-75b9-4ac9-aa97-c3a0f02dd0cc-6364e8c1-23b3-4ec0-aab8-6a6784a65a91 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:32:27.881077 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [None req-2b363e56-3542-422c-a49e-76eb6d8edd15 tempest-VolumesActionsTest-1540518602 None] CMD "rbd export --pool volumes volume-41f6d481-75b9-4ac9-aa97-c3a0f02dd0cc /opt/stack/data/cinder/conversion/volume-41f6d481-75b9-4ac9-aa97-c3a0f02dd0cc-6364e8c1-23b3-4ec0-aab8-6a6784a65a91 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.822s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:32:27.892616 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.image_utils [None req-2b363e56-3542-422c-a49e-76eb6d8edd15 tempest-VolumesActionsTest-1540518602 None] 6364e8c1-23b3-4ec0-aab8-6a6784a65a91 was raw, no need to convert to raw {{(pid=129926) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:815}} Dec 25 21:32:29.906915 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [req-98a39ba4-d012-4b2f-b39a-c8af532c8d35 req-b4d5b36c-391d-42c6-a242-0c8b836dbba6 tempest-TestVolumeBootPattern-1499667379 None] Created reservations ['ace1674d-7c9f-450e-94fe-272079831246', '13294dbc-2e94-4c14-8edf-6a7c721d4b69', 'daa8fbe7-b814-4b6f-8711-1d79b16d0191', 'ba79eb8b-4e90-4cbd-93ef-b452aabdf2de'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:32:30.224098 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-98a39ba4-d012-4b2f-b39a-c8af532c8d35 req-b4d5b36c-391d-42c6-a242-0c8b836dbba6 tempest-TestVolumeBootPattern-1499667379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:32:30.292812 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-98a39ba4-d012-4b2f-b39a-c8af532c8d35 req-b4d5b36c-391d-42c6-a242-0c8b836dbba6 tempest-TestVolumeBootPattern-1499667379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:32:30.363252 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [req-98a39ba4-d012-4b2f-b39a-c8af532c8d35 req-b4d5b36c-391d-42c6-a242-0c8b836dbba6 tempest-TestVolumeBootPattern-1499667379 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:32:30.368263 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-98a39ba4-d012-4b2f-b39a-c8af532c8d35 req-b4d5b36c-391d-42c6-a242-0c8b836dbba6 tempest-TestVolumeBootPattern-1499667379 None] Deleted volume successfully. Dec 25 21:32:30.471251 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [req-98a39ba4-d012-4b2f-b39a-c8af532c8d35 req-b4d5b36c-391d-42c6-a242-0c8b836dbba6 tempest-TestVolumeBootPattern-1499667379 None] Lock "b'cinder-60287979-54be-4064-9dab-ee0d101371d4-delete_volume'" released by "delete_volume" :: held 9.303s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:32:31.122536 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-dce83bdf-58bc-46cd-9b88-de01b9ff9357 tempest-TestVolumeBootPattern-1499667379 None] Lock "b'cinder-cc684306-48c1-4377-9775-39fc12aed847-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:32:31.126493 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-dce83bdf-58bc-46cd-9b88-de01b9ff9357 tempest-TestVolumeBootPattern-1499667379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:32:32.054212 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:32:32.054940 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:32:32.114014 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:32:32.206517 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:32:35.395774 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-dce83bdf-58bc-46cd-9b88-de01b9ff9357 tempest-TestVolumeBootPattern-1499667379 None] Created reservations ['8eba34ea-6be5-4622-971d-54a207a579dc', '8210821d-cc76-43e7-a275-58cc247648df', '05982297-6adc-4fed-9e12-78598647b750', 'bcc60d77-c76d-4925-9ec0-54df9afb077c'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:32:35.707254 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-dce83bdf-58bc-46cd-9b88-de01b9ff9357 tempest-TestVolumeBootPattern-1499667379 None] Delete snapshot completed successfully. Dec 25 21:32:35.713942 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-dce83bdf-58bc-46cd-9b88-de01b9ff9357 tempest-TestVolumeBootPattern-1499667379 None] Lock "b'cinder-cc684306-48c1-4377-9775-39fc12aed847-delete_snapshot'" released by "delete_snapshot" :: held 4.591s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:32:36.642742 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-ef4931de-58b3-4862-8aa9-9942cd78fc0e tempest-TestVolumeBootPattern-1499667379 None] Lock "b'cinder-d3859288-1717-450f-aa47-2e8e44a2382e-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:32:36.971766 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ef4931de-58b3-4862-8aa9-9942cd78fc0e tempest-TestVolumeBootPattern-1499667379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:32:37.331850 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ef4931de-58b3-4862-8aa9-9942cd78fc0e tempest-TestVolumeBootPattern-1499667379 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:32:37.693764 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ef4931de-58b3-4862-8aa9-9942cd78fc0e tempest-TestVolumeBootPattern-1499667379 None] deleting rbd volume volume-d3859288-1717-450f-aa47-2e8e44a2382e {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:32:40.157256 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ba30c87-7abe-4fca-a95d-9005b14e6451 tempest-VolumesActionsTest-2089127211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:32:40.175084 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-3ba30c87-7abe-4fca-a95d-9005b14e6451 tempest-VolumesActionsTest-2089127211 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:32:40.176260 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-3ba30c87-7abe-4fca-a95d-9005b14e6451 tempest-VolumesActionsTest-2089127211 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:32:40.216132 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3ba30c87-7abe-4fca-a95d-9005b14e6451 tempest-VolumesActionsTest-2089127211 None] Flow 'volume_create_manager' (d6b6f32e-7c8e-42c5-84e3-db6375afee4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:32:40.220732 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3ba30c87-7abe-4fca-a95d-9005b14e6451 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b4e4b40-0113-49e1-901e-ac804becb926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:32:40.232549 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-3ba30c87-7abe-4fca-a95d-9005b14e6451 tempest-VolumesActionsTest-2089127211 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:32:40.256488 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3ba30c87-7abe-4fca-a95d-9005b14e6451 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b4e4b40-0113-49e1-901e-ac804becb926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2109551161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ce10a0b6-7e66-422d-8632-6cdb68412794,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71418288426545dea311f347bd0cbfdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:32:40Z,use_quota=True,user_id='f2237f90a5db4203805e0a7f287f0964',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:32:40.261056 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3ba30c87-7abe-4fca-a95d-9005b14e6451 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57906986-f40a-4254-9d78-ca9f3b020d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:32:40.263384 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3ba30c87-7abe-4fca-a95d-9005b14e6451 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57906986-f40a-4254-9d78-ca9f3b020d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:32:40.274514 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3ba30c87-7abe-4fca-a95d-9005b14e6451 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f630a90-778d-4cc1-9d60-f1c58b23c963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:32:40.284090 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3ba30c87-7abe-4fca-a95d-9005b14e6451 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f630a90-778d-4cc1-9d60-f1c58b23c963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce10a0b6-7e66-422d-8632-6cdb68412794', 'volume_name': 'volume-ce10a0b6-7e66-422d-8632-6cdb68412794', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:32:40.300601 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3ba30c87-7abe-4fca-a95d-9005b14e6451 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50820fd3-6c14-4ef8-a3c4-4cba7586c1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:32:40.315262 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3ba30c87-7abe-4fca-a95d-9005b14e6451 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50820fd3-6c14-4ef8-a3c4-4cba7586c1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:32:40.319778 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3ba30c87-7abe-4fca-a95d-9005b14e6451 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2cf6f53-9e35-4669-b130-b1fe0b60306c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:32:40.320803 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-3ba30c87-7abe-4fca-a95d-9005b14e6451 tempest-VolumesActionsTest-2089127211 None] Volume ce10a0b6-7e66-422d-8632-6cdb68412794: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce10a0b6-7e66-422d-8632-6cdb68412794', 'volume_size': 1} Dec 25 21:32:40.321233 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-3ba30c87-7abe-4fca-a95d-9005b14e6451 tempest-VolumesActionsTest-2089127211 None] creating volume 'volume-ce10a0b6-7e66-422d-8632-6cdb68412794' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:32:40.322230 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-3ba30c87-7abe-4fca-a95d-9005b14e6451 tempest-VolumesActionsTest-2089127211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:32:41.457672 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-3ba30c87-7abe-4fca-a95d-9005b14e6451 tempest-VolumesActionsTest-2089127211 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:32:41.458380 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-3ba30c87-7abe-4fca-a95d-9005b14e6451 tempest-VolumesActionsTest-2089127211 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:32:41.460098 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3ba30c87-7abe-4fca-a95d-9005b14e6451 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2cf6f53-9e35-4669-b130-b1fe0b60306c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce10a0b6-7e66-422d-8632-6cdb68412794', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:32:41.462323 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3ba30c87-7abe-4fca-a95d-9005b14e6451 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (002c0349-7faf-4fda-86aa-c81f9cd67953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:32:41.565407 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-3ba30c87-7abe-4fca-a95d-9005b14e6451 tempest-VolumesActionsTest-2089127211 None] Volume volume-ce10a0b6-7e66-422d-8632-6cdb68412794 (ce10a0b6-7e66-422d-8632-6cdb68412794): created successfully Dec 25 21:32:41.567509 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3ba30c87-7abe-4fca-a95d-9005b14e6451 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (002c0349-7faf-4fda-86aa-c81f9cd67953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:32:41.570591 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3ba30c87-7abe-4fca-a95d-9005b14e6451 tempest-VolumesActionsTest-2089127211 None] Flow 'volume_create_manager' (d6b6f32e-7c8e-42c5-84e3-db6375afee4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:32:41.833159 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-f727cfd0-cb2a-4567-8e20-812556c612de tempest-GroupSnapshotsTest-1402242931 None] Group tempest-GroupSnapshotsTest-Group-82759138: creating Dec 25 21:32:41.856350 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-3ba30c87-7abe-4fca-a95d-9005b14e6451 tempest-VolumesActionsTest-2089127211 None] Created volume successfully. Dec 25 21:32:41.985862 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-f727cfd0-cb2a-4567-8e20-812556c612de tempest-GroupSnapshotsTest-1402242931 None] Group tempest-GroupSnapshotsTest-Group-82759138: created successfully Dec 25 21:32:41.989128 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-2fcec249-da29-4472-857a-9f010b917205 tempest-VolumesActionsTest-2089127211 None] Lock "b'cinder-ce10a0b6-7e66-422d-8632-6cdb68412794'" acquired by "attach_volume" :: waited 0.019s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:32:42.004033 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-f727cfd0-cb2a-4567-8e20-812556c612de tempest-GroupSnapshotsTest-1402242931 None] Create group completed successfully. Dec 25 21:32:42.177591 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-2fcec249-da29-4472-857a-9f010b917205 tempest-VolumesActionsTest-2089127211 None] Attaching volume ce10a0b6-7e66-422d-8632-6cdb68412794 to instance aa3f4646-839b-4b87-b6eb-ac1157f96783 at mountpoint /dev/sdb on host None. Dec 25 21:32:42.345950 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-2fcec249-da29-4472-857a-9f010b917205 tempest-VolumesActionsTest-2089127211 None] Attach volume completed successfully. Dec 25 21:32:42.351048 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-2fcec249-da29-4472-857a-9f010b917205 tempest-VolumesActionsTest-2089127211 None] Lock "b'cinder-ce10a0b6-7e66-422d-8632-6cdb68412794'" released by "attach_volume" :: held 0.362s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:32:43.109795 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-4ccc5250-cb76-49e1-83d6-dee2f69a364d tempest-VolumesActionsTest-1050374675 None] Terminate volume connection completed successfully. Dec 25 21:32:43.153399 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-4ccc5250-cb76-49e1-83d6-dee2f69a364d tempest-VolumesActionsTest-1050374675 None] Lock "b'cinder-ce10a0b6-7e66-422d-8632-6cdb68412794-detach_volume'" acquired by "detach_volume" :: waited 0.012s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:32:43.168414 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-4ccc5250-cb76-49e1-83d6-dee2f69a364d tempest-VolumesActionsTest-1050374675 None] Detaching volume ce10a0b6-7e66-422d-8632-6cdb68412794 from instance aa3f4646-839b-4b87-b6eb-ac1157f96783. Dec 25 21:32:43.446055 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-4ccc5250-cb76-49e1-83d6-dee2f69a364d tempest-VolumesActionsTest-1050374675 None] Detach volume completed successfully. Dec 25 21:32:43.453331 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-4ccc5250-cb76-49e1-83d6-dee2f69a364d tempest-VolumesActionsTest-1050374675 None] Lock "b'cinder-ce10a0b6-7e66-422d-8632-6cdb68412794-detach_volume'" released by "detach_volume" :: held 0.300s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:32:43.734495 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-016ecaa2-9116-4ba1-94c7-0b730707ebca tempest-VolumesActionsTest-2089127211 None] Lock "b'cinder-ce10a0b6-7e66-422d-8632-6cdb68412794-detach_volume'" acquired by "detach_volume" :: waited 0.012s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:32:43.734952 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-016ecaa2-9116-4ba1-94c7-0b730707ebca tempest-VolumesActionsTest-2089127211 None] Volume detach called, but volume not attached. Dec 25 21:32:44.156685 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-016ecaa2-9116-4ba1-94c7-0b730707ebca tempest-VolumesActionsTest-2089127211 None] Lock "b'cinder-ce10a0b6-7e66-422d-8632-6cdb68412794-detach_volume'" released by "detach_volume" :: held 0.416s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:32:44.273675 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3260fca-1250-4060-8ff6-146cf929fb4d tempest-GroupSnapshotsTest-1402242931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:32:44.282774 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-e3260fca-1250-4060-8ff6-146cf929fb4d tempest-GroupSnapshotsTest-1402242931 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:32:44.282774 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-e3260fca-1250-4060-8ff6-146cf929fb4d tempest-GroupSnapshotsTest-1402242931 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:32:44.306998 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e3260fca-1250-4060-8ff6-146cf929fb4d tempest-GroupSnapshotsTest-1402242931 None] Flow 'volume_create_manager' (6a14e388-620f-4644-9729-4c864707341b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:32:44.313451 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e3260fca-1250-4060-8ff6-146cf929fb4d tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1b57590-4a50-4ed6-9b90-740eca777a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:32:44.319122 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-e3260fca-1250-4060-8ff6-146cf929fb4d tempest-GroupSnapshotsTest-1402242931 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:32:44.339172 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e3260fca-1250-4060-8ff6-146cf929fb4d tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1b57590-4a50-4ed6-9b90-740eca777a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1660953819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bccf34df-c189-42e2-bba6-2995ddc69e03,host='ncdv-master-1@ceph#ceph',id=8daddb8a-c31d-4e21-a2ac-39be7a4477d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='758f44503e1c41dc9aecca962e0c75f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:32:44Z,use_quota=True,user_id='3a838ec078394a5cba918617920febff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f547cac0-4794-4d24-b7bc-0c933ea2fa2c),volume_type_id=f547cac0-4794-4d24-b7bc-0c933ea2fa2c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:32:44.349009 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e3260fca-1250-4060-8ff6-146cf929fb4d tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b392fde-2909-4995-b612-afe199383df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:32:44.354476 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e3260fca-1250-4060-8ff6-146cf929fb4d tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b392fde-2909-4995-b612-afe199383df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:32:44.363674 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e3260fca-1250-4060-8ff6-146cf929fb4d tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4646bbb4-a479-4823-bf68-4cc7e9b7ac09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:32:44.367226 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e3260fca-1250-4060-8ff6-146cf929fb4d tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4646bbb4-a479-4823-bf68-4cc7e9b7ac09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8daddb8a-c31d-4e21-a2ac-39be7a4477d3', 'volume_name': 'volume-8daddb8a-c31d-4e21-a2ac-39be7a4477d3', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:32:44.369356 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e3260fca-1250-4060-8ff6-146cf929fb4d tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (247bc561-e3d1-4c16-a097-115f7ff51a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:32:44.372068 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e3260fca-1250-4060-8ff6-146cf929fb4d tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (247bc561-e3d1-4c16-a097-115f7ff51a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:32:44.375280 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e3260fca-1250-4060-8ff6-146cf929fb4d tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3168de7f-5e35-46e7-9571-b36a0a469c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:32:44.377082 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-e3260fca-1250-4060-8ff6-146cf929fb4d tempest-GroupSnapshotsTest-1402242931 None] Volume 8daddb8a-c31d-4e21-a2ac-39be7a4477d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8daddb8a-c31d-4e21-a2ac-39be7a4477d3', 'volume_size': 1} Dec 25 21:32:44.377082 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e3260fca-1250-4060-8ff6-146cf929fb4d tempest-GroupSnapshotsTest-1402242931 None] creating volume 'volume-8daddb8a-c31d-4e21-a2ac-39be7a4477d3' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:32:44.378135 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e3260fca-1250-4060-8ff6-146cf929fb4d tempest-GroupSnapshotsTest-1402242931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:32:45.570508 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e3260fca-1250-4060-8ff6-146cf929fb4d tempest-GroupSnapshotsTest-1402242931 None] extra_specs: {} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:32:45.571217 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e3260fca-1250-4060-8ff6-146cf929fb4d tempest-GroupSnapshotsTest-1402242931 None] extra_specs: {} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:32:45.573354 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e3260fca-1250-4060-8ff6-146cf929fb4d tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3168de7f-5e35-46e7-9571-b36a0a469c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8daddb8a-c31d-4e21-a2ac-39be7a4477d3', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:32:45.575772 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e3260fca-1250-4060-8ff6-146cf929fb4d tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8698288b-35d7-4431-b075-eaab3dbafa84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:32:45.700851 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-e3260fca-1250-4060-8ff6-146cf929fb4d tempest-GroupSnapshotsTest-1402242931 None] Volume volume-8daddb8a-c31d-4e21-a2ac-39be7a4477d3 (8daddb8a-c31d-4e21-a2ac-39be7a4477d3): created successfully Dec 25 21:32:45.704462 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e3260fca-1250-4060-8ff6-146cf929fb4d tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8698288b-35d7-4431-b075-eaab3dbafa84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:32:45.707680 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e3260fca-1250-4060-8ff6-146cf929fb4d tempest-GroupSnapshotsTest-1402242931 None] Flow 'volume_create_manager' (6a14e388-620f-4644-9729-4c864707341b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:32:45.798517 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-e3260fca-1250-4060-8ff6-146cf929fb4d tempest-GroupSnapshotsTest-1402242931 None] Created volume successfully. Dec 25 21:32:46.735329 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-d04d183f-7392-42c3-8c19-70d8eba61ff3 tempest-GroupSnapshotsTest-1402242931 None] GroupSnapshot 701fc647-4a84-4b43-a93f-26d613fa5a24: creating. Dec 25 21:32:46.763485 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ef4931de-58b3-4862-8aa9-9942cd78fc0e tempest-TestVolumeBootPattern-1499667379 None] volume is a clone so cleaning references {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 25 21:32:47.155580 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ef4931de-58b3-4862-8aa9-9942cd78fc0e tempest-TestVolumeBootPattern-1499667379 None] deleting parent snapshot volume-d3859288-1717-450f-aa47-2e8e44a2382e.clone_snap {{(pid=129926) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 25 21:32:51.460304 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-d04d183f-7392-42c3-8c19-70d8eba61ff3 tempest-GroupSnapshotsTest-1402242931 None] Group snapshot 701fc647-4a84-4b43-a93f-26d613fa5a24: creating. {{(pid=129926) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4078}} Dec 25 21:32:51.503539 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-d04d183f-7392-42c3-8c19-70d8eba61ff3 tempest-GroupSnapshotsTest-1402242931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:32:51.771007 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b26a0e7-5d2f-4540-ab8a-edf279a2c7b3 tempest-VolumesActionsTest-2089127211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:32:51.782472 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-3b26a0e7-5d2f-4540-ab8a-edf279a2c7b3 tempest-VolumesActionsTest-2089127211 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:32:51.782472 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-3b26a0e7-5d2f-4540-ab8a-edf279a2c7b3 tempest-VolumesActionsTest-2089127211 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:32:51.786858 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3b26a0e7-5d2f-4540-ab8a-edf279a2c7b3 tempest-VolumesActionsTest-2089127211 None] Flow 'volume_create_manager' (303b922a-9927-493a-b7e0-b18403a23191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:32:51.790575 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3b26a0e7-5d2f-4540-ab8a-edf279a2c7b3 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2a01bfe-ae34-4c47-bd8e-712e6d988874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:32:51.799522 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-ef4931de-58b3-4862-8aa9-9942cd78fc0e tempest-TestVolumeBootPattern-1499667379 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:32:51.816845 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3b26a0e7-5d2f-4540-ab8a-edf279a2c7b3 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2a01bfe-ae34-4c47-bd8e-712e6d988874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:32:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-136881006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=16f102f3-273f-4124-8669-3e8a2c022688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71418288426545dea311f347bd0cbfdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:32:50Z,use_quota=True,user_id='f2237f90a5db4203805e0a7f287f0964',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:32:51.819505 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3b26a0e7-5d2f-4540-ab8a-edf279a2c7b3 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c3c266d-3d78-4cf6-81c3-619627735f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:32:51.821745 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3b26a0e7-5d2f-4540-ab8a-edf279a2c7b3 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c3c266d-3d78-4cf6-81c3-619627735f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:32:51.824165 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3b26a0e7-5d2f-4540-ab8a-edf279a2c7b3 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8cd1c3f-b1fa-47af-a7f7-0e9e4e484c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:32:51.826422 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3b26a0e7-5d2f-4540-ab8a-edf279a2c7b3 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8cd1c3f-b1fa-47af-a7f7-0e9e4e484c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16f102f3-273f-4124-8669-3e8a2c022688', 'volume_name': 'volume-16f102f3-273f-4124-8669-3e8a2c022688', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:32:51.829248 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3b26a0e7-5d2f-4540-ab8a-edf279a2c7b3 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (365414b1-df96-45ca-944a-8b17e658c18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:32:51.831369 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3b26a0e7-5d2f-4540-ab8a-edf279a2c7b3 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (365414b1-df96-45ca-944a-8b17e658c18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:32:51.833565 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3b26a0e7-5d2f-4540-ab8a-edf279a2c7b3 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (715b9d82-99e2-4be8-968a-d6465b968d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:32:51.834368 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-3b26a0e7-5d2f-4540-ab8a-edf279a2c7b3 tempest-VolumesActionsTest-2089127211 None] Volume 16f102f3-273f-4124-8669-3e8a2c022688: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16f102f3-273f-4124-8669-3e8a2c022688', 'volume_size': 1} Dec 25 21:32:51.834763 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-3b26a0e7-5d2f-4540-ab8a-edf279a2c7b3 tempest-VolumesActionsTest-2089127211 None] creating volume 'volume-16f102f3-273f-4124-8669-3e8a2c022688' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:32:51.835721 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-3b26a0e7-5d2f-4540-ab8a-edf279a2c7b3 tempest-VolumesActionsTest-2089127211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:32:51.958606 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-ef4931de-58b3-4862-8aa9-9942cd78fc0e tempest-TestVolumeBootPattern-1499667379 None] Created reservations ['7d67a132-6eef-4821-8291-f990a2723a22', '34d9b915-2638-4682-bc38-fcc4ef016fbb', '281616f9-503f-4d9a-aea5-b23985f02412', 'd5a81bdf-bacb-42ee-bd26-ceb0b5a01142'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:32:52.195380 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ef4931de-58b3-4862-8aa9-9942cd78fc0e tempest-TestVolumeBootPattern-1499667379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:32:52.244032 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ef4931de-58b3-4862-8aa9-9942cd78fc0e tempest-TestVolumeBootPattern-1499667379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:32:52.271763 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-ef4931de-58b3-4862-8aa9-9942cd78fc0e tempest-TestVolumeBootPattern-1499667379 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:32:52.276535 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-ef4931de-58b3-4862-8aa9-9942cd78fc0e tempest-TestVolumeBootPattern-1499667379 None] Deleted volume successfully. Dec 25 21:32:52.375312 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-ef4931de-58b3-4862-8aa9-9942cd78fc0e tempest-TestVolumeBootPattern-1499667379 None] Lock "b'cinder-d3859288-1717-450f-aa47-2e8e44a2382e-delete_volume'" released by "delete_volume" :: held 15.733s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:32:53.204609 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-3b26a0e7-5d2f-4540-ab8a-edf279a2c7b3 tempest-VolumesActionsTest-2089127211 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:32:53.205303 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-3b26a0e7-5d2f-4540-ab8a-edf279a2c7b3 tempest-VolumesActionsTest-2089127211 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:32:53.207804 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3b26a0e7-5d2f-4540-ab8a-edf279a2c7b3 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (715b9d82-99e2-4be8-968a-d6465b968d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16f102f3-273f-4124-8669-3e8a2c022688', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:32:53.214595 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3b26a0e7-5d2f-4540-ab8a-edf279a2c7b3 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bfb5b1e-af68-43aa-8095-56657aba6081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:32:53.360648 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-3b26a0e7-5d2f-4540-ab8a-edf279a2c7b3 tempest-VolumesActionsTest-2089127211 None] Volume volume-16f102f3-273f-4124-8669-3e8a2c022688 (16f102f3-273f-4124-8669-3e8a2c022688): created successfully Dec 25 21:32:53.365864 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3b26a0e7-5d2f-4540-ab8a-edf279a2c7b3 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bfb5b1e-af68-43aa-8095-56657aba6081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:32:53.369535 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-3b26a0e7-5d2f-4540-ab8a-edf279a2c7b3 tempest-VolumesActionsTest-2089127211 None] Flow 'volume_create_manager' (303b922a-9927-493a-b7e0-b18403a23191) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:32:53.456896 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-3b26a0e7-5d2f-4540-ab8a-edf279a2c7b3 tempest-VolumesActionsTest-2089127211 None] Created volume successfully. Dec 25 21:32:54.430648 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-27a376e5-8590-407d-80ed-8a3e7a07e21e tempest-TestVolumeBootPattern-1499667379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:32:54.435002 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-27a376e5-8590-407d-80ed-8a3e7a07e21e tempest-TestVolumeBootPattern-1499667379 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:32:54.437830 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-27a376e5-8590-407d-80ed-8a3e7a07e21e tempest-TestVolumeBootPattern-1499667379 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:32:54.449287 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-27a376e5-8590-407d-80ed-8a3e7a07e21e tempest-TestVolumeBootPattern-1499667379 None] Flow 'volume_create_manager' (abbf3741-f60e-4a86-bbe1-258074a43d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:32:54.453371 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-27a376e5-8590-407d-80ed-8a3e7a07e21e tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dccd452c-1269-4354-8e85-bb6311f7e708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:32:54.459795 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-27a376e5-8590-407d-80ed-8a3e7a07e21e tempest-TestVolumeBootPattern-1499667379 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:32:54.489784 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-27a376e5-8590-407d-80ed-8a3e7a07e21e tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dccd452c-1269-4354-8e85-bb6311f7e708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1701545965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=63db5869-7587-4d2a-ac56-8b2e33092808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c77dc74a46d64a67991d82bf12adb1dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:32:54Z,use_quota=True,user_id='171c198b6b734cd698b3c1eaf76a0234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:32:54.492379 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-27a376e5-8590-407d-80ed-8a3e7a07e21e tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c107c37a-d4a4-4acc-92c6-8cfcaa168e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:32:54.495228 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-27a376e5-8590-407d-80ed-8a3e7a07e21e tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c107c37a-d4a4-4acc-92c6-8cfcaa168e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:32:54.498185 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-27a376e5-8590-407d-80ed-8a3e7a07e21e tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d7c0b1a-4013-4bc8-8650-af47ac72cea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:32:54.608939 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-27a376e5-8590-407d-80ed-8a3e7a07e21e tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d7c0b1a-4013-4bc8-8650-af47ac72cea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '63db5869-7587-4d2a-ac56-8b2e33092808', 'volume_name': 'volume-63db5869-7587-4d2a-ac56-8b2e33092808', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:32:54.611499 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-27a376e5-8590-407d-80ed-8a3e7a07e21e tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58448959-b004-4601-8acd-5f1fcf57f7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:32:54.614102 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-27a376e5-8590-407d-80ed-8a3e7a07e21e tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58448959-b004-4601-8acd-5f1fcf57f7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:32:54.616440 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-27a376e5-8590-407d-80ed-8a3e7a07e21e tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5566600b-e8b5-4e40-a164-eac1296b1c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:32:54.617311 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-27a376e5-8590-407d-80ed-8a3e7a07e21e tempest-TestVolumeBootPattern-1499667379 None] Volume 63db5869-7587-4d2a-ac56-8b2e33092808: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-63db5869-7587-4d2a-ac56-8b2e33092808', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 25 21:32:54.617898 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-27a376e5-8590-407d-80ed-8a3e7a07e21e tempest-TestVolumeBootPattern-1499667379 None] Cloning 63db5869-7587-4d2a-ac56-8b2e33092808 from image aca914d0-5f7b-465f-a024-75efa27d7291 at location (None, None). {{(pid=129926) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Dec 25 21:32:54.637480 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-27a376e5-8590-407d-80ed-8a3e7a07e21e tempest-TestVolumeBootPattern-1499667379 None] Lock "b'cinder-aca914d0-5f7b-465f-a024-75efa27d7291'" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:32:54.708686 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-ed0a29af-430c-4a86-b20d-e5af037c323d tempest-VolumesActionsTest-1050374675 None] Lock "b'cinder-16f102f3-273f-4124-8669-3e8a2c022688-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:32:54.724618 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-27a376e5-8590-407d-80ed-8a3e7a07e21e tempest-TestVolumeBootPattern-1499667379 None] Found image-volume cache entry: {'id': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'volume_id': '058f5fb3-51e4-40e3-9c98-542207f1fc1f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31), 'last_used': datetime.datetime(2021, 12, 25, 21, 32, 54, 633653)}. {{(pid=129926) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 25 21:32:54.725221 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-27a376e5-8590-407d-80ed-8a3e7a07e21e tempest-TestVolumeBootPattern-1499667379 None] Image-volume cache entry image_update_at = 2021-12-25 20:58:31+00:00, requested image updated_at = 2021-12-25 20:58:31+00:00. {{(pid=129926) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 25 21:32:54.726411 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-27a376e5-8590-407d-80ed-8a3e7a07e21e tempest-TestVolumeBootPattern-1499667379 None] Found cache entry for image = aca914d0-5f7b-465f-a024-75efa27d7291 on host ncdv-master-1@ceph#ceph. {{(pid=129926) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Dec 25 21:32:54.735342 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-27a376e5-8590-407d-80ed-8a3e7a07e21e tempest-TestVolumeBootPattern-1499667379 None] Lock "b'cinder-aca914d0-5f7b-465f-a024-75efa27d7291'" released by "_prepare_image_cache_entry" :: held 0.105s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:32:54.736153 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-27a376e5-8590-407d-80ed-8a3e7a07e21e tempest-TestVolumeBootPattern-1499667379 None] Attempting to retrieve cache entry for image = aca914d0-5f7b-465f-a024-75efa27d7291 on host ncdv-master-1@ceph#ceph. {{(pid=129926) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Dec 25 21:32:54.743233 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-27a376e5-8590-407d-80ed-8a3e7a07e21e tempest-TestVolumeBootPattern-1499667379 None] Found image-volume cache entry: {'id': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'volume_id': '058f5fb3-51e4-40e3-9c98-542207f1fc1f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31), 'last_used': datetime.datetime(2021, 12, 25, 21, 32, 54, 740289)}. {{(pid=129926) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 25 21:32:54.743768 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-27a376e5-8590-407d-80ed-8a3e7a07e21e tempest-TestVolumeBootPattern-1499667379 None] Image-volume cache entry image_update_at = 2021-12-25 20:58:31+00:00, requested image updated_at = 2021-12-25 20:58:31+00:00. {{(pid=129926) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 25 21:32:54.744293 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-27a376e5-8590-407d-80ed-8a3e7a07e21e tempest-TestVolumeBootPattern-1499667379 None] Creating from source image-volume 058f5fb3-51e4-40e3-9c98-542207f1fc1f {{(pid=129926) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Dec 25 21:32:54.761851 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-27a376e5-8590-407d-80ed-8a3e7a07e21e tempest-TestVolumeBootPattern-1499667379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:32:55.128613 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-27a376e5-8590-407d-80ed-8a3e7a07e21e tempest-TestVolumeBootPattern-1499667379 None] creating snapshot='volume-63db5869-7587-4d2a-ac56-8b2e33092808.clone_snap' {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 25 21:32:57.748211 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-27a376e5-8590-407d-80ed-8a3e7a07e21e tempest-TestVolumeBootPattern-1499667379 None] cloning 'volume-058f5fb3-51e4-40e3-9c98-542207f1fc1f@volume-63db5869-7587-4d2a-ac56-8b2e33092808.clone_snap' to 'volume-63db5869-7587-4d2a-ac56-8b2e33092808' {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 25 21:32:57.778692 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ed0a29af-430c-4a86-b20d-e5af037c323d tempest-VolumesActionsTest-1050374675 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:32:58.130252 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ed0a29af-430c-4a86-b20d-e5af037c323d tempest-VolumesActionsTest-1050374675 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:32:58.134750 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ed0a29af-430c-4a86-b20d-e5af037c323d tempest-VolumesActionsTest-1050374675 None] Volume volume-16f102f3-273f-4124-8669-3e8a2c022688 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:32:58.439293 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ed0a29af-430c-4a86-b20d-e5af037c323d tempest-VolumesActionsTest-1050374675 None] deleting rbd volume volume-16f102f3-273f-4124-8669-3e8a2c022688 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:32:58.832928 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-d04d183f-7392-42c3-8c19-70d8eba61ff3 tempest-GroupSnapshotsTest-1402242931 None] group_snapshot 701fc647-4a84-4b43-a93f-26d613fa5a24: created successfully Dec 25 21:32:59.448430 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-2b363e56-3542-422c-a49e-76eb6d8edd15 tempest-VolumesActionsTest-1540518602 None] Uploaded volume to glance image-id: 6364e8c1-23b3-4ec0-aab8-6a6784a65a91. {{(pid=129926) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1747}} Dec 25 21:32:59.525843 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-2b363e56-3542-422c-a49e-76eb6d8edd15 tempest-VolumesActionsTest-1540518602 None] Copy volume to image completed successfully. Dec 25 21:33:00.299021 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-27a376e5-8590-407d-80ed-8a3e7a07e21e tempest-TestVolumeBootPattern-1499667379 None] Volume volume-98b6d31e-e760-499e-8962-7b22479c1e9a.deleted is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:33:00.299563 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-27a376e5-8590-407d-80ed-8a3e7a07e21e tempest-TestVolumeBootPattern-1499667379 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:33:00.300642 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-27a376e5-8590-407d-80ed-8a3e7a07e21e tempest-TestVolumeBootPattern-1499667379 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:33:01.127604 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-27a376e5-8590-407d-80ed-8a3e7a07e21e tempest-TestVolumeBootPattern-1499667379 None] clone created successfully {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 25 21:33:01.128202 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.volume_utils [None req-27a376e5-8590-407d-80ed-8a3e7a07e21e tempest-TestVolumeBootPattern-1499667379 None] Marking volume 63db5869-7587-4d2a-ac56-8b2e33092808 as bootable. {{(pid=129926) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 25 21:33:01.179345 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-210f9cfc-56a0-412c-8732-980e667467a1 tempest-GroupSnapshotsTest-1402242931 None] cloning volumes/volume-8daddb8a-c31d-4e21-a2ac-39be7a4477d3@snapshot-f0c9ef1d-5f51-40b8-8fbb-86f34159cdc9 to volume-e3dbd0c1-eeba-437a-97f0-f47d2b6a83f6 {{(pid=129926) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Dec 25 21:33:01.179992 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-210f9cfc-56a0-412c-8732-980e667467a1 tempest-GroupSnapshotsTest-1402242931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:33:01.220378 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-210f9cfc-56a0-412c-8732-980e667467a1 tempest-GroupSnapshotsTest-1402242931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:33:01.255195 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-27a376e5-8590-407d-80ed-8a3e7a07e21e tempest-TestVolumeBootPattern-1499667379 None] Copying metadata from image aca914d0-5f7b-465f-a024-75efa27d7291 to 63db5869-7587-4d2a-ac56-8b2e33092808. {{(pid=129926) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Dec 25 21:33:01.255620 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-27a376e5-8590-407d-80ed-8a3e7a07e21e tempest-TestVolumeBootPattern-1499667379 None] Creating volume glance metadata for volume 63db5869-7587-4d2a-ac56-8b2e33092808 backed by image aca914d0-5f7b-465f-a024-75efa27d7291 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129926) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Dec 25 21:33:01.376002 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-27a376e5-8590-407d-80ed-8a3e7a07e21e tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5566600b-e8b5-4e40-a164-eac1296b1c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63db5869-7587-4d2a-ac56-8b2e33092808', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:01.378302 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-27a376e5-8590-407d-80ed-8a3e7a07e21e tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (628a4886-2338-44cf-a124-c996f4aba2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:01.488079 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-27a376e5-8590-407d-80ed-8a3e7a07e21e tempest-TestVolumeBootPattern-1499667379 None] Volume volume-63db5869-7587-4d2a-ac56-8b2e33092808 (63db5869-7587-4d2a-ac56-8b2e33092808): created successfully Dec 25 21:33:01.498752 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-27a376e5-8590-407d-80ed-8a3e7a07e21e tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (628a4886-2338-44cf-a124-c996f4aba2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:01.498752 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-27a376e5-8590-407d-80ed-8a3e7a07e21e tempest-TestVolumeBootPattern-1499667379 None] Flow 'volume_create_manager' (abbf3741-f60e-4a86-bbe1-258074a43d64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:33:01.639068 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-27a376e5-8590-407d-80ed-8a3e7a07e21e tempest-TestVolumeBootPattern-1499667379 None] Created volume successfully. Dec 25 21:33:02.145147 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-907a3c48-908b-44c6-a41d-91d2233bd3a3 tempest-VolumesActionsTest-1540518602 None] Lock "b'cinder-41f6d481-75b9-4ac9-aa97-c3a0f02dd0cc-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:33:02.262136 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-907a3c48-908b-44c6-a41d-91d2233bd3a3 tempest-VolumesActionsTest-1540518602 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:33:02.552014 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-907a3c48-908b-44c6-a41d-91d2233bd3a3 tempest-VolumesActionsTest-1540518602 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:33:02.552656 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-907a3c48-908b-44c6-a41d-91d2233bd3a3 tempest-VolumesActionsTest-1540518602 None] Volume volume-41f6d481-75b9-4ac9-aa97-c3a0f02dd0cc is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:33:02.873759 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-907a3c48-908b-44c6-a41d-91d2233bd3a3 tempest-VolumesActionsTest-1540518602 None] deleting rbd volume volume-41f6d481-75b9-4ac9-aa97-c3a0f02dd0cc {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:33:03.594900 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-210f9cfc-56a0-412c-8732-980e667467a1 tempest-GroupSnapshotsTest-1402242931 None] extra_specs: {} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:33:03.600337 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-210f9cfc-56a0-412c-8732-980e667467a1 tempest-GroupSnapshotsTest-1402242931 None] extra_specs: {} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:33:04.079957 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-210f9cfc-56a0-412c-8732-980e667467a1 tempest-GroupSnapshotsTest-1402242931 None] Create group from source-snapshot-701fc647-4a84-4b43-a93f-26d613fa5a24 completed successfully. Dec 25 21:33:05.243978 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-72893cf3-ea7c-434c-8501-a69a2b5ea22b tempest-GroupSnapshotsTest-1402242931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:33:05.542040 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-72893cf3-ea7c-434c-8501-a69a2b5ea22b tempest-GroupSnapshotsTest-1402242931 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:33:05.863037 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-72893cf3-ea7c-434c-8501-a69a2b5ea22b tempest-GroupSnapshotsTest-1402242931 None] deleting rbd volume volume-e3dbd0c1-eeba-437a-97f0-f47d2b6a83f6 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:33:06.605603 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-ed0a29af-430c-4a86-b20d-e5af037c323d tempest-VolumesActionsTest-1050374675 None] Created reservations ['ab168b72-b569-4bc4-8834-cfa2bf80d9cb', '9f9d5315-806e-4384-991d-3ef77697b266', '74e922ef-eb83-4503-a993-54db5f328809', '2d546efc-d5ec-46c6-8d03-bc2363c2f711'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:33:06.826158 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ed0a29af-430c-4a86-b20d-e5af037c323d tempest-VolumesActionsTest-1050374675 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:33:06.868231 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ed0a29af-430c-4a86-b20d-e5af037c323d tempest-VolumesActionsTest-1050374675 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:33:06.909045 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-ed0a29af-430c-4a86-b20d-e5af037c323d tempest-VolumesActionsTest-1050374675 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:33:06.924451 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-ed0a29af-430c-4a86-b20d-e5af037c323d tempest-VolumesActionsTest-1050374675 None] Deleted volume successfully. Dec 25 21:33:06.934803 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-85c02b23-17f5-4ea3-9e85-c658f4e19638 req-c4f40fad-3615-4c14-8849-826f45d18273 tempest-TestVolumeBootPattern-1499667379 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:33:07.045594 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-ed0a29af-430c-4a86-b20d-e5af037c323d tempest-VolumesActionsTest-1050374675 None] Lock "b'cinder-16f102f3-273f-4124-8669-3e8a2c022688-delete_volume'" released by "delete_volume" :: held 12.337s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:33:07.676147 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-85c02b23-17f5-4ea3-9e85-c658f4e19638 req-c4f40fad-3615-4c14-8849-826f45d18273 tempest-TestVolumeBootPattern-1499667379 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.741s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:33:07.676828 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-85c02b23-17f5-4ea3-9e85-c658f4e19638 req-c4f40fad-3615-4c14-8849-826f45d18273 tempest-TestVolumeBootPattern-1499667379 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-63db5869-7587-4d2a-ac56-8b2e33092808', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': '63db5869-7587-4d2a-ac56-8b2e33092808', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 21:33:07.774385 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-85c02b23-17f5-4ea3-9e85-c658f4e19638 req-c4f40fad-3615-4c14-8849-826f45d18273 tempest-TestVolumeBootPattern-1499667379 None] Connection info returned from driver {'name': 'volumes/volume-63db5869-7587-4d2a-ac56-8b2e33092808', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '63db5869-7587-4d2a-ac56-8b2e33092808', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ae2ea7d3-0909-4c8d-8c1a-948a60d2036e'} {{(pid=129926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 25 21:33:07.936581 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-85c02b23-17f5-4ea3-9e85-c658f4e19638 req-c4f40fad-3615-4c14-8849-826f45d18273 tempest-TestVolumeBootPattern-1499667379 None] attachment_update completed successfully. Dec 25 21:33:08.358165 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9ead3ae-15b3-4508-82a7-5dba64bb4686 tempest-VolumesActionsTest-2089127211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:33:08.362051 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-f9ead3ae-15b3-4508-82a7-5dba64bb4686 tempest-VolumesActionsTest-2089127211 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:33:08.362539 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-f9ead3ae-15b3-4508-82a7-5dba64bb4686 tempest-VolumesActionsTest-2089127211 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:33:08.376623 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f9ead3ae-15b3-4508-82a7-5dba64bb4686 tempest-VolumesActionsTest-2089127211 None] Flow 'volume_create_manager' (9bb41bb9-bfe2-4e0b-9e8e-df11beb1a5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:33:08.380335 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f9ead3ae-15b3-4508-82a7-5dba64bb4686 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a44ad6f-b9d9-4d99-9c15-a1d5f537c16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:08.387292 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-f9ead3ae-15b3-4508-82a7-5dba64bb4686 tempest-VolumesActionsTest-2089127211 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:33:08.406059 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f9ead3ae-15b3-4508-82a7-5dba64bb4686 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a44ad6f-b9d9-4d99-9c15-a1d5f537c16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2088179623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9fd4e77d-2aec-4cb2-84ba-b020435db22e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71418288426545dea311f347bd0cbfdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:33:08Z,use_quota=True,user_id='f2237f90a5db4203805e0a7f287f0964',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:08.410843 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f9ead3ae-15b3-4508-82a7-5dba64bb4686 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c92be963-7117-481f-924b-b1c8a4565c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:08.415136 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f9ead3ae-15b3-4508-82a7-5dba64bb4686 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c92be963-7117-481f-924b-b1c8a4565c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:08.418237 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f9ead3ae-15b3-4508-82a7-5dba64bb4686 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4793e4e5-fa60-450b-9f47-f58df77c6aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:08.420842 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f9ead3ae-15b3-4508-82a7-5dba64bb4686 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4793e4e5-fa60-450b-9f47-f58df77c6aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fd4e77d-2aec-4cb2-84ba-b020435db22e', 'volume_name': 'volume-9fd4e77d-2aec-4cb2-84ba-b020435db22e', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:08.423451 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f9ead3ae-15b3-4508-82a7-5dba64bb4686 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc71c70f-1968-40a3-8a54-18292a946905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:08.426775 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f9ead3ae-15b3-4508-82a7-5dba64bb4686 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc71c70f-1968-40a3-8a54-18292a946905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:08.429025 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f9ead3ae-15b3-4508-82a7-5dba64bb4686 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20a35e91-c264-439a-ad9b-f1c117fae1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:08.430057 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-f9ead3ae-15b3-4508-82a7-5dba64bb4686 tempest-VolumesActionsTest-2089127211 None] Volume 9fd4e77d-2aec-4cb2-84ba-b020435db22e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fd4e77d-2aec-4cb2-84ba-b020435db22e', 'volume_size': 1} Dec 25 21:33:08.430458 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f9ead3ae-15b3-4508-82a7-5dba64bb4686 tempest-VolumesActionsTest-2089127211 None] creating volume 'volume-9fd4e77d-2aec-4cb2-84ba-b020435db22e' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:33:08.431559 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f9ead3ae-15b3-4508-82a7-5dba64bb4686 tempest-VolumesActionsTest-2089127211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:33:09.431444 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f9ead3ae-15b3-4508-82a7-5dba64bb4686 tempest-VolumesActionsTest-2089127211 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:33:09.437613 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f9ead3ae-15b3-4508-82a7-5dba64bb4686 tempest-VolumesActionsTest-2089127211 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:33:09.437613 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f9ead3ae-15b3-4508-82a7-5dba64bb4686 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20a35e91-c264-439a-ad9b-f1c117fae1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fd4e77d-2aec-4cb2-84ba-b020435db22e', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:09.437613 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f9ead3ae-15b3-4508-82a7-5dba64bb4686 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (101c93d1-cd05-40d2-806d-bbeeb350dc26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:09.549736 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-f9ead3ae-15b3-4508-82a7-5dba64bb4686 tempest-VolumesActionsTest-2089127211 None] Volume volume-9fd4e77d-2aec-4cb2-84ba-b020435db22e (9fd4e77d-2aec-4cb2-84ba-b020435db22e): created successfully Dec 25 21:33:09.552108 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f9ead3ae-15b3-4508-82a7-5dba64bb4686 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (101c93d1-cd05-40d2-806d-bbeeb350dc26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:09.555378 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f9ead3ae-15b3-4508-82a7-5dba64bb4686 tempest-VolumesActionsTest-2089127211 None] Flow 'volume_create_manager' (9bb41bb9-bfe2-4e0b-9e8e-df11beb1a5ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:33:09.648200 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-f9ead3ae-15b3-4508-82a7-5dba64bb4686 tempest-VolumesActionsTest-2089127211 None] Created volume successfully. Dec 25 21:33:10.652247 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-907a3c48-908b-44c6-a41d-91d2233bd3a3 tempest-VolumesActionsTest-1540518602 None] Created reservations ['708765a6-01f1-4c94-9dd3-117d01872421', 'cfda3f35-0904-4c37-a7e7-05732491c291', 'c73bdcdf-07af-4d88-8e97-ec24771e3e55', 'a60e95ff-c8cd-4c28-b09c-2cc1f17b1527'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:33:10.776533 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-c476c56e-aca6-4d20-b1f1-f8225020b491 tempest-VolumesActionsTest-1050374675 None] Lock "b'cinder-9fd4e77d-2aec-4cb2-84ba-b020435db22e-delete_volume'" acquired by "delete_volume" :: waited 0.028s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:33:10.890880 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-c476c56e-aca6-4d20-b1f1-f8225020b491 tempest-VolumesActionsTest-1050374675 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:33:11.168128 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-c476c56e-aca6-4d20-b1f1-f8225020b491 tempest-VolumesActionsTest-1050374675 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:33:11.169266 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-c476c56e-aca6-4d20-b1f1-f8225020b491 tempest-VolumesActionsTest-1050374675 None] Volume volume-9fd4e77d-2aec-4cb2-84ba-b020435db22e is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:33:11.420184 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-c476c56e-aca6-4d20-b1f1-f8225020b491 tempest-VolumesActionsTest-1050374675 None] deleting rbd volume volume-9fd4e77d-2aec-4cb2-84ba-b020435db22e {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:33:11.424562 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-907a3c48-908b-44c6-a41d-91d2233bd3a3 tempest-VolumesActionsTest-1540518602 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:33:11.452087 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-907a3c48-908b-44c6-a41d-91d2233bd3a3 tempest-VolumesActionsTest-1540518602 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:33:11.500561 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-907a3c48-908b-44c6-a41d-91d2233bd3a3 tempest-VolumesActionsTest-1540518602 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:33:11.507146 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-907a3c48-908b-44c6-a41d-91d2233bd3a3 tempest-VolumesActionsTest-1540518602 None] Deleted volume successfully. Dec 25 21:33:11.598422 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-907a3c48-908b-44c6-a41d-91d2233bd3a3 tempest-VolumesActionsTest-1540518602 None] Lock "b'cinder-41f6d481-75b9-4ac9-aa97-c3a0f02dd0cc-delete_volume'" released by "delete_volume" :: held 9.453s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:33:14.175391 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-72893cf3-ea7c-434c-8501-a69a2b5ea22b tempest-GroupSnapshotsTest-1402242931 None] Created reservations ['54142e05-53f8-4530-b340-bed238c67267'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:33:14.191954 ncdv-master-1 cinder-volume[129926]: WARNING cinder.quota [None req-72893cf3-ea7c-434c-8501-a69a2b5ea22b tempest-GroupSnapshotsTest-1402242931 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1061109169 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1061109169, it is now deprecated. Please use the default quota class for default quota. Dec 25 21:33:14.192741 ncdv-master-1 cinder-volume[129926]: WARNING cinder.quota [None req-72893cf3-ea7c-434c-8501-a69a2b5ea22b tempest-GroupSnapshotsTest-1402242931 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1061109169 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1061109169, it is now deprecated. Please use the default quota class for default quota. Dec 25 21:33:14.265125 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-72893cf3-ea7c-434c-8501-a69a2b5ea22b tempest-GroupSnapshotsTest-1402242931 None] Created reservations ['7219f98e-467e-4823-91c5-9ba0307f6b0d', '8ef7f8b4-4c88-4095-93be-1f538cc90549', 'a0fd789c-e3ef-4b7d-8821-910f80a39aab', '6a94317a-48b6-445a-b624-a5234d247d85'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:33:14.657190 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-72893cf3-ea7c-434c-8501-a69a2b5ea22b tempest-GroupSnapshotsTest-1402242931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:33:14.687330 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-72893cf3-ea7c-434c-8501-a69a2b5ea22b tempest-GroupSnapshotsTest-1402242931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:33:14.713150 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-72893cf3-ea7c-434c-8501-a69a2b5ea22b tempest-GroupSnapshotsTest-1402242931 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:33:14.718012 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-72893cf3-ea7c-434c-8501-a69a2b5ea22b tempest-GroupSnapshotsTest-1402242931 None] Delete group completed successfully. Dec 25 21:33:14.740310 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-225526c3-f02a-4d0f-9eba-82cb152e8a0b tempest-VolumesBackupsV39Test-1766595062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:33:14.743754 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-225526c3-f02a-4d0f-9eba-82cb152e8a0b tempest-VolumesBackupsV39Test-1766595062 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:33:14.744189 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-225526c3-f02a-4d0f-9eba-82cb152e8a0b tempest-VolumesBackupsV39Test-1766595062 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:33:14.756459 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-225526c3-f02a-4d0f-9eba-82cb152e8a0b tempest-VolumesBackupsV39Test-1766595062 None] Flow 'volume_create_manager' (71078562-3076-4d07-aa11-d12836533c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:33:14.760737 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-225526c3-f02a-4d0f-9eba-82cb152e8a0b tempest-VolumesBackupsV39Test-1766595062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89ad7aa3-b1bd-4d6f-aaaa-4f46268c57ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:14.770967 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-225526c3-f02a-4d0f-9eba-82cb152e8a0b tempest-VolumesBackupsV39Test-1766595062 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:33:14.780839 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-225526c3-f02a-4d0f-9eba-82cb152e8a0b tempest-VolumesBackupsV39Test-1766595062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89ad7aa3-b1bd-4d6f-aaaa-4f46268c57ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Volume-38615121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=418b0ee7-9825-409e-a27f-ab8034c2c05f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45b0c92954754ea791ec111677972332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:33:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:33:15Z,use_quota=True,user_id='4a10d60f8b244da881d219d6fdc011f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:14.784174 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-225526c3-f02a-4d0f-9eba-82cb152e8a0b tempest-VolumesBackupsV39Test-1766595062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaa75dea-8344-4b4a-a9b2-311714fae800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:14.786393 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-225526c3-f02a-4d0f-9eba-82cb152e8a0b tempest-VolumesBackupsV39Test-1766595062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaa75dea-8344-4b4a-a9b2-311714fae800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:14.788762 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-225526c3-f02a-4d0f-9eba-82cb152e8a0b tempest-VolumesBackupsV39Test-1766595062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (887769bb-1783-4bc4-90de-8c0189de0ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:14.791000 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-225526c3-f02a-4d0f-9eba-82cb152e8a0b tempest-VolumesBackupsV39Test-1766595062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (887769bb-1783-4bc4-90de-8c0189de0ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '418b0ee7-9825-409e-a27f-ab8034c2c05f', 'volume_name': 'volume-418b0ee7-9825-409e-a27f-ab8034c2c05f', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:14.793429 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-225526c3-f02a-4d0f-9eba-82cb152e8a0b tempest-VolumesBackupsV39Test-1766595062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c16a80f6-161a-4f36-aad6-0d2ba5769744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:14.795537 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-225526c3-f02a-4d0f-9eba-82cb152e8a0b tempest-VolumesBackupsV39Test-1766595062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c16a80f6-161a-4f36-aad6-0d2ba5769744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:14.798406 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-225526c3-f02a-4d0f-9eba-82cb152e8a0b tempest-VolumesBackupsV39Test-1766595062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb371ef7-260a-4581-a150-df0e53a10983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:14.799244 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-225526c3-f02a-4d0f-9eba-82cb152e8a0b tempest-VolumesBackupsV39Test-1766595062 None] Volume 418b0ee7-9825-409e-a27f-ab8034c2c05f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-418b0ee7-9825-409e-a27f-ab8034c2c05f', 'volume_size': 1} Dec 25 21:33:14.799628 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-225526c3-f02a-4d0f-9eba-82cb152e8a0b tempest-VolumesBackupsV39Test-1766595062 None] creating volume 'volume-418b0ee7-9825-409e-a27f-ab8034c2c05f' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:33:14.800576 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-225526c3-f02a-4d0f-9eba-82cb152e8a0b tempest-VolumesBackupsV39Test-1766595062 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:33:15.742367 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-b0a2d0cc-d57c-4ff5-bdfa-0d3bd2e22936 tempest-GroupSnapshotsTest-1402242931 None] group_snapshot 701fc647-4a84-4b43-a93f-26d613fa5a24: deleting Dec 25 21:33:15.757252 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b0a2d0cc-d57c-4ff5-bdfa-0d3bd2e22936 tempest-GroupSnapshotsTest-1402242931 None] group_snapshot 701fc647-4a84-4b43-a93f-26d613fa5a24: deleting {{(pid=129926) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4253}} Dec 25 21:33:15.773134 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b0a2d0cc-d57c-4ff5-bdfa-0d3bd2e22936 tempest-GroupSnapshotsTest-1402242931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:33:16.008640 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-225526c3-f02a-4d0f-9eba-82cb152e8a0b tempest-VolumesBackupsV39Test-1766595062 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:33:16.009063 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-225526c3-f02a-4d0f-9eba-82cb152e8a0b tempest-VolumesBackupsV39Test-1766595062 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:33:16.011278 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-225526c3-f02a-4d0f-9eba-82cb152e8a0b tempest-VolumesBackupsV39Test-1766595062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb371ef7-260a-4581-a150-df0e53a10983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-418b0ee7-9825-409e-a27f-ab8034c2c05f', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:16.015727 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-225526c3-f02a-4d0f-9eba-82cb152e8a0b tempest-VolumesBackupsV39Test-1766595062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b102009-56c4-4007-af8e-157b85ff54f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:16.072786 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-225526c3-f02a-4d0f-9eba-82cb152e8a0b tempest-VolumesBackupsV39Test-1766595062 None] Volume volume-418b0ee7-9825-409e-a27f-ab8034c2c05f (418b0ee7-9825-409e-a27f-ab8034c2c05f): created successfully Dec 25 21:33:16.075084 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-225526c3-f02a-4d0f-9eba-82cb152e8a0b tempest-VolumesBackupsV39Test-1766595062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b102009-56c4-4007-af8e-157b85ff54f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:16.078370 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-225526c3-f02a-4d0f-9eba-82cb152e8a0b tempest-VolumesBackupsV39Test-1766595062 None] Flow 'volume_create_manager' (71078562-3076-4d07-aa11-d12836533c0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:33:16.124147 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-225526c3-f02a-4d0f-9eba-82cb152e8a0b tempest-VolumesBackupsV39Test-1766595062 None] Created volume successfully. Dec 25 21:33:19.443819 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-c476c56e-aca6-4d20-b1f1-f8225020b491 tempest-VolumesActionsTest-1050374675 None] Created reservations ['df01542f-6891-4da4-b0d4-32541d256344', 'bc4707d2-ca45-46f3-9095-d6c1ddb722a5', '504798aa-9872-41c2-95eb-7bec003c8d9a', '92b0b75a-c77a-43c3-a6ae-cb87ed977b72'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:33:19.657812 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-c476c56e-aca6-4d20-b1f1-f8225020b491 tempest-VolumesActionsTest-1050374675 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:33:19.740831 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-c476c56e-aca6-4d20-b1f1-f8225020b491 tempest-VolumesActionsTest-1050374675 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:33:19.790196 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-c476c56e-aca6-4d20-b1f1-f8225020b491 tempest-VolumesActionsTest-1050374675 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:33:19.796758 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-c476c56e-aca6-4d20-b1f1-f8225020b491 tempest-VolumesActionsTest-1050374675 None] Deleted volume successfully. Dec 25 21:33:19.879744 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-c476c56e-aca6-4d20-b1f1-f8225020b491 tempest-VolumesActionsTest-1050374675 None] Lock "b'cinder-9fd4e77d-2aec-4cb2-84ba-b020435db22e-delete_volume'" released by "delete_volume" :: held 9.104s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:33:20.045359 ncdv-master-1 cinder-volume[129926]: WARNING cinder.quota [None req-b0a2d0cc-d57c-4ff5-bdfa-0d3bd2e22936 tempest-GroupSnapshotsTest-1402242931 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1061109169 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1061109169, it is now deprecated. Please use the default quota class for default quota. Dec 25 21:33:20.116054 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-b0a2d0cc-d57c-4ff5-bdfa-0d3bd2e22936 tempest-GroupSnapshotsTest-1402242931 None] Created reservations ['f6f5de76-e48c-40e6-9426-9b9fd1480434', '547d562f-024d-4f12-9d2e-056e993e4510', 'f9bc603e-8bd1-4f0c-b198-418f4fd41c97', 'e411d095-e186-474b-ba48-fd12c0ec0a18'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:33:20.410217 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-b0a2d0cc-d57c-4ff5-bdfa-0d3bd2e22936 tempest-GroupSnapshotsTest-1402242931 None] group_snapshot 701fc647-4a84-4b43-a93f-26d613fa5a24: deleted successfully Dec 25 21:33:20.617800 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [None req-8826072d-9c7d-40e0-8d21-863b3def84e5 tempest-VolumesBackupsV39Test-1766595062 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:33:21.356329 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-827c9447-1472-4138-9009-664d2c4af047 req-8325bc48-d212-4f2a-9692-31e827f1bf9b tempest-TestVolumeBootPattern-1499667379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:33:21.638303 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [None req-8826072d-9c7d-40e0-8d21-863b3def84e5 tempest-VolumesBackupsV39Test-1766595062 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.020s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:33:21.639781 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-8826072d-9c7d-40e0-8d21-863b3def84e5 tempest-VolumesBackupsV39Test-1766595062 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-418b0ee7-9825-409e-a27f-ab8034c2c05f', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': '418b0ee7-9825-409e-a27f-ab8034c2c05f', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 21:33:21.685272 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-8826072d-9c7d-40e0-8d21-863b3def84e5 tempest-VolumesBackupsV39Test-1766595062 None] Initialize volume connection completed successfully. Dec 25 21:33:21.705555 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7fc64897-141a-4ddc-86ae-8888c8606b2e tempest-GroupSnapshotsTest-1402242931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:33:21.951237 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7fc64897-141a-4ddc-86ae-8888c8606b2e tempest-GroupSnapshotsTest-1402242931 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:33:21.951237 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7fc64897-141a-4ddc-86ae-8888c8606b2e tempest-GroupSnapshotsTest-1402242931 None] Volume volume-8daddb8a-c31d-4e21-a2ac-39be7a4477d3 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:33:22.272416 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7fc64897-141a-4ddc-86ae-8888c8606b2e tempest-GroupSnapshotsTest-1402242931 None] deleting rbd volume volume-8daddb8a-c31d-4e21-a2ac-39be7a4477d3 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:33:22.351442 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-65fe2a89-511e-4444-87f1-49ac45993c6c tempest-VolumesActionsTest-2089127211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:33:22.355568 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-65fe2a89-511e-4444-87f1-49ac45993c6c tempest-VolumesActionsTest-2089127211 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:33:22.356055 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-65fe2a89-511e-4444-87f1-49ac45993c6c tempest-VolumesActionsTest-2089127211 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:33:22.368564 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-65fe2a89-511e-4444-87f1-49ac45993c6c tempest-VolumesActionsTest-2089127211 None] Flow 'volume_create_manager' (230a4d5c-2263-4cee-bf90-e796ff253dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:33:22.371948 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-65fe2a89-511e-4444-87f1-49ac45993c6c tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6352f925-3557-4018-9bb2-09f1377784e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:22.378850 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-65fe2a89-511e-4444-87f1-49ac45993c6c tempest-VolumesActionsTest-2089127211 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:33:22.391396 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-65fe2a89-511e-4444-87f1-49ac45993c6c tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6352f925-3557-4018-9bb2-09f1377784e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-128181068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3599da99-01c2-4596-80ee-79e18d887a4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71418288426545dea311f347bd0cbfdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:33:21Z,use_quota=True,user_id='f2237f90a5db4203805e0a7f287f0964',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:22.394006 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-65fe2a89-511e-4444-87f1-49ac45993c6c tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (484bcbf2-a13d-41ee-b0e1-911f891bdbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:22.396182 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-65fe2a89-511e-4444-87f1-49ac45993c6c tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (484bcbf2-a13d-41ee-b0e1-911f891bdbac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:22.399919 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-65fe2a89-511e-4444-87f1-49ac45993c6c tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b3ee81-6714-4a91-a525-99be97a7866f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:22.400985 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-65fe2a89-511e-4444-87f1-49ac45993c6c tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b3ee81-6714-4a91-a525-99be97a7866f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3599da99-01c2-4596-80ee-79e18d887a4b', 'volume_name': 'volume-3599da99-01c2-4596-80ee-79e18d887a4b', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:22.403327 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-65fe2a89-511e-4444-87f1-49ac45993c6c tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15ec9040-7854-4acd-8db7-6d0e3a8cdc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:22.405506 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-65fe2a89-511e-4444-87f1-49ac45993c6c tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15ec9040-7854-4acd-8db7-6d0e3a8cdc78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:22.407972 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-65fe2a89-511e-4444-87f1-49ac45993c6c tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dfc1405-bdfd-419f-8d88-6262c1d3a1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:22.408774 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-65fe2a89-511e-4444-87f1-49ac45993c6c tempest-VolumesActionsTest-2089127211 None] Volume 3599da99-01c2-4596-80ee-79e18d887a4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3599da99-01c2-4596-80ee-79e18d887a4b', 'volume_size': 1} Dec 25 21:33:22.409201 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-65fe2a89-511e-4444-87f1-49ac45993c6c tempest-VolumesActionsTest-2089127211 None] creating volume 'volume-3599da99-01c2-4596-80ee-79e18d887a4b' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:33:22.410210 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-65fe2a89-511e-4444-87f1-49ac45993c6c tempest-VolumesActionsTest-2089127211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:33:24.024219 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-65fe2a89-511e-4444-87f1-49ac45993c6c tempest-VolumesActionsTest-2089127211 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:33:24.026257 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-65fe2a89-511e-4444-87f1-49ac45993c6c tempest-VolumesActionsTest-2089127211 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:33:24.026730 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-65fe2a89-511e-4444-87f1-49ac45993c6c tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dfc1405-bdfd-419f-8d88-6262c1d3a1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3599da99-01c2-4596-80ee-79e18d887a4b', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:24.028936 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-65fe2a89-511e-4444-87f1-49ac45993c6c tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcdf49af-560c-47fc-bd3a-02dda31150a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:24.112954 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-65fe2a89-511e-4444-87f1-49ac45993c6c tempest-VolumesActionsTest-2089127211 None] Volume volume-3599da99-01c2-4596-80ee-79e18d887a4b (3599da99-01c2-4596-80ee-79e18d887a4b): created successfully Dec 25 21:33:24.115105 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-65fe2a89-511e-4444-87f1-49ac45993c6c tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcdf49af-560c-47fc-bd3a-02dda31150a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:24.118173 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-65fe2a89-511e-4444-87f1-49ac45993c6c tempest-VolumesActionsTest-2089127211 None] Flow 'volume_create_manager' (230a4d5c-2263-4cee-bf90-e796ff253dcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:33:24.210401 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-65fe2a89-511e-4444-87f1-49ac45993c6c tempest-VolumesActionsTest-2089127211 None] Created volume successfully. Dec 25 21:33:24.741019 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-1d13a16f-6b06-4fd2-80d9-f5e40636d4c3 tempest-VolumesActionsTest-1050374675 None] Lock "b'cinder-3599da99-01c2-4596-80ee-79e18d887a4b-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:33:24.997382 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-1d13a16f-6b06-4fd2-80d9-f5e40636d4c3 tempest-VolumesActionsTest-1050374675 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:33:25.441231 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-1d13a16f-6b06-4fd2-80d9-f5e40636d4c3 tempest-VolumesActionsTest-1050374675 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:33:25.442641 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-1d13a16f-6b06-4fd2-80d9-f5e40636d4c3 tempest-VolumesActionsTest-1050374675 None] Volume volume-3599da99-01c2-4596-80ee-79e18d887a4b is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:33:25.706879 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-1d13a16f-6b06-4fd2-80d9-f5e40636d4c3 tempest-VolumesActionsTest-1050374675 None] deleting rbd volume volume-3599da99-01c2-4596-80ee-79e18d887a4b {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:33:25.711616 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-827c9447-1472-4138-9009-664d2c4af047 req-8325bc48-d212-4f2a-9692-31e827f1bf9b tempest-TestVolumeBootPattern-1499667379 None] Create snapshot completed successfully Dec 25 21:33:25.905871 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-361bfc0a-df4b-46f2-815f-b0274490ea9f tempest-AttachVolumeShelveTestJSON-1279821748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:33:25.909251 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-361bfc0a-df4b-46f2-815f-b0274490ea9f tempest-AttachVolumeShelveTestJSON-1279821748 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:33:25.913735 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-361bfc0a-df4b-46f2-815f-b0274490ea9f tempest-AttachVolumeShelveTestJSON-1279821748 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:33:25.922049 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-361bfc0a-df4b-46f2-815f-b0274490ea9f tempest-AttachVolumeShelveTestJSON-1279821748 None] Flow 'volume_create_manager' (d380ab0a-c215-426f-9859-7e74fcf8916c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:33:25.925365 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-361bfc0a-df4b-46f2-815f-b0274490ea9f tempest-AttachVolumeShelveTestJSON-1279821748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f117561f-f11f-435a-84bc-5d6bb94853df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:25.932114 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-361bfc0a-df4b-46f2-815f-b0274490ea9f tempest-AttachVolumeShelveTestJSON-1279821748 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:33:25.959686 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-361bfc0a-df4b-46f2-815f-b0274490ea9f tempest-AttachVolumeShelveTestJSON-1279821748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f117561f-f11f-435a-84bc-5d6bb94853df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1057294119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c6f19b7c-8208-496f-b21d-a897c1383467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0560c323ec8e41b3bc05939e12e049d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:33:26Z,use_quota=True,user_id='517838d2d4a942bfa8b332c767c60904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:25.962588 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-361bfc0a-df4b-46f2-815f-b0274490ea9f tempest-AttachVolumeShelveTestJSON-1279821748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e4ed90-5782-4697-a0c2-4a64f6164fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:25.965075 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-361bfc0a-df4b-46f2-815f-b0274490ea9f tempest-AttachVolumeShelveTestJSON-1279821748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e4ed90-5782-4697-a0c2-4a64f6164fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:25.967661 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-361bfc0a-df4b-46f2-815f-b0274490ea9f tempest-AttachVolumeShelveTestJSON-1279821748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dda8bb5a-ba15-44a5-a08c-fb10b3ac4160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:25.970806 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-361bfc0a-df4b-46f2-815f-b0274490ea9f tempest-AttachVolumeShelveTestJSON-1279821748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dda8bb5a-ba15-44a5-a08c-fb10b3ac4160) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6f19b7c-8208-496f-b21d-a897c1383467', 'volume_name': 'volume-c6f19b7c-8208-496f-b21d-a897c1383467', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:25.973270 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-361bfc0a-df4b-46f2-815f-b0274490ea9f tempest-AttachVolumeShelveTestJSON-1279821748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66fb0722-fa19-47ce-ab5b-18c66a5006d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:25.975421 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-361bfc0a-df4b-46f2-815f-b0274490ea9f tempest-AttachVolumeShelveTestJSON-1279821748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66fb0722-fa19-47ce-ab5b-18c66a5006d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:25.977661 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-361bfc0a-df4b-46f2-815f-b0274490ea9f tempest-AttachVolumeShelveTestJSON-1279821748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80572d04-35e9-4d2d-b2d6-24824ac5f1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:25.978568 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-361bfc0a-df4b-46f2-815f-b0274490ea9f tempest-AttachVolumeShelveTestJSON-1279821748 None] Volume c6f19b7c-8208-496f-b21d-a897c1383467: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6f19b7c-8208-496f-b21d-a897c1383467', 'volume_size': 1} Dec 25 21:33:25.978834 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-361bfc0a-df4b-46f2-815f-b0274490ea9f tempest-AttachVolumeShelveTestJSON-1279821748 None] creating volume 'volume-c6f19b7c-8208-496f-b21d-a897c1383467' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:33:25.979836 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-361bfc0a-df4b-46f2-815f-b0274490ea9f tempest-AttachVolumeShelveTestJSON-1279821748 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:33:27.367301 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-361bfc0a-df4b-46f2-815f-b0274490ea9f tempest-AttachVolumeShelveTestJSON-1279821748 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:33:27.372436 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-361bfc0a-df4b-46f2-815f-b0274490ea9f tempest-AttachVolumeShelveTestJSON-1279821748 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:33:27.372436 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-361bfc0a-df4b-46f2-815f-b0274490ea9f tempest-AttachVolumeShelveTestJSON-1279821748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80572d04-35e9-4d2d-b2d6-24824ac5f1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6f19b7c-8208-496f-b21d-a897c1383467', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:27.372436 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-361bfc0a-df4b-46f2-815f-b0274490ea9f tempest-AttachVolumeShelveTestJSON-1279821748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b794a67d-18cb-4eb4-b9a9-1d80fed25db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:27.466567 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-361bfc0a-df4b-46f2-815f-b0274490ea9f tempest-AttachVolumeShelveTestJSON-1279821748 None] Volume volume-c6f19b7c-8208-496f-b21d-a897c1383467 (c6f19b7c-8208-496f-b21d-a897c1383467): created successfully Dec 25 21:33:27.468533 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-361bfc0a-df4b-46f2-815f-b0274490ea9f tempest-AttachVolumeShelveTestJSON-1279821748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b794a67d-18cb-4eb4-b9a9-1d80fed25db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:27.471762 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-361bfc0a-df4b-46f2-815f-b0274490ea9f tempest-AttachVolumeShelveTestJSON-1279821748 None] Flow 'volume_create_manager' (d380ab0a-c215-426f-9859-7e74fcf8916c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:33:27.607217 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-361bfc0a-df4b-46f2-815f-b0274490ea9f tempest-AttachVolumeShelveTestJSON-1279821748 None] Created volume successfully. Dec 25 21:33:30.347366 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [req-82931d7c-ef42-453e-8fe5-04a9e43f36bc req-c48e0f59-6608-4a91-a582-5470b0bf7488 tempest-TestVolumeBootPattern-1499667379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:33:30.350829 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [req-82931d7c-ef42-453e-8fe5-04a9e43f36bc req-c48e0f59-6608-4a91-a582-5470b0bf7488 tempest-TestVolumeBootPattern-1499667379 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:33:30.357963 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [req-82931d7c-ef42-453e-8fe5-04a9e43f36bc req-c48e0f59-6608-4a91-a582-5470b0bf7488 tempest-TestVolumeBootPattern-1499667379 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:33:30.372584 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-82931d7c-ef42-453e-8fe5-04a9e43f36bc req-c48e0f59-6608-4a91-a582-5470b0bf7488 tempest-TestVolumeBootPattern-1499667379 None] Flow 'volume_create_manager' (049c6f03-1989-4000-9d9c-36ad8a4694f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:33:30.376447 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-82931d7c-ef42-453e-8fe5-04a9e43f36bc req-c48e0f59-6608-4a91-a582-5470b0bf7488 tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76075f2e-d43a-411a-bf68-19006ac9ec43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:30.421359 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [req-82931d7c-ef42-453e-8fe5-04a9e43f36bc req-c48e0f59-6608-4a91-a582-5470b0bf7488 tempest-TestVolumeBootPattern-1499667379 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:33:30.434210 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-82931d7c-ef42-453e-8fe5-04a9e43f36bc req-c48e0f59-6608-4a91-a582-5470b0bf7488 tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76075f2e-d43a-411a-bf68-19006ac9ec43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:33:30Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=44f518a8-0417-4cf7-ab00-ecd532f8439e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c77dc74a46d64a67991d82bf12adb1dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=408acdab-9a9e-4132-bb02-430bae4d8a1d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:33:30Z,use_quota=True,user_id='171c198b6b734cd698b3c1eaf76a0234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:30.436926 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-82931d7c-ef42-453e-8fe5-04a9e43f36bc req-c48e0f59-6608-4a91-a582-5470b0bf7488 tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbcd8e05-2c73-4bcd-b379-346594419001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:30.439648 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-82931d7c-ef42-453e-8fe5-04a9e43f36bc req-c48e0f59-6608-4a91-a582-5470b0bf7488 tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbcd8e05-2c73-4bcd-b379-346594419001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:30.442121 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-82931d7c-ef42-453e-8fe5-04a9e43f36bc req-c48e0f59-6608-4a91-a582-5470b0bf7488 tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fca5801e-452c-4689-818b-79892d8a76fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:30.444355 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-82931d7c-ef42-453e-8fe5-04a9e43f36bc req-c48e0f59-6608-4a91-a582-5470b0bf7488 tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fca5801e-452c-4689-818b-79892d8a76fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '44f518a8-0417-4cf7-ab00-ecd532f8439e', 'volume_name': 'volume-44f518a8-0417-4cf7-ab00-ecd532f8439e', 'volume_size': 1, 'snapshot_id': '408acdab-9a9e-4132-bb02-430bae4d8a1d'}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:30.446974 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-82931d7c-ef42-453e-8fe5-04a9e43f36bc req-c48e0f59-6608-4a91-a582-5470b0bf7488 tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f39710e7-77c1-46af-afb4-d8d586d0f3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:30.451189 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-82931d7c-ef42-453e-8fe5-04a9e43f36bc req-c48e0f59-6608-4a91-a582-5470b0bf7488 tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f39710e7-77c1-46af-afb4-d8d586d0f3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:30.451329 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-82931d7c-ef42-453e-8fe5-04a9e43f36bc req-c48e0f59-6608-4a91-a582-5470b0bf7488 tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80f7688e-4089-4f5e-82a1-fc0cdd65f6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:30.452134 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [req-82931d7c-ef42-453e-8fe5-04a9e43f36bc req-c48e0f59-6608-4a91-a582-5470b0bf7488 tempest-TestVolumeBootPattern-1499667379 None] Volume 44f518a8-0417-4cf7-ab00-ecd532f8439e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-44f518a8-0417-4cf7-ab00-ecd532f8439e', 'volume_size': 1, 'snapshot_id': '408acdab-9a9e-4132-bb02-430bae4d8a1d'} Dec 25 21:33:30.475849 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-82931d7c-ef42-453e-8fe5-04a9e43f36bc req-c48e0f59-6608-4a91-a582-5470b0bf7488 tempest-TestVolumeBootPattern-1499667379 None] cloning volumes/volume-63db5869-7587-4d2a-ac56-8b2e33092808@snapshot-408acdab-9a9e-4132-bb02-430bae4d8a1d to volume-44f518a8-0417-4cf7-ab00-ecd532f8439e {{(pid=129926) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Dec 25 21:33:30.476787 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-82931d7c-ef42-453e-8fe5-04a9e43f36bc req-c48e0f59-6608-4a91-a582-5470b0bf7488 tempest-TestVolumeBootPattern-1499667379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:33:30.576244 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-82931d7c-ef42-453e-8fe5-04a9e43f36bc req-c48e0f59-6608-4a91-a582-5470b0bf7488 tempest-TestVolumeBootPattern-1499667379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:33:31.933064 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-7fc64897-141a-4ddc-86ae-8888c8606b2e tempest-GroupSnapshotsTest-1402242931 None] Created reservations ['8f5a435b-b596-42e2-8c34-45cf452c6390'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:33:31.971587 ncdv-master-1 cinder-volume[129926]: WARNING cinder.db.sqlalchemy.api [None req-7fc64897-141a-4ddc-86ae-8888c8606b2e tempest-GroupSnapshotsTest-1402242931 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1061109169'] Dec 25 21:33:32.055855 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:33:32.057246 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:33:32.090071 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:33:32.117825 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:33:32.121519 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-7fc64897-141a-4ddc-86ae-8888c8606b2e tempest-GroupSnapshotsTest-1402242931 None] Created reservations ['89d20b99-556b-4efd-a7fa-563366192f20', 'f94c338a-3979-47ca-b1aa-151aba2caf52', '281bc018-4c43-4543-a614-e5f5370f7e44', '6f3c58e4-b4c4-4cbc-9076-3456d46f25cf'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:33:32.570562 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7fc64897-141a-4ddc-86ae-8888c8606b2e tempest-GroupSnapshotsTest-1402242931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:33:32.593463 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7fc64897-141a-4ddc-86ae-8888c8606b2e tempest-GroupSnapshotsTest-1402242931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:33:32.617664 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-7fc64897-141a-4ddc-86ae-8888c8606b2e tempest-GroupSnapshotsTest-1402242931 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:33:32.623262 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-7fc64897-141a-4ddc-86ae-8888c8606b2e tempest-GroupSnapshotsTest-1402242931 None] Delete group completed successfully. Dec 25 21:33:33.438516 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-82931d7c-ef42-453e-8fe5-04a9e43f36bc req-c48e0f59-6608-4a91-a582-5470b0bf7488 tempest-TestVolumeBootPattern-1499667379 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:33:33.439081 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-82931d7c-ef42-453e-8fe5-04a9e43f36bc req-c48e0f59-6608-4a91-a582-5470b0bf7488 tempest-TestVolumeBootPattern-1499667379 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:33:33.458226 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.volume_utils [req-82931d7c-ef42-453e-8fe5-04a9e43f36bc req-c48e0f59-6608-4a91-a582-5470b0bf7488 tempest-TestVolumeBootPattern-1499667379 None] Marking volume 44f518a8-0417-4cf7-ab00-ecd532f8439e as bootable. {{(pid=129926) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 25 21:33:33.521285 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [req-82931d7c-ef42-453e-8fe5-04a9e43f36bc req-c48e0f59-6608-4a91-a582-5470b0bf7488 tempest-TestVolumeBootPattern-1499667379 None] Copying metadata from snapshot 408acdab-9a9e-4132-bb02-430bae4d8a1d to 44f518a8-0417-4cf7-ab00-ecd532f8439e. {{(pid=129926) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:422}} Dec 25 21:33:33.575208 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-8826072d-9c7d-40e0-8d21-863b3def84e5 tempest-VolumesBackupsV39Test-1766595062 None] Terminate volume connection completed successfully. Dec 25 21:33:33.595259 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-8826072d-9c7d-40e0-8d21-863b3def84e5 tempest-VolumesBackupsV39Test-1766595062 None] Remove volume export completed successfully. Dec 25 21:33:33.740333 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-82931d7c-ef42-453e-8fe5-04a9e43f36bc req-c48e0f59-6608-4a91-a582-5470b0bf7488 tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80f7688e-4089-4f5e-82a1-fc0cdd65f6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44f518a8-0417-4cf7-ab00-ecd532f8439e', 'volume_size': 1, 'snapshot_id': '408acdab-9a9e-4132-bb02-430bae4d8a1d'}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:33.744238 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-82931d7c-ef42-453e-8fe5-04a9e43f36bc req-c48e0f59-6608-4a91-a582-5470b0bf7488 tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5844779c-885a-461f-9ab2-7f13e809f228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:33.946567 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [req-82931d7c-ef42-453e-8fe5-04a9e43f36bc req-c48e0f59-6608-4a91-a582-5470b0bf7488 tempest-TestVolumeBootPattern-1499667379 None] Volume volume-44f518a8-0417-4cf7-ab00-ecd532f8439e (44f518a8-0417-4cf7-ab00-ecd532f8439e): created successfully Dec 25 21:33:33.949062 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-82931d7c-ef42-453e-8fe5-04a9e43f36bc req-c48e0f59-6608-4a91-a582-5470b0bf7488 tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5844779c-885a-461f-9ab2-7f13e809f228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:33.952744 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-82931d7c-ef42-453e-8fe5-04a9e43f36bc req-c48e0f59-6608-4a91-a582-5470b0bf7488 tempest-TestVolumeBootPattern-1499667379 None] Flow 'volume_create_manager' (049c6f03-1989-4000-9d9c-36ad8a4694f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:33:34.106447 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-82931d7c-ef42-453e-8fe5-04a9e43f36bc req-c48e0f59-6608-4a91-a582-5470b0bf7488 tempest-TestVolumeBootPattern-1499667379 None] Created volume successfully. Dec 25 21:33:34.344558 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-911f037b-3a81-4552-8f36-0c19d158cdd4 tempest-GroupSnapshotsTest-1402242931 None] Group tempest-GroupSnapshotsTest-Group-865842990: creating Dec 25 21:33:34.603548 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-911f037b-3a81-4552-8f36-0c19d158cdd4 tempest-GroupSnapshotsTest-1402242931 None] Group tempest-GroupSnapshotsTest-Group-865842990: created successfully Dec 25 21:33:34.612779 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-911f037b-3a81-4552-8f36-0c19d158cdd4 tempest-GroupSnapshotsTest-1402242931 None] Create group completed successfully. Dec 25 21:33:35.172339 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-1d13a16f-6b06-4fd2-80d9-f5e40636d4c3 tempest-VolumesActionsTest-1050374675 None] Created reservations ['918a5629-d747-4e6c-868c-b0278b33911f', '64bbbe8b-bdc6-4e66-a4d0-d2957c10355f', '68e47cd8-74c0-46db-97cf-fac750832efe', '7ffd1f81-1f8e-4b12-8341-864219278d3b'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:33:35.350939 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-1d13a16f-6b06-4fd2-80d9-f5e40636d4c3 tempest-VolumesActionsTest-1050374675 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:33:35.408484 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-1d13a16f-6b06-4fd2-80d9-f5e40636d4c3 tempest-VolumesActionsTest-1050374675 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:33:35.454354 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-1d13a16f-6b06-4fd2-80d9-f5e40636d4c3 tempest-VolumesActionsTest-1050374675 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:33:35.458591 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-1d13a16f-6b06-4fd2-80d9-f5e40636d4c3 tempest-VolumesActionsTest-1050374675 None] Deleted volume successfully. Dec 25 21:33:35.570067 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-1d13a16f-6b06-4fd2-80d9-f5e40636d4c3 tempest-VolumesActionsTest-1050374675 None] Lock "b'cinder-3599da99-01c2-4596-80ee-79e18d887a4b-delete_volume'" released by "delete_volume" :: held 10.829s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:33:36.358968 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f10ca44-0ed5-4ec7-8122-fb052e97eac5 tempest-VolumesActionsTest-2089127211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:33:36.362664 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-8f10ca44-0ed5-4ec7-8122-fb052e97eac5 tempest-VolumesActionsTest-2089127211 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:33:36.363103 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-8f10ca44-0ed5-4ec7-8122-fb052e97eac5 tempest-VolumesActionsTest-2089127211 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:33:36.377234 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8f10ca44-0ed5-4ec7-8122-fb052e97eac5 tempest-VolumesActionsTest-2089127211 None] Flow 'volume_create_manager' (96c5e297-7e4d-44c5-a9db-08ce702f0d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:33:36.380338 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8f10ca44-0ed5-4ec7-8122-fb052e97eac5 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99fae5c4-fc96-41d4-8e29-f0e7cb2a0598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:36.386662 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-8f10ca44-0ed5-4ec7-8122-fb052e97eac5 tempest-VolumesActionsTest-2089127211 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:33:36.399219 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8f10ca44-0ed5-4ec7-8122-fb052e97eac5 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99fae5c4-fc96-41d4-8e29-f0e7cb2a0598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-238142559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=abecbbce-2ad9-4268-addf-6c52b15c3da2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71418288426545dea311f347bd0cbfdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:33:36Z,use_quota=True,user_id='f2237f90a5db4203805e0a7f287f0964',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:36.401844 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8f10ca44-0ed5-4ec7-8122-fb052e97eac5 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22a9b28c-2f36-4e54-8075-de19dc8b4120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:36.404438 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8f10ca44-0ed5-4ec7-8122-fb052e97eac5 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22a9b28c-2f36-4e54-8075-de19dc8b4120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:36.406877 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8f10ca44-0ed5-4ec7-8122-fb052e97eac5 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55124e90-5954-4134-9f8f-49cd9b3d08af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:36.409112 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8f10ca44-0ed5-4ec7-8122-fb052e97eac5 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55124e90-5954-4134-9f8f-49cd9b3d08af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abecbbce-2ad9-4268-addf-6c52b15c3da2', 'volume_name': 'volume-abecbbce-2ad9-4268-addf-6c52b15c3da2', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:36.411381 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8f10ca44-0ed5-4ec7-8122-fb052e97eac5 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7453cb3e-c727-4d45-bcf8-e8bb38972be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:36.413555 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8f10ca44-0ed5-4ec7-8122-fb052e97eac5 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7453cb3e-c727-4d45-bcf8-e8bb38972be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:36.417396 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8f10ca44-0ed5-4ec7-8122-fb052e97eac5 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad997bb0-cdcf-4e40-bdc3-b2fcdf66eeb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:36.418206 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-8f10ca44-0ed5-4ec7-8122-fb052e97eac5 tempest-VolumesActionsTest-2089127211 None] Volume abecbbce-2ad9-4268-addf-6c52b15c3da2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abecbbce-2ad9-4268-addf-6c52b15c3da2', 'volume_size': 1} Dec 25 21:33:36.418593 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-8f10ca44-0ed5-4ec7-8122-fb052e97eac5 tempest-VolumesActionsTest-2089127211 None] creating volume 'volume-abecbbce-2ad9-4268-addf-6c52b15c3da2' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:33:36.419559 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-8f10ca44-0ed5-4ec7-8122-fb052e97eac5 tempest-VolumesActionsTest-2089127211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:33:36.468631 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d5a51be-6e6d-4b71-82c1-bef860062d34 tempest-GroupSnapshotsTest-1402242931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:33:36.473238 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-2d5a51be-6e6d-4b71-82c1-bef860062d34 tempest-GroupSnapshotsTest-1402242931 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:33:36.473974 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-2d5a51be-6e6d-4b71-82c1-bef860062d34 tempest-GroupSnapshotsTest-1402242931 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:33:36.489597 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-2d5a51be-6e6d-4b71-82c1-bef860062d34 tempest-GroupSnapshotsTest-1402242931 None] Flow 'volume_create_manager' (5f4308ba-9a74-4d6b-a856-9cfdb3ebd84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:33:36.500759 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-2d5a51be-6e6d-4b71-82c1-bef860062d34 tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a5f5b78-350c-4c7e-9e08-a4c8c755c494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:36.500759 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-2d5a51be-6e6d-4b71-82c1-bef860062d34 tempest-GroupSnapshotsTest-1402242931 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:33:36.515491 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-2d5a51be-6e6d-4b71-82c1-bef860062d34 tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a5f5b78-350c-4c7e-9e08-a4c8c755c494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1869196422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=999cbbfb-1314-44c6-b632-2178de7e5be1,host='ncdv-master-1@ceph#ceph',id=ca20cf63-7388-425a-8647-0fab862b20fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='758f44503e1c41dc9aecca962e0c75f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:33:36Z,use_quota=True,user_id='3a838ec078394a5cba918617920febff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a67cc81-91aa-427a-8518-7abf3e08af64),volume_type_id=9a67cc81-91aa-427a-8518-7abf3e08af64)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:36.519139 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-2d5a51be-6e6d-4b71-82c1-bef860062d34 tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8202f5e-9d41-44f3-b1fe-f7f2748ab4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:36.521429 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-2d5a51be-6e6d-4b71-82c1-bef860062d34 tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8202f5e-9d41-44f3-b1fe-f7f2748ab4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:36.524009 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-2d5a51be-6e6d-4b71-82c1-bef860062d34 tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bcc31b0-9d8e-48d8-8703-0e7dd0ed06de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:36.526293 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-2d5a51be-6e6d-4b71-82c1-bef860062d34 tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bcc31b0-9d8e-48d8-8703-0e7dd0ed06de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca20cf63-7388-425a-8647-0fab862b20fb', 'volume_name': 'volume-ca20cf63-7388-425a-8647-0fab862b20fb', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:36.528629 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-2d5a51be-6e6d-4b71-82c1-bef860062d34 tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7a44121-8970-4d7a-9d50-ee6324d0558e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:36.530976 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-2d5a51be-6e6d-4b71-82c1-bef860062d34 tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7a44121-8970-4d7a-9d50-ee6324d0558e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:36.533284 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-2d5a51be-6e6d-4b71-82c1-bef860062d34 tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea628273-833a-4370-b90e-8b0cf64eebec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:36.534419 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-2d5a51be-6e6d-4b71-82c1-bef860062d34 tempest-GroupSnapshotsTest-1402242931 None] Volume ca20cf63-7388-425a-8647-0fab862b20fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca20cf63-7388-425a-8647-0fab862b20fb', 'volume_size': 1} Dec 25 21:33:36.535137 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-2d5a51be-6e6d-4b71-82c1-bef860062d34 tempest-GroupSnapshotsTest-1402242931 None] creating volume 'volume-ca20cf63-7388-425a-8647-0fab862b20fb' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:33:36.537985 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-2d5a51be-6e6d-4b71-82c1-bef860062d34 tempest-GroupSnapshotsTest-1402242931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:33:36.658822 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-82931d7c-ef42-453e-8fe5-04a9e43f36bc req-09699f74-2ca3-4a1b-9edc-5579452c466c tempest-TestVolumeBootPattern-1499667379 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:33:37.345085 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-82931d7c-ef42-453e-8fe5-04a9e43f36bc req-09699f74-2ca3-4a1b-9edc-5579452c466c tempest-TestVolumeBootPattern-1499667379 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.686s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:33:37.346594 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-82931d7c-ef42-453e-8fe5-04a9e43f36bc req-09699f74-2ca3-4a1b-9edc-5579452c466c tempest-TestVolumeBootPattern-1499667379 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-44f518a8-0417-4cf7-ab00-ecd532f8439e', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': '44f518a8-0417-4cf7-ab00-ecd532f8439e', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 21:33:37.452217 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-82931d7c-ef42-453e-8fe5-04a9e43f36bc req-09699f74-2ca3-4a1b-9edc-5579452c466c tempest-TestVolumeBootPattern-1499667379 None] Connection info returned from driver {'name': 'volumes/volume-44f518a8-0417-4cf7-ab00-ecd532f8439e', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '44f518a8-0417-4cf7-ab00-ecd532f8439e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '13692b80-7ff2-4a48-a6f8-fe03096d17b9'} {{(pid=129926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 25 21:33:37.483486 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-8f10ca44-0ed5-4ec7-8122-fb052e97eac5 tempest-VolumesActionsTest-2089127211 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:33:37.483788 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-8f10ca44-0ed5-4ec7-8122-fb052e97eac5 tempest-VolumesActionsTest-2089127211 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:33:37.488073 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8f10ca44-0ed5-4ec7-8122-fb052e97eac5 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad997bb0-cdcf-4e40-bdc3-b2fcdf66eeb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abecbbce-2ad9-4268-addf-6c52b15c3da2', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:37.489926 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8f10ca44-0ed5-4ec7-8122-fb052e97eac5 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fd92f8b-e950-4f74-8d00-ed8e1ec12011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:37.586816 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-8f10ca44-0ed5-4ec7-8122-fb052e97eac5 tempest-VolumesActionsTest-2089127211 None] Volume volume-abecbbce-2ad9-4268-addf-6c52b15c3da2 (abecbbce-2ad9-4268-addf-6c52b15c3da2): created successfully Dec 25 21:33:37.588831 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8f10ca44-0ed5-4ec7-8122-fb052e97eac5 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fd92f8b-e950-4f74-8d00-ed8e1ec12011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:37.598118 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8f10ca44-0ed5-4ec7-8122-fb052e97eac5 tempest-VolumesActionsTest-2089127211 None] Flow 'volume_create_manager' (96c5e297-7e4d-44c5-a9db-08ce702f0d01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:33:37.629604 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-82931d7c-ef42-453e-8fe5-04a9e43f36bc req-09699f74-2ca3-4a1b-9edc-5579452c466c tempest-TestVolumeBootPattern-1499667379 None] attachment_update completed successfully. Dec 25 21:33:37.713136 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-8f10ca44-0ed5-4ec7-8122-fb052e97eac5 tempest-VolumesActionsTest-2089127211 None] Created volume successfully. Dec 25 21:33:37.751407 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-2d5a51be-6e6d-4b71-82c1-bef860062d34 tempest-GroupSnapshotsTest-1402242931 None] extra_specs: {} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:33:37.752764 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-2d5a51be-6e6d-4b71-82c1-bef860062d34 tempest-GroupSnapshotsTest-1402242931 None] extra_specs: {} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:33:37.754074 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-2d5a51be-6e6d-4b71-82c1-bef860062d34 tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea628273-833a-4370-b90e-8b0cf64eebec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca20cf63-7388-425a-8647-0fab862b20fb', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:37.756522 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-2d5a51be-6e6d-4b71-82c1-bef860062d34 tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8949e27a-726d-4014-8bca-2525c157ae0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:37.834959 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-2d5a51be-6e6d-4b71-82c1-bef860062d34 tempest-GroupSnapshotsTest-1402242931 None] Volume volume-ca20cf63-7388-425a-8647-0fab862b20fb (ca20cf63-7388-425a-8647-0fab862b20fb): created successfully Dec 25 21:33:37.839194 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-2d5a51be-6e6d-4b71-82c1-bef860062d34 tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8949e27a-726d-4014-8bca-2525c157ae0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:37.840337 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-2d5a51be-6e6d-4b71-82c1-bef860062d34 tempest-GroupSnapshotsTest-1402242931 None] Flow 'volume_create_manager' (5f4308ba-9a74-4d6b-a856-9cfdb3ebd84a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:33:37.943558 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-2d5a51be-6e6d-4b71-82c1-bef860062d34 tempest-GroupSnapshotsTest-1402242931 None] Created volume successfully. Dec 25 21:33:38.678633 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-bab7f849-101f-481b-ba81-8cff69bbf25c tempest-VolumesActionsTest-1050374675 None] Lock "b'cinder-abecbbce-2ad9-4268-addf-6c52b15c3da2-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:33:38.820601 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-bab7f849-101f-481b-ba81-8cff69bbf25c tempest-VolumesActionsTest-1050374675 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:33:39.087055 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-bab7f849-101f-481b-ba81-8cff69bbf25c tempest-VolumesActionsTest-1050374675 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:33:39.087055 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-bab7f849-101f-481b-ba81-8cff69bbf25c tempest-VolumesActionsTest-1050374675 None] Volume volume-abecbbce-2ad9-4268-addf-6c52b15c3da2 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:33:39.393079 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-bab7f849-101f-481b-ba81-8cff69bbf25c tempest-VolumesActionsTest-1050374675 None] deleting rbd volume volume-abecbbce-2ad9-4268-addf-6c52b15c3da2 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:33:39.499331 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec1e9b2e-a401-45fb-aabe-a15bef8267ba tempest-GroupSnapshotsTest-1402242931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:33:39.503758 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-ec1e9b2e-a401-45fb-aabe-a15bef8267ba tempest-GroupSnapshotsTest-1402242931 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:33:39.504246 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-ec1e9b2e-a401-45fb-aabe-a15bef8267ba tempest-GroupSnapshotsTest-1402242931 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:33:39.517794 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ec1e9b2e-a401-45fb-aabe-a15bef8267ba tempest-GroupSnapshotsTest-1402242931 None] Flow 'volume_create_manager' (4c9f028e-fbe9-4cc4-8a19-d62822cf9107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:33:39.521183 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ec1e9b2e-a401-45fb-aabe-a15bef8267ba tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d2eda9d-71a0-4626-9df0-dc25067d7ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:39.527101 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-ec1e9b2e-a401-45fb-aabe-a15bef8267ba tempest-GroupSnapshotsTest-1402242931 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:33:39.539848 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ec1e9b2e-a401-45fb-aabe-a15bef8267ba tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d2eda9d-71a0-4626-9df0-dc25067d7ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-2073345833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=999cbbfb-1314-44c6-b632-2178de7e5be1,host='ncdv-master-1@ceph#ceph',id=438feb07-4583-4515-b9f6-61763c5cd380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='758f44503e1c41dc9aecca962e0c75f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:33:39Z,use_quota=True,user_id='3a838ec078394a5cba918617920febff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a67cc81-91aa-427a-8518-7abf3e08af64),volume_type_id=9a67cc81-91aa-427a-8518-7abf3e08af64)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:39.542529 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ec1e9b2e-a401-45fb-aabe-a15bef8267ba tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feb46378-41cf-446d-a718-e2c019d064f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:39.546549 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ec1e9b2e-a401-45fb-aabe-a15bef8267ba tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feb46378-41cf-446d-a718-e2c019d064f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:39.547208 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ec1e9b2e-a401-45fb-aabe-a15bef8267ba tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cf9adf1-a6c4-4153-8135-581e51fba754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:39.549572 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ec1e9b2e-a401-45fb-aabe-a15bef8267ba tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cf9adf1-a6c4-4153-8135-581e51fba754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '438feb07-4583-4515-b9f6-61763c5cd380', 'volume_name': 'volume-438feb07-4583-4515-b9f6-61763c5cd380', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:39.551798 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ec1e9b2e-a401-45fb-aabe-a15bef8267ba tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b98a11b3-c8bc-4f07-958a-89564722d673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:39.554017 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ec1e9b2e-a401-45fb-aabe-a15bef8267ba tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b98a11b3-c8bc-4f07-958a-89564722d673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:39.556232 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ec1e9b2e-a401-45fb-aabe-a15bef8267ba tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ae8415d-495e-4536-9730-8f3f3329e119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:39.557106 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-ec1e9b2e-a401-45fb-aabe-a15bef8267ba tempest-GroupSnapshotsTest-1402242931 None] Volume 438feb07-4583-4515-b9f6-61763c5cd380: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-438feb07-4583-4515-b9f6-61763c5cd380', 'volume_size': 1} Dec 25 21:33:39.557503 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ec1e9b2e-a401-45fb-aabe-a15bef8267ba tempest-GroupSnapshotsTest-1402242931 None] creating volume 'volume-438feb07-4583-4515-b9f6-61763c5cd380' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:33:39.558491 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ec1e9b2e-a401-45fb-aabe-a15bef8267ba tempest-GroupSnapshotsTest-1402242931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:33:40.844567 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ec1e9b2e-a401-45fb-aabe-a15bef8267ba tempest-GroupSnapshotsTest-1402242931 None] extra_specs: {} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:33:40.845186 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ec1e9b2e-a401-45fb-aabe-a15bef8267ba tempest-GroupSnapshotsTest-1402242931 None] extra_specs: {} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:33:40.847073 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ec1e9b2e-a401-45fb-aabe-a15bef8267ba tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ae8415d-495e-4536-9730-8f3f3329e119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-438feb07-4583-4515-b9f6-61763c5cd380', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:40.851640 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ec1e9b2e-a401-45fb-aabe-a15bef8267ba tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1180ccf2-2cfd-4083-b65f-13d676f7ba3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:41.015251 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-ec1e9b2e-a401-45fb-aabe-a15bef8267ba tempest-GroupSnapshotsTest-1402242931 None] Volume volume-438feb07-4583-4515-b9f6-61763c5cd380 (438feb07-4583-4515-b9f6-61763c5cd380): created successfully Dec 25 21:33:41.017965 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ec1e9b2e-a401-45fb-aabe-a15bef8267ba tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1180ccf2-2cfd-4083-b65f-13d676f7ba3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:41.021022 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ec1e9b2e-a401-45fb-aabe-a15bef8267ba tempest-GroupSnapshotsTest-1402242931 None] Flow 'volume_create_manager' (4c9f028e-fbe9-4cc4-8a19-d62822cf9107) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:33:41.106618 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-ec1e9b2e-a401-45fb-aabe-a15bef8267ba tempest-GroupSnapshotsTest-1402242931 None] Created volume successfully. Dec 25 21:33:41.684503 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-efce41b1-82c5-4458-8226-907e25085f9d tempest-GroupSnapshotsTest-1402242931 None] Update group completed successfully. Dec 25 21:33:42.988903 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-66303585-6eb4-4eba-b500-83de5d2f5565 tempest-GroupSnapshotsTest-1402242931 None] Update group completed successfully. Dec 25 21:33:44.586869 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-6bdc4da7-6e37-4b23-b290-406a7a67fd96 tempest-GroupSnapshotsTest-1402242931 None] Update group completed successfully. Dec 25 21:33:45.656595 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-bff48b26-c02c-413c-bbff-8c2c47d5295e tempest-GroupSnapshotsTest-1402242931 None] Update group completed successfully. Dec 25 21:33:47.389155 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-478b03e2-001f-460d-a109-79db9be034f0 tempest-GroupSnapshotsTest-1402242931 None] GroupSnapshot 2e92dcd9-fc82-4b0f-8b67-0092b9ff364a: creating. Dec 25 21:33:47.450012 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-478b03e2-001f-460d-a109-79db9be034f0 tempest-GroupSnapshotsTest-1402242931 None] Group snapshot 2e92dcd9-fc82-4b0f-8b67-0092b9ff364a: creating. {{(pid=129926) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4078}} Dec 25 21:33:47.487661 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-478b03e2-001f-460d-a109-79db9be034f0 tempest-GroupSnapshotsTest-1402242931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:33:50.223644 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-bab7f849-101f-481b-ba81-8cff69bbf25c tempest-VolumesActionsTest-1050374675 None] Created reservations ['9da74c8c-0ff1-4765-babb-4fca6d1e3bf5', '223cabcc-9f3e-4c3e-a013-4d2e7f54ade5', '6b4b9a5c-e024-420e-b97e-1ad99933f0ac', '3e946911-385b-406b-8d3d-16d37090c215'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:33:50.432656 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-bab7f849-101f-481b-ba81-8cff69bbf25c tempest-VolumesActionsTest-1050374675 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:33:50.504858 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-bab7f849-101f-481b-ba81-8cff69bbf25c tempest-VolumesActionsTest-1050374675 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:33:50.599023 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-bab7f849-101f-481b-ba81-8cff69bbf25c tempest-VolumesActionsTest-1050374675 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:33:50.603793 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-bab7f849-101f-481b-ba81-8cff69bbf25c tempest-VolumesActionsTest-1050374675 None] Deleted volume successfully. Dec 25 21:33:50.722393 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-bab7f849-101f-481b-ba81-8cff69bbf25c tempest-VolumesActionsTest-1050374675 None] Lock "b'cinder-abecbbce-2ad9-4268-addf-6c52b15c3da2-delete_volume'" released by "delete_volume" :: held 12.044s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:33:51.555513 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0922083-8f09-439f-bba1-478c8cf2bfa9 tempest-VolumesActionsTest-2089127211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:33:51.561850 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-e0922083-8f09-439f-bba1-478c8cf2bfa9 tempest-VolumesActionsTest-2089127211 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:33:51.562526 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-e0922083-8f09-439f-bba1-478c8cf2bfa9 tempest-VolumesActionsTest-2089127211 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:33:51.600334 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e0922083-8f09-439f-bba1-478c8cf2bfa9 tempest-VolumesActionsTest-2089127211 None] Flow 'volume_create_manager' (717bffb9-d8f7-4ae5-b0a4-401dd5f10c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:33:51.610915 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e0922083-8f09-439f-bba1-478c8cf2bfa9 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b902bf51-d140-457c-9184-be5eabc56b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:51.628756 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-478b03e2-001f-460d-a109-79db9be034f0 tempest-GroupSnapshotsTest-1402242931 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:33:51.652231 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-478b03e2-001f-460d-a109-79db9be034f0 tempest-GroupSnapshotsTest-1402242931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:33:51.935085 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e0922083-8f09-439f-bba1-478c8cf2bfa9 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b902bf51-d140-457c-9184-be5eabc56b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1204257324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=62b93d7a-1216-4669-a452-ac265d5c8b39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71418288426545dea311f347bd0cbfdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:33:51Z,use_quota=True,user_id='f2237f90a5db4203805e0a7f287f0964',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:51.939853 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e0922083-8f09-439f-bba1-478c8cf2bfa9 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (715fe46a-4b3d-460f-bed7-aa1224beb1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:51.942090 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e0922083-8f09-439f-bba1-478c8cf2bfa9 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (715fe46a-4b3d-460f-bed7-aa1224beb1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:51.949289 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e0922083-8f09-439f-bba1-478c8cf2bfa9 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca8346eb-627d-4467-8221-dce924f66b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:51.951786 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e0922083-8f09-439f-bba1-478c8cf2bfa9 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca8346eb-627d-4467-8221-dce924f66b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62b93d7a-1216-4669-a452-ac265d5c8b39', 'volume_name': 'volume-62b93d7a-1216-4669-a452-ac265d5c8b39', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:51.955007 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e0922083-8f09-439f-bba1-478c8cf2bfa9 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1b221c1-7f91-4d2c-99c9-9c6ca6990462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:51.957485 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e0922083-8f09-439f-bba1-478c8cf2bfa9 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1b221c1-7f91-4d2c-99c9-9c6ca6990462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:51.960228 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e0922083-8f09-439f-bba1-478c8cf2bfa9 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55b91316-d0af-4a42-9ddf-b498e96f4c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:51.961477 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-e0922083-8f09-439f-bba1-478c8cf2bfa9 tempest-VolumesActionsTest-2089127211 None] Volume 62b93d7a-1216-4669-a452-ac265d5c8b39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62b93d7a-1216-4669-a452-ac265d5c8b39', 'volume_size': 1} Dec 25 21:33:51.962168 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e0922083-8f09-439f-bba1-478c8cf2bfa9 tempest-VolumesActionsTest-2089127211 None] creating volume 'volume-62b93d7a-1216-4669-a452-ac265d5c8b39' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:33:51.964039 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e0922083-8f09-439f-bba1-478c8cf2bfa9 tempest-VolumesActionsTest-2089127211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:33:52.008025 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-88fb3089-579f-4fd0-b983-17108e7594ac tempest-VolumesBackupsV39Test-1766595062 None] Lock "b'cinder-418b0ee7-9825-409e-a27f-ab8034c2c05f-delete_volume'" acquired by "delete_volume" :: waited 0.085s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:33:52.199073 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-88fb3089-579f-4fd0-b983-17108e7594ac tempest-VolumesBackupsV39Test-1766595062 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:33:55.753835 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-88fb3089-579f-4fd0-b983-17108e7594ac tempest-VolumesBackupsV39Test-1766595062 None] Volume volume-418b0ee7-9825-409e-a27f-ab8034c2c05f is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:33:56.900660 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-88fb3089-579f-4fd0-b983-17108e7594ac tempest-VolumesBackupsV39Test-1766595062 None] deleting rbd volume volume-418b0ee7-9825-409e-a27f-ab8034c2c05f {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:33:56.909150 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e0922083-8f09-439f-bba1-478c8cf2bfa9 tempest-VolumesActionsTest-2089127211 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:33:56.909522 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e0922083-8f09-439f-bba1-478c8cf2bfa9 tempest-VolumesActionsTest-2089127211 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:33:56.911554 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e0922083-8f09-439f-bba1-478c8cf2bfa9 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55b91316-d0af-4a42-9ddf-b498e96f4c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62b93d7a-1216-4669-a452-ac265d5c8b39', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:56.913732 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e0922083-8f09-439f-bba1-478c8cf2bfa9 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c41c713-1118-42b4-9431-c748afd87119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:33:56.927504 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-31f64b63-61b6-484d-9aa0-869b45a4ebac req-41623407-eba0-4b74-917f-d8ef9aeabf39 tempest-TestVolumeBootPattern-1499667379 None] Terminate volume connection completed successfully. Dec 25 21:33:56.930897 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-31f64b63-61b6-484d-9aa0-869b45a4ebac req-41623407-eba0-4b74-917f-d8ef9aeabf39 tempest-TestVolumeBootPattern-1499667379 None] Deleting attachment 13692b80-7ff2-4a48-a6f8-fe03096d17b9. {{(pid=129926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 25 21:33:57.025910 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-e0922083-8f09-439f-bba1-478c8cf2bfa9 tempest-VolumesActionsTest-2089127211 None] Volume volume-62b93d7a-1216-4669-a452-ac265d5c8b39 (62b93d7a-1216-4669-a452-ac265d5c8b39): created successfully Dec 25 21:33:57.028137 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e0922083-8f09-439f-bba1-478c8cf2bfa9 tempest-VolumesActionsTest-2089127211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c41c713-1118-42b4-9431-c748afd87119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:33:57.032086 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e0922083-8f09-439f-bba1-478c8cf2bfa9 tempest-VolumesActionsTest-2089127211 None] Flow 'volume_create_manager' (717bffb9-d8f7-4ae5-b0a4-401dd5f10c06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:33:57.094972 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-e0922083-8f09-439f-bba1-478c8cf2bfa9 tempest-VolumesActionsTest-2089127211 None] Created volume successfully. Dec 25 21:33:57.267519 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [req-31f64b63-61b6-484d-9aa0-869b45a4ebac req-1258526f-6c3e-4784-8d2b-fbb214ede5ec tempest-TestVolumeBootPattern-1499667379 None] Lock "b'cinder-44f518a8-0417-4cf7-ab00-ecd532f8439e-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:33:57.384906 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-31f64b63-61b6-484d-9aa0-869b45a4ebac req-1258526f-6c3e-4784-8d2b-fbb214ede5ec tempest-TestVolumeBootPattern-1499667379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:33:58.206136 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-31f64b63-61b6-484d-9aa0-869b45a4ebac req-1258526f-6c3e-4784-8d2b-fbb214ede5ec tempest-TestVolumeBootPattern-1499667379 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:33:58.582430 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-31f64b63-61b6-484d-9aa0-869b45a4ebac req-1258526f-6c3e-4784-8d2b-fbb214ede5ec tempest-TestVolumeBootPattern-1499667379 None] deleting rbd volume volume-44f518a8-0417-4cf7-ab00-ecd532f8439e {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:33:58.713932 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-799993b9-388e-4176-8d15-d4a0479fe07c tempest-VolumesActionsTest-2089127211 None] Lock "b'cinder-62b93d7a-1216-4669-a452-ac265d5c8b39-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:33:58.825876 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-799993b9-388e-4176-8d15-d4a0479fe07c tempest-VolumesActionsTest-2089127211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:33:59.066438 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-799993b9-388e-4176-8d15-d4a0479fe07c tempest-VolumesActionsTest-2089127211 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:33:59.068100 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-799993b9-388e-4176-8d15-d4a0479fe07c tempest-VolumesActionsTest-2089127211 None] Volume volume-62b93d7a-1216-4669-a452-ac265d5c8b39 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:33:59.318861 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-799993b9-388e-4176-8d15-d4a0479fe07c tempest-VolumesActionsTest-2089127211 None] deleting rbd volume volume-62b93d7a-1216-4669-a452-ac265d5c8b39 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:33:59.572366 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-478b03e2-001f-460d-a109-79db9be034f0 tempest-GroupSnapshotsTest-1402242931 None] group_snapshot 2e92dcd9-fc82-4b0f-8b67-0092b9ff364a: created successfully Dec 25 21:34:00.325195 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-bac74ceb-d1a3-42a8-99bc-28360852c909 tempest-GroupSnapshotsTest-1402242931 None] group_snapshot 2e92dcd9-fc82-4b0f-8b67-0092b9ff364a: deleting Dec 25 21:34:00.345160 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-bac74ceb-d1a3-42a8-99bc-28360852c909 tempest-GroupSnapshotsTest-1402242931 None] group_snapshot 2e92dcd9-fc82-4b0f-8b67-0092b9ff364a: deleting {{(pid=129926) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4253}} Dec 25 21:34:00.363110 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-bac74ceb-d1a3-42a8-99bc-28360852c909 tempest-GroupSnapshotsTest-1402242931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:34:00.863146 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-d1dc7fa0-473a-44e8-a8fc-030c39d48eb6 req-3254cf2e-f58a-4851-8d4a-e0840c914e17 tempest-AttachVolumeShelveTestJSON-1279821748 None] No connector for attachment d5f068b3-985c-4170-8b49-1e254e06dca3; skipping storage backend terminate_connection call. {{(pid=129926) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4903}} Dec 25 21:34:00.863518 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-d1dc7fa0-473a-44e8-a8fc-030c39d48eb6 req-3254cf2e-f58a-4851-8d4a-e0840c914e17 tempest-AttachVolumeShelveTestJSON-1279821748 None] Deleting attachment d5f068b3-985c-4170-8b49-1e254e06dca3. {{(pid=129926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 25 21:34:05.479704 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-bac74ceb-d1a3-42a8-99bc-28360852c909 tempest-GroupSnapshotsTest-1402242931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:34:06.002828 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-88fb3089-579f-4fd0-b983-17108e7594ac tempest-VolumesBackupsV39Test-1766595062 None] Created reservations ['1207e848-f2f1-4781-947d-1e5dbfd5c892', 'cd9c3846-a1cc-4197-a65a-bb04c6261e0c', '8dab2414-8fd2-4cbe-b7ec-cf53d37490c4', '181d5529-6ad3-4c00-afd2-87101c123939'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:34:06.283333 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-88fb3089-579f-4fd0-b983-17108e7594ac tempest-VolumesBackupsV39Test-1766595062 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:34:06.422733 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-88fb3089-579f-4fd0-b983-17108e7594ac tempest-VolumesBackupsV39Test-1766595062 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:34:06.495002 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-88fb3089-579f-4fd0-b983-17108e7594ac tempest-VolumesBackupsV39Test-1766595062 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:34:06.504170 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-88fb3089-579f-4fd0-b983-17108e7594ac tempest-VolumesBackupsV39Test-1766595062 None] Deleted volume successfully. Dec 25 21:34:06.602932 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-88fb3089-579f-4fd0-b983-17108e7594ac tempest-VolumesBackupsV39Test-1766595062 None] Lock "b'cinder-418b0ee7-9825-409e-a27f-ab8034c2c05f-delete_volume'" released by "delete_volume" :: held 14.595s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:34:08.646661 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [req-31f64b63-61b6-484d-9aa0-869b45a4ebac req-1258526f-6c3e-4784-8d2b-fbb214ede5ec tempest-TestVolumeBootPattern-1499667379 None] Created reservations ['62751ca0-4d5a-4574-b7bf-3eae10a4f077', 'c4c86d3c-cd67-441d-8d1d-3998f70c60cd', '440e5c1e-f506-4078-8eb5-0b6b31fa61f2', '7c527ea2-1ada-48cd-8f8a-2de5b574e7cb'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:34:08.660368 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-799993b9-388e-4176-8d15-d4a0479fe07c tempest-VolumesActionsTest-2089127211 None] Created reservations ['98705fd7-3d20-4cc6-9bce-637916af5362', 'd8cf9663-9421-48d7-b4d5-6c36e5ac5546', 'a7520015-d9ff-4ca3-a7bc-4b288b83a118', '53d74fca-d1ef-4ca8-ac99-adcb98317bf0'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:34:08.978223 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-31f64b63-61b6-484d-9aa0-869b45a4ebac req-1258526f-6c3e-4784-8d2b-fbb214ede5ec tempest-TestVolumeBootPattern-1499667379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:34:09.058642 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-31f64b63-61b6-484d-9aa0-869b45a4ebac req-1258526f-6c3e-4784-8d2b-fbb214ede5ec tempest-TestVolumeBootPattern-1499667379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:34:09.162855 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [req-31f64b63-61b6-484d-9aa0-869b45a4ebac req-1258526f-6c3e-4784-8d2b-fbb214ede5ec tempest-TestVolumeBootPattern-1499667379 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:34:09.179388 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-31f64b63-61b6-484d-9aa0-869b45a4ebac req-1258526f-6c3e-4784-8d2b-fbb214ede5ec tempest-TestVolumeBootPattern-1499667379 None] Deleted volume successfully. Dec 25 21:34:09.184506 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-799993b9-388e-4176-8d15-d4a0479fe07c tempest-VolumesActionsTest-2089127211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:34:09.252293 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-799993b9-388e-4176-8d15-d4a0479fe07c tempest-VolumesActionsTest-2089127211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:34:09.294181 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-799993b9-388e-4176-8d15-d4a0479fe07c tempest-VolumesActionsTest-2089127211 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:34:09.306666 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-799993b9-388e-4176-8d15-d4a0479fe07c tempest-VolumesActionsTest-2089127211 None] Deleted volume successfully. Dec 25 21:34:09.316936 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-0325c61a-de6d-4784-b983-77cd7d7223c0 tempest-TestVolumeBootPattern-1499667379 None] Lock "b'cinder-408acdab-9a9e-4132-bb02-430bae4d8a1d-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.145s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:34:09.317404 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0325c61a-de6d-4784-b983-77cd7d7223c0 tempest-TestVolumeBootPattern-1499667379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:34:09.685480 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [req-31f64b63-61b6-484d-9aa0-869b45a4ebac req-1258526f-6c3e-4784-8d2b-fbb214ede5ec tempest-TestVolumeBootPattern-1499667379 None] Lock "b'cinder-44f518a8-0417-4cf7-ab00-ecd532f8439e-delete_volume'" released by "delete_volume" :: held 12.418s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:34:09.687310 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-799993b9-388e-4176-8d15-d4a0479fe07c tempest-VolumesActionsTest-2089127211 None] Lock "b'cinder-62b93d7a-1216-4669-a452-ac265d5c8b39-delete_volume'" released by "delete_volume" :: held 10.974s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:34:09.856521 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-9d9e25cc-011a-43b4-ac32-f2bb867aee23 tempest-VolumesActionsTest-2089127211 None] Lock "b'cinder-ce10a0b6-7e66-422d-8632-6cdb68412794-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:34:10.303934 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-9d9e25cc-011a-43b4-ac32-f2bb867aee23 tempest-VolumesActionsTest-2089127211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:34:10.689454 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-9d9e25cc-011a-43b4-ac32-f2bb867aee23 tempest-VolumesActionsTest-2089127211 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:34:10.690072 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-9d9e25cc-011a-43b4-ac32-f2bb867aee23 tempest-VolumesActionsTest-2089127211 None] Volume volume-ce10a0b6-7e66-422d-8632-6cdb68412794 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:34:11.102625 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-9d9e25cc-011a-43b4-ac32-f2bb867aee23 tempest-VolumesActionsTest-2089127211 None] deleting rbd volume volume-ce10a0b6-7e66-422d-8632-6cdb68412794 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:34:11.313152 ncdv-master-1 cinder-volume[129926]: WARNING cinder.quota [None req-bac74ceb-d1a3-42a8-99bc-28360852c909 tempest-GroupSnapshotsTest-1402242931 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1945979702 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1945979702, it is now deprecated. Please use the default quota class for default quota. Dec 25 21:34:11.314133 ncdv-master-1 cinder-volume[129926]: WARNING cinder.quota [None req-bac74ceb-d1a3-42a8-99bc-28360852c909 tempest-GroupSnapshotsTest-1402242931 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1945979702 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1945979702, it is now deprecated. Please use the default quota class for default quota. Dec 25 21:34:11.404998 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-bac74ceb-d1a3-42a8-99bc-28360852c909 tempest-GroupSnapshotsTest-1402242931 None] Created reservations ['328c665a-e693-49ef-a552-2700e5d5c54e', '311b0cdc-ae5f-4276-b9df-7ad5651c7ead', 'a3c80bbe-4613-424b-a63f-1a9a5592df59', 'e0aa6b3d-d3bf-4eac-a411-6c66b2ba5ba3'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:34:11.424217 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-702f5e69-7663-4456-810f-7cc2eea4b899 tempest-VolumesExtendTest-789413853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:34:11.427806 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-702f5e69-7663-4456-810f-7cc2eea4b899 tempest-VolumesExtendTest-789413853 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:34:11.428778 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-702f5e69-7663-4456-810f-7cc2eea4b899 tempest-VolumesExtendTest-789413853 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:34:11.442468 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-702f5e69-7663-4456-810f-7cc2eea4b899 tempest-VolumesExtendTest-789413853 None] Flow 'volume_create_manager' (60606ff1-45e8-4ab1-ae51-acda5619754f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:34:11.445720 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-702f5e69-7663-4456-810f-7cc2eea4b899 tempest-VolumesExtendTest-789413853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bedb736d-0c3f-476c-80ad-d4b813ecdc4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:34:11.452761 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-702f5e69-7663-4456-810f-7cc2eea4b899 tempest-VolumesExtendTest-789413853 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:34:11.465988 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-702f5e69-7663-4456-810f-7cc2eea4b899 tempest-VolumesExtendTest-789413853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bedb736d-0c3f-476c-80ad-d4b813ecdc4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1420244477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=23c339db-ad89-43c8-81a1-e84ef68c6ced,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14f47a8e0d5f4e858f4f0ddf0fb5f347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:34:11Z,use_quota=True,user_id='3707d8197a4a43e1be6a10b4b3c58004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:34:11.468745 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-702f5e69-7663-4456-810f-7cc2eea4b899 tempest-VolumesExtendTest-789413853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec17af89-7edd-4b72-a8d6-b1c9c7859983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:34:11.470997 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-702f5e69-7663-4456-810f-7cc2eea4b899 tempest-VolumesExtendTest-789413853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec17af89-7edd-4b72-a8d6-b1c9c7859983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:34:11.473491 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-702f5e69-7663-4456-810f-7cc2eea4b899 tempest-VolumesExtendTest-789413853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f177eb-bf19-4e61-8ab6-a01596993d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:34:11.585047 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-702f5e69-7663-4456-810f-7cc2eea4b899 tempest-VolumesExtendTest-789413853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f177eb-bf19-4e61-8ab6-a01596993d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '23c339db-ad89-43c8-81a1-e84ef68c6ced', 'volume_name': 'volume-23c339db-ad89-43c8-81a1-e84ef68c6ced', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:34:11.587434 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-702f5e69-7663-4456-810f-7cc2eea4b899 tempest-VolumesExtendTest-789413853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d44f276d-dd54-484b-ae84-80cb6dfd8dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:34:11.590237 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-702f5e69-7663-4456-810f-7cc2eea4b899 tempest-VolumesExtendTest-789413853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d44f276d-dd54-484b-ae84-80cb6dfd8dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:34:11.592438 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-702f5e69-7663-4456-810f-7cc2eea4b899 tempest-VolumesExtendTest-789413853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc80d69a-98f5-43ea-8622-2012372387d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:34:11.593875 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-702f5e69-7663-4456-810f-7cc2eea4b899 tempest-VolumesExtendTest-789413853 None] Volume 23c339db-ad89-43c8-81a1-e84ef68c6ced: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-23c339db-ad89-43c8-81a1-e84ef68c6ced', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 25 21:34:11.594474 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-702f5e69-7663-4456-810f-7cc2eea4b899 tempest-VolumesExtendTest-789413853 None] Cloning 23c339db-ad89-43c8-81a1-e84ef68c6ced from image aca914d0-5f7b-465f-a024-75efa27d7291 at location (None, None). {{(pid=129926) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Dec 25 21:34:11.614520 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-702f5e69-7663-4456-810f-7cc2eea4b899 tempest-VolumesExtendTest-789413853 None] Lock "b'cinder-aca914d0-5f7b-465f-a024-75efa27d7291'" acquired by "_prepare_image_cache_entry" :: waited 0.019s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:34:11.723699 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-702f5e69-7663-4456-810f-7cc2eea4b899 tempest-VolumesExtendTest-789413853 None] Found image-volume cache entry: {'id': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'volume_id': '058f5fb3-51e4-40e3-9c98-542207f1fc1f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31), 'last_used': datetime.datetime(2021, 12, 25, 21, 34, 11, 626204)}. {{(pid=129926) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 25 21:34:11.724308 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-702f5e69-7663-4456-810f-7cc2eea4b899 tempest-VolumesExtendTest-789413853 None] Image-volume cache entry image_update_at = 2021-12-25 20:58:31+00:00, requested image updated_at = 2021-12-25 20:58:31+00:00. {{(pid=129926) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 25 21:34:11.725118 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-702f5e69-7663-4456-810f-7cc2eea4b899 tempest-VolumesExtendTest-789413853 None] Found cache entry for image = aca914d0-5f7b-465f-a024-75efa27d7291 on host ncdv-master-1@ceph#ceph. {{(pid=129926) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Dec 25 21:34:11.732995 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-702f5e69-7663-4456-810f-7cc2eea4b899 tempest-VolumesExtendTest-789413853 None] Lock "b'cinder-aca914d0-5f7b-465f-a024-75efa27d7291'" released by "_prepare_image_cache_entry" :: held 0.116s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:34:11.732995 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-702f5e69-7663-4456-810f-7cc2eea4b899 tempest-VolumesExtendTest-789413853 None] Attempting to retrieve cache entry for image = aca914d0-5f7b-465f-a024-75efa27d7291 on host ncdv-master-1@ceph#ceph. {{(pid=129926) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Dec 25 21:34:11.739362 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-702f5e69-7663-4456-810f-7cc2eea4b899 tempest-VolumesExtendTest-789413853 None] Found image-volume cache entry: {'id': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'volume_id': '058f5fb3-51e4-40e3-9c98-542207f1fc1f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31), 'last_used': datetime.datetime(2021, 12, 25, 21, 34, 11, 736849)}. {{(pid=129926) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 25 21:34:11.739882 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-702f5e69-7663-4456-810f-7cc2eea4b899 tempest-VolumesExtendTest-789413853 None] Image-volume cache entry image_update_at = 2021-12-25 20:58:31+00:00, requested image updated_at = 2021-12-25 20:58:31+00:00. {{(pid=129926) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 25 21:34:11.740348 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-702f5e69-7663-4456-810f-7cc2eea4b899 tempest-VolumesExtendTest-789413853 None] Creating from source image-volume 058f5fb3-51e4-40e3-9c98-542207f1fc1f {{(pid=129926) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Dec 25 21:34:11.753941 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-702f5e69-7663-4456-810f-7cc2eea4b899 tempest-VolumesExtendTest-789413853 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:34:12.242630 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-702f5e69-7663-4456-810f-7cc2eea4b899 tempest-VolumesExtendTest-789413853 None] creating snapshot='volume-23c339db-ad89-43c8-81a1-e84ef68c6ced.clone_snap' {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 25 21:34:16.928797 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-702f5e69-7663-4456-810f-7cc2eea4b899 tempest-VolumesExtendTest-789413853 None] cloning 'volume-058f5fb3-51e4-40e3-9c98-542207f1fc1f@volume-23c339db-ad89-43c8-81a1-e84ef68c6ced.clone_snap' to 'volume-23c339db-ad89-43c8-81a1-e84ef68c6ced' {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 25 21:34:16.932929 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-bac74ceb-d1a3-42a8-99bc-28360852c909 tempest-GroupSnapshotsTest-1402242931 None] Created reservations ['94a31cac-8fb8-44c1-a729-b49040c2e090', '57603d11-1e14-4f28-87eb-9860b49de740', 'ac3f5802-6778-40dc-980f-9a11ce4cbab3', '590425dc-c91c-465e-a2a2-78e9f4e0de31'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:34:17.236833 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-bac74ceb-d1a3-42a8-99bc-28360852c909 tempest-GroupSnapshotsTest-1402242931 None] group_snapshot 2e92dcd9-fc82-4b0f-8b67-0092b9ff364a: deleted successfully Dec 25 21:34:18.598748 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f6ac8570-80e9-4f48-b30c-221a4e9ed13c tempest-GroupSnapshotsTest-1402242931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:34:18.933725 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f6ac8570-80e9-4f48-b30c-221a4e9ed13c tempest-GroupSnapshotsTest-1402242931 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:34:18.934350 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f6ac8570-80e9-4f48-b30c-221a4e9ed13c tempest-GroupSnapshotsTest-1402242931 None] Volume volume-438feb07-4583-4515-b9f6-61763c5cd380 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:34:19.163699 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f6ac8570-80e9-4f48-b30c-221a4e9ed13c tempest-GroupSnapshotsTest-1402242931 None] deleting rbd volume volume-438feb07-4583-4515-b9f6-61763c5cd380 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:34:19.209329 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-702f5e69-7663-4456-810f-7cc2eea4b899 tempest-VolumesExtendTest-789413853 None] Volume volume-98b6d31e-e760-499e-8962-7b22479c1e9a.deleted is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:34:19.210400 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-702f5e69-7663-4456-810f-7cc2eea4b899 tempest-VolumesExtendTest-789413853 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:34:19.210855 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-702f5e69-7663-4456-810f-7cc2eea4b899 tempest-VolumesExtendTest-789413853 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:34:19.972349 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-702f5e69-7663-4456-810f-7cc2eea4b899 tempest-VolumesExtendTest-789413853 None] clone created successfully {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 25 21:34:19.973323 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.volume_utils [None req-702f5e69-7663-4456-810f-7cc2eea4b899 tempest-VolumesExtendTest-789413853 None] Marking volume 23c339db-ad89-43c8-81a1-e84ef68c6ced as bootable. {{(pid=129926) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 25 21:34:20.049954 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-702f5e69-7663-4456-810f-7cc2eea4b899 tempest-VolumesExtendTest-789413853 None] Copying metadata from image aca914d0-5f7b-465f-a024-75efa27d7291 to 23c339db-ad89-43c8-81a1-e84ef68c6ced. {{(pid=129926) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Dec 25 21:34:20.055214 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-702f5e69-7663-4456-810f-7cc2eea4b899 tempest-VolumesExtendTest-789413853 None] Creating volume glance metadata for volume 23c339db-ad89-43c8-81a1-e84ef68c6ced backed by image aca914d0-5f7b-465f-a024-75efa27d7291 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129926) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Dec 25 21:34:20.210697 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-702f5e69-7663-4456-810f-7cc2eea4b899 tempest-VolumesExtendTest-789413853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc80d69a-98f5-43ea-8622-2012372387d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23c339db-ad89-43c8-81a1-e84ef68c6ced', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:34:20.214488 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-702f5e69-7663-4456-810f-7cc2eea4b899 tempest-VolumesExtendTest-789413853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (681abbc7-8aa9-4e17-8838-15af10338069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:34:20.339477 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-702f5e69-7663-4456-810f-7cc2eea4b899 tempest-VolumesExtendTest-789413853 None] Volume volume-23c339db-ad89-43c8-81a1-e84ef68c6ced (23c339db-ad89-43c8-81a1-e84ef68c6ced): created successfully Dec 25 21:34:20.343543 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-702f5e69-7663-4456-810f-7cc2eea4b899 tempest-VolumesExtendTest-789413853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (681abbc7-8aa9-4e17-8838-15af10338069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:34:20.347038 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-702f5e69-7663-4456-810f-7cc2eea4b899 tempest-VolumesExtendTest-789413853 None] Flow 'volume_create_manager' (60606ff1-45e8-4ab1-ae51-acda5619754f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:34:20.459573 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-702f5e69-7663-4456-810f-7cc2eea4b899 tempest-VolumesExtendTest-789413853 None] Created volume successfully. Dec 25 21:34:20.669077 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-9d9e25cc-011a-43b4-ac32-f2bb867aee23 tempest-VolumesActionsTest-2089127211 None] Created reservations ['6b02c16f-dff1-4a28-acac-828d0f336171', '89126314-1e2e-496e-80e7-331b4f7842c8', '6a80d696-8218-41d8-a275-39183d31a8ab', 'e9e75ddd-8054-419d-9644-b54c20d2dd34'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:34:20.851086 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-9d9e25cc-011a-43b4-ac32-f2bb867aee23 tempest-VolumesActionsTest-2089127211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:34:20.873173 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-9d9e25cc-011a-43b4-ac32-f2bb867aee23 tempest-VolumesActionsTest-2089127211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:34:20.898750 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-9d9e25cc-011a-43b4-ac32-f2bb867aee23 tempest-VolumesActionsTest-2089127211 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:34:20.902774 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-9d9e25cc-011a-43b4-ac32-f2bb867aee23 tempest-VolumesActionsTest-2089127211 None] Deleted volume successfully. Dec 25 21:34:21.071138 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-9d9e25cc-011a-43b4-ac32-f2bb867aee23 tempest-VolumesActionsTest-2089127211 None] Lock "b'cinder-ce10a0b6-7e66-422d-8632-6cdb68412794-delete_volume'" released by "delete_volume" :: held 11.215s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:34:21.144270 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e65a4a53-b4d0-463b-83bb-571a73470832 tempest-VolumesExtendTest-789413853 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:34:23.540444 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e65a4a53-b4d0-463b-83bb-571a73470832 tempest-VolumesExtendTest-789413853 None] Extend volume from 1 GB to 2 GB. {{(pid=129926) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1732}} Dec 25 21:34:23.796987 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-e65a4a53-b4d0-463b-83bb-571a73470832 tempest-VolumesExtendTest-789413853 None] Extend volume completed successfully. Dec 25 21:34:25.493478 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-9524b5a8-6e5d-4537-abec-d1c7c3873d5b tempest-VolumesExtendTest-789413853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:34:25.501551 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-9524b5a8-6e5d-4537-abec-d1c7c3873d5b tempest-VolumesExtendTest-789413853 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:34:25.501551 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-9524b5a8-6e5d-4537-abec-d1c7c3873d5b tempest-VolumesExtendTest-789413853 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:34:25.510787 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-9524b5a8-6e5d-4537-abec-d1c7c3873d5b tempest-VolumesExtendTest-789413853 None] Flow 'volume_create_manager' (d9b38cc7-5b4f-4f75-b287-20a649837966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:34:25.515088 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-9524b5a8-6e5d-4537-abec-d1c7c3873d5b tempest-VolumesExtendTest-789413853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97aff3ae-9057-4780-951f-5b3c3e73443b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:34:25.521430 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-9524b5a8-6e5d-4537-abec-d1c7c3873d5b tempest-VolumesExtendTest-789413853 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:34:25.535032 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-9524b5a8-6e5d-4537-abec-d1c7c3873d5b tempest-VolumesExtendTest-789413853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97aff3ae-9057-4780-951f-5b3c3e73443b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-302131272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c8168394-603d-4428-8e69-430dd2fb388c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14f47a8e0d5f4e858f4f0ddf0fb5f347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:34:25Z,use_quota=True,user_id='3707d8197a4a43e1be6a10b4b3c58004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:34:25.537683 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-9524b5a8-6e5d-4537-abec-d1c7c3873d5b tempest-VolumesExtendTest-789413853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f9b8fd0-9725-440d-a686-adf75831151f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:34:25.539831 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-9524b5a8-6e5d-4537-abec-d1c7c3873d5b tempest-VolumesExtendTest-789413853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f9b8fd0-9725-440d-a686-adf75831151f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:34:25.542294 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-9524b5a8-6e5d-4537-abec-d1c7c3873d5b tempest-VolumesExtendTest-789413853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c99d598-8e13-4e40-9763-bc8d182691fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:34:25.545838 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-9524b5a8-6e5d-4537-abec-d1c7c3873d5b tempest-VolumesExtendTest-789413853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c99d598-8e13-4e40-9763-bc8d182691fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8168394-603d-4428-8e69-430dd2fb388c', 'volume_name': 'volume-c8168394-603d-4428-8e69-430dd2fb388c', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:34:25.547151 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-9524b5a8-6e5d-4537-abec-d1c7c3873d5b tempest-VolumesExtendTest-789413853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90efb6a8-1ac2-4786-b715-a7dc6e15b6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:34:25.549282 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-9524b5a8-6e5d-4537-abec-d1c7c3873d5b tempest-VolumesExtendTest-789413853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90efb6a8-1ac2-4786-b715-a7dc6e15b6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:34:25.551496 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-9524b5a8-6e5d-4537-abec-d1c7c3873d5b tempest-VolumesExtendTest-789413853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba06e06b-42d5-4176-848c-ca7dae39e4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:34:25.552299 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-9524b5a8-6e5d-4537-abec-d1c7c3873d5b tempest-VolumesExtendTest-789413853 None] Volume c8168394-603d-4428-8e69-430dd2fb388c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8168394-603d-4428-8e69-430dd2fb388c', 'volume_size': 1} Dec 25 21:34:25.552689 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-9524b5a8-6e5d-4537-abec-d1c7c3873d5b tempest-VolumesExtendTest-789413853 None] creating volume 'volume-c8168394-603d-4428-8e69-430dd2fb388c' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:34:25.553687 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-9524b5a8-6e5d-4537-abec-d1c7c3873d5b tempest-VolumesExtendTest-789413853 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:34:27.017399 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-9524b5a8-6e5d-4537-abec-d1c7c3873d5b tempest-VolumesExtendTest-789413853 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:34:27.018046 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-9524b5a8-6e5d-4537-abec-d1c7c3873d5b tempest-VolumesExtendTest-789413853 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:34:27.019813 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-9524b5a8-6e5d-4537-abec-d1c7c3873d5b tempest-VolumesExtendTest-789413853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba06e06b-42d5-4176-848c-ca7dae39e4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8168394-603d-4428-8e69-430dd2fb388c', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:34:27.022009 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-9524b5a8-6e5d-4537-abec-d1c7c3873d5b tempest-VolumesExtendTest-789413853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebb95426-2351-4517-9866-b970e0f88d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:34:27.184750 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-9524b5a8-6e5d-4537-abec-d1c7c3873d5b tempest-VolumesExtendTest-789413853 None] Volume volume-c8168394-603d-4428-8e69-430dd2fb388c (c8168394-603d-4428-8e69-430dd2fb388c): created successfully Dec 25 21:34:27.187159 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-9524b5a8-6e5d-4537-abec-d1c7c3873d5b tempest-VolumesExtendTest-789413853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebb95426-2351-4517-9866-b970e0f88d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:34:27.190358 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-9524b5a8-6e5d-4537-abec-d1c7c3873d5b tempest-VolumesExtendTest-789413853 None] Flow 'volume_create_manager' (d9b38cc7-5b4f-4f75-b287-20a649837966) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:34:27.262543 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-9524b5a8-6e5d-4537-abec-d1c7c3873d5b tempest-VolumesExtendTest-789413853 None] Created volume successfully. Dec 25 21:34:28.075405 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-d655d71a-b109-45b9-9eb4-1ef1e4968edf tempest-VolumesExtendTest-789413853 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:34:28.385121 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f6ac8570-80e9-4f48-b30c-221a4e9ed13c tempest-GroupSnapshotsTest-1402242931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:34:28.655386 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f6ac8570-80e9-4f48-b30c-221a4e9ed13c tempest-GroupSnapshotsTest-1402242931 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:34:28.655816 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f6ac8570-80e9-4f48-b30c-221a4e9ed13c tempest-GroupSnapshotsTest-1402242931 None] Volume volume-ca20cf63-7388-425a-8647-0fab862b20fb is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:34:28.953866 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f6ac8570-80e9-4f48-b30c-221a4e9ed13c tempest-GroupSnapshotsTest-1402242931 None] deleting rbd volume volume-ca20cf63-7388-425a-8647-0fab862b20fb {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:34:29.037710 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c6d1797-3d12-433a-a2a3-1cc422e9c05a tempest-VolumesSnapshotTestJSON-639273304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:34:29.041283 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-6c6d1797-3d12-433a-a2a3-1cc422e9c05a tempest-VolumesSnapshotTestJSON-639273304 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:34:29.042010 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-6c6d1797-3d12-433a-a2a3-1cc422e9c05a tempest-VolumesSnapshotTestJSON-639273304 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:34:29.057520 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6c6d1797-3d12-433a-a2a3-1cc422e9c05a tempest-VolumesSnapshotTestJSON-639273304 None] Flow 'volume_create_manager' (feb27451-ec00-4cd3-8861-06869e66a9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:34:29.060655 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6c6d1797-3d12-433a-a2a3-1cc422e9c05a tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b751cf1d-7ec7-4f63-a672-2ff27e5aec22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:34:29.067484 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-6c6d1797-3d12-433a-a2a3-1cc422e9c05a tempest-VolumesSnapshotTestJSON-639273304 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:34:29.080400 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6c6d1797-3d12-433a-a2a3-1cc422e9c05a tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b751cf1d-7ec7-4f63-a672-2ff27e5aec22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-386242661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f03e9745-84e8-42ce-aae1-83a861dbd629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a416565d81324f55b88111b36c4a777c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:34:29Z,use_quota=True,user_id='c3a55c151bef4387a4fef00ab6687a20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:34:29.082999 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6c6d1797-3d12-433a-a2a3-1cc422e9c05a tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8314b15f-bf79-446a-9758-47c8b3c1baab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:34:29.085157 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6c6d1797-3d12-433a-a2a3-1cc422e9c05a tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8314b15f-bf79-446a-9758-47c8b3c1baab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:34:29.087623 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6c6d1797-3d12-433a-a2a3-1cc422e9c05a tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a00d98e-c171-424a-bd18-ce357850c769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:34:29.089967 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6c6d1797-3d12-433a-a2a3-1cc422e9c05a tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a00d98e-c171-424a-bd18-ce357850c769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f03e9745-84e8-42ce-aae1-83a861dbd629', 'volume_name': 'volume-f03e9745-84e8-42ce-aae1-83a861dbd629', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:34:29.092294 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6c6d1797-3d12-433a-a2a3-1cc422e9c05a tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ed8fad9-05ea-4646-a273-a157d42679e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:34:29.094432 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6c6d1797-3d12-433a-a2a3-1cc422e9c05a tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ed8fad9-05ea-4646-a273-a157d42679e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:34:29.098962 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6c6d1797-3d12-433a-a2a3-1cc422e9c05a tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b42012f0-e60a-4550-9930-ef6c27851a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:34:29.098962 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-6c6d1797-3d12-433a-a2a3-1cc422e9c05a tempest-VolumesSnapshotTestJSON-639273304 None] Volume f03e9745-84e8-42ce-aae1-83a861dbd629: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f03e9745-84e8-42ce-aae1-83a861dbd629', 'volume_size': 1} Dec 25 21:34:29.098962 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-6c6d1797-3d12-433a-a2a3-1cc422e9c05a tempest-VolumesSnapshotTestJSON-639273304 None] creating volume 'volume-f03e9745-84e8-42ce-aae1-83a861dbd629' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:34:29.099234 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-6c6d1797-3d12-433a-a2a3-1cc422e9c05a tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:34:30.159828 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-6c6d1797-3d12-433a-a2a3-1cc422e9c05a tempest-VolumesSnapshotTestJSON-639273304 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:34:30.160591 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-6c6d1797-3d12-433a-a2a3-1cc422e9c05a tempest-VolumesSnapshotTestJSON-639273304 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:34:30.162295 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6c6d1797-3d12-433a-a2a3-1cc422e9c05a tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b42012f0-e60a-4550-9930-ef6c27851a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f03e9745-84e8-42ce-aae1-83a861dbd629', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:34:30.164458 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6c6d1797-3d12-433a-a2a3-1cc422e9c05a tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17f73f9d-a030-4991-8d4e-b66824f16c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:34:30.236117 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-6c6d1797-3d12-433a-a2a3-1cc422e9c05a tempest-VolumesSnapshotTestJSON-639273304 None] Volume volume-f03e9745-84e8-42ce-aae1-83a861dbd629 (f03e9745-84e8-42ce-aae1-83a861dbd629): created successfully Dec 25 21:34:30.238260 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6c6d1797-3d12-433a-a2a3-1cc422e9c05a tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17f73f9d-a030-4991-8d4e-b66824f16c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:34:30.241237 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6c6d1797-3d12-433a-a2a3-1cc422e9c05a tempest-VolumesSnapshotTestJSON-639273304 None] Flow 'volume_create_manager' (feb27451-ec00-4cd3-8861-06869e66a9ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:34:30.310730 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-6c6d1797-3d12-433a-a2a3-1cc422e9c05a tempest-VolumesSnapshotTestJSON-639273304 None] Created volume successfully. Dec 25 21:34:31.547530 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-83a4b7c1-dd84-414e-975a-5bb0997a6d86 tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:34:32.055228 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:34:32.055991 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:34:32.081011 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:34:32.103028 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:34:32.340946 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-d655d71a-b109-45b9-9eb4-1ef1e4968edf tempest-VolumesExtendTest-789413853 None] Create snapshot completed successfully Dec 25 21:34:33.263704 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-d974267c-eacb-4edb-bc2c-99403420e955 tempest-VolumesExtendTest-789413853 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:34:35.618601 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-83a4b7c1-dd84-414e-975a-5bb0997a6d86 tempest-VolumesSnapshotTestJSON-639273304 None] Create snapshot completed successfully Dec 25 21:34:35.730821 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-d974267c-eacb-4edb-bc2c-99403420e955 tempest-VolumesExtendTest-789413853 None] Extend volume from 1 GB to 2 GB. {{(pid=129926) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1732}} Dec 25 21:34:35.957769 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-d974267c-eacb-4edb-bc2c-99403420e955 tempest-VolumesExtendTest-789413853 None] Extend volume completed successfully. Dec 25 21:34:36.613605 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-4fe6e2c9-19ec-40ce-8d63-0dd734096a51 tempest-VolumesExtendTest-789413853 None] Lock "b'cinder-b9e3d6a9-9496-48d7-8e90-6b75a50ab7c4-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:34:36.615055 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-4fe6e2c9-19ec-40ce-8d63-0dd734096a51 tempest-VolumesExtendTest-789413853 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:34:37.306227 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-f6ac8570-80e9-4f48-b30c-221a4e9ed13c tempest-GroupSnapshotsTest-1402242931 None] Created reservations ['a77a3194-57f5-4d0e-b1ec-cb50e09031e1'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:34:37.322551 ncdv-master-1 cinder-volume[129926]: WARNING cinder.quota [None req-f6ac8570-80e9-4f48-b30c-221a4e9ed13c tempest-GroupSnapshotsTest-1402242931 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1945979702 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1945979702, it is now deprecated. Please use the default quota class for default quota. Dec 25 21:34:37.518370 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-f6ac8570-80e9-4f48-b30c-221a4e9ed13c tempest-GroupSnapshotsTest-1402242931 None] Created reservations ['5b4c8468-747d-4551-b7d1-8aa6519d657c', '924c2928-963e-4448-b4a2-d2c97fe9da9d', 'f4cac0aa-a1de-436b-8908-dc28453586b9', 'c1ae2053-c69f-4537-9235-1ac79953fbb2'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:34:37.590477 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.driver [None req-1125206f-c370-4113-9b5e-cc680b2bd33a tempest-VolumesSnapshotTestJSON-639273304 None] Creating a new backup for volume volume-f03e9745-84e8-42ce-aae1-83a861dbd629. {{(pid=129926) _get_backup_volume_temp_volume /opt/stack/cinder/cinder/volume/driver.py:1226}} Dec 25 21:34:37.795524 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-1125206f-c370-4113-9b5e-cc680b2bd33a tempest-VolumesSnapshotTestJSON-639273304 None] cloning volumes/volume-f03e9745-84e8-42ce-aae1-83a861dbd629@snapshot-fa65ec2d-542f-4a76-8b2c-0f05d2f40f68 to volume-69fd46b7-dacb-409d-88c5-27d9657b39f5 {{(pid=129926) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Dec 25 21:34:37.797068 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-1125206f-c370-4113-9b5e-cc680b2bd33a tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:34:37.872171 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-1125206f-c370-4113-9b5e-cc680b2bd33a tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:34:38.043814 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-f6ac8570-80e9-4f48-b30c-221a4e9ed13c tempest-GroupSnapshotsTest-1402242931 None] Created reservations ['12cfd4bd-0bf6-46a0-ab01-bd88b27b31be', 'a933aa1e-62ce-47de-aaf8-968a030377ad', '8efc87f4-b6c0-4ac1-b1cf-62ef14505d1f', '302921c9-297d-4c47-93c9-7b4bd9de1b95'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:34:38.447882 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f6ac8570-80e9-4f48-b30c-221a4e9ed13c tempest-GroupSnapshotsTest-1402242931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:34:38.473724 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f6ac8570-80e9-4f48-b30c-221a4e9ed13c tempest-GroupSnapshotsTest-1402242931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:34:38.499143 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-f6ac8570-80e9-4f48-b30c-221a4e9ed13c tempest-GroupSnapshotsTest-1402242931 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:34:38.503968 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-f6ac8570-80e9-4f48-b30c-221a4e9ed13c tempest-GroupSnapshotsTest-1402242931 None] Delete group completed successfully. Dec 25 21:34:39.875266 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-b8162307-fe6b-4f09-a177-a0336a3828a6 tempest-GroupSnapshotsTest-1402242931 None] Group tempest-GroupSnapshotsTest-Group-1723443788: creating Dec 25 21:34:39.973496 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-b8162307-fe6b-4f09-a177-a0336a3828a6 tempest-GroupSnapshotsTest-1402242931 None] Group tempest-GroupSnapshotsTest-Group-1723443788: created successfully Dec 25 21:34:39.982231 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-b8162307-fe6b-4f09-a177-a0336a3828a6 tempest-GroupSnapshotsTest-1402242931 None] Create group completed successfully. Dec 25 21:34:40.725858 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-1125206f-c370-4113-9b5e-cc680b2bd33a tempest-VolumesSnapshotTestJSON-639273304 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:34:40.726593 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-1125206f-c370-4113-9b5e-cc680b2bd33a tempest-VolumesSnapshotTestJSON-639273304 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:34:40.980014 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [None req-1125206f-c370-4113-9b5e-cc680b2bd33a tempest-VolumesSnapshotTestJSON-639273304 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:34:41.637493 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [None req-1125206f-c370-4113-9b5e-cc680b2bd33a tempest-VolumesSnapshotTestJSON-639273304 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.657s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:34:41.638391 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-1125206f-c370-4113-9b5e-cc680b2bd33a tempest-VolumesSnapshotTestJSON-639273304 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-69fd46b7-dacb-409d-88c5-27d9657b39f5', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': '69fd46b7-dacb-409d-88c5-27d9657b39f5', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 21:34:41.653386 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-1125206f-c370-4113-9b5e-cc680b2bd33a tempest-VolumesSnapshotTestJSON-639273304 None] Initialize volume connection completed successfully. Dec 25 21:34:41.861833 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb64b724-f7ee-44dd-bbfe-9a060159f9fb tempest-GroupSnapshotsTest-1402242931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:34:41.866038 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-eb64b724-f7ee-44dd-bbfe-9a060159f9fb tempest-GroupSnapshotsTest-1402242931 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:34:41.866536 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-eb64b724-f7ee-44dd-bbfe-9a060159f9fb tempest-GroupSnapshotsTest-1402242931 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:34:41.883534 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-eb64b724-f7ee-44dd-bbfe-9a060159f9fb tempest-GroupSnapshotsTest-1402242931 None] Flow 'volume_create_manager' (2f01b9eb-cc33-4254-996e-b0e3a524e103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:34:41.887202 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-eb64b724-f7ee-44dd-bbfe-9a060159f9fb tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afe842eb-6952-4ad4-a4ba-138b44870e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:34:41.893925 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-eb64b724-f7ee-44dd-bbfe-9a060159f9fb tempest-GroupSnapshotsTest-1402242931 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:34:41.907361 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-eb64b724-f7ee-44dd-bbfe-9a060159f9fb tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afe842eb-6952-4ad4-a4ba-138b44870e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-730161842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5cebfeb9-ad84-478d-a1e1-e6b34cdfa084,host='ncdv-master-1@ceph#ceph',id=3d6e5b6f-73e9-464e-b54f-93d9d8ea1421,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='758f44503e1c41dc9aecca962e0c75f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:34:42Z,use_quota=True,user_id='3a838ec078394a5cba918617920febff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3037462-d83e-48f3-85b6-ca0c282aeb85),volume_type_id=c3037462-d83e-48f3-85b6-ca0c282aeb85)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:34:41.910008 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-eb64b724-f7ee-44dd-bbfe-9a060159f9fb tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf7b2ebf-baad-4cd5-b388-3381e18ee28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:34:41.912148 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-eb64b724-f7ee-44dd-bbfe-9a060159f9fb tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf7b2ebf-baad-4cd5-b388-3381e18ee28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:34:41.914552 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-eb64b724-f7ee-44dd-bbfe-9a060159f9fb tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1030a245-2d87-46d8-a3fc-4b585413e798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:34:41.916797 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-eb64b724-f7ee-44dd-bbfe-9a060159f9fb tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1030a245-2d87-46d8-a3fc-4b585413e798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d6e5b6f-73e9-464e-b54f-93d9d8ea1421', 'volume_name': 'volume-3d6e5b6f-73e9-464e-b54f-93d9d8ea1421', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:34:41.919117 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-eb64b724-f7ee-44dd-bbfe-9a060159f9fb tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8fa6d6c-9153-4c05-9c6b-88ca0cc63cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:34:41.921911 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-eb64b724-f7ee-44dd-bbfe-9a060159f9fb tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8fa6d6c-9153-4c05-9c6b-88ca0cc63cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:34:41.924089 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-eb64b724-f7ee-44dd-bbfe-9a060159f9fb tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7ce358a-c84c-4c7f-873b-a155f01fe71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:34:41.924952 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-eb64b724-f7ee-44dd-bbfe-9a060159f9fb tempest-GroupSnapshotsTest-1402242931 None] Volume 3d6e5b6f-73e9-464e-b54f-93d9d8ea1421: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d6e5b6f-73e9-464e-b54f-93d9d8ea1421', 'volume_size': 1} Dec 25 21:34:41.925360 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-eb64b724-f7ee-44dd-bbfe-9a060159f9fb tempest-GroupSnapshotsTest-1402242931 None] creating volume 'volume-3d6e5b6f-73e9-464e-b54f-93d9d8ea1421' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:34:41.926420 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-eb64b724-f7ee-44dd-bbfe-9a060159f9fb tempest-GroupSnapshotsTest-1402242931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:34:42.089380 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-0325c61a-de6d-4784-b983-77cd7d7223c0 tempest-TestVolumeBootPattern-1499667379 None] Created reservations ['91db2440-aafd-4459-a51c-9f4b54ccf209', 'a80cb40c-0933-4805-bd2a-88a2c6d5ef81', '0b4f255a-cd5a-4383-9175-682d6f8bd7f1', 'b46918ef-f7a2-400c-90f2-679bbd88866a'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:34:42.298675 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-4fe6e2c9-19ec-40ce-8d63-0dd734096a51 tempest-VolumesExtendTest-789413853 None] Created reservations ['3990d9fb-6f5d-484b-b6ae-35581b330997', '55f661f9-d273-4111-ba03-4ebb72ad59e8', '3da81d8b-cfc6-4a68-b73e-74a9fbb3c19a', 'fd3bf407-f844-4c6f-82a0-742cbbd6098d'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:34:42.422468 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-0325c61a-de6d-4784-b983-77cd7d7223c0 tempest-TestVolumeBootPattern-1499667379 None] Delete snapshot completed successfully. Dec 25 21:34:42.432304 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-0325c61a-de6d-4784-b983-77cd7d7223c0 tempest-TestVolumeBootPattern-1499667379 None] Lock "b'cinder-408acdab-9a9e-4132-bb02-430bae4d8a1d-delete_snapshot'" released by "delete_snapshot" :: held 33.117s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:34:42.521564 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-4fe6e2c9-19ec-40ce-8d63-0dd734096a51 tempest-VolumesExtendTest-789413853 None] Delete snapshot completed successfully. Dec 25 21:34:42.525982 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-4fe6e2c9-19ec-40ce-8d63-0dd734096a51 tempest-VolumesExtendTest-789413853 None] Lock "b'cinder-b9e3d6a9-9496-48d7-8e90-6b75a50ab7c4-delete_snapshot'" released by "delete_snapshot" :: held 5.912s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:34:43.045593 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-f881473e-60d0-480c-b59d-6661fe0d2b87 tempest-VolumesExtendTest-789413853 None] Lock "b'cinder-c8168394-603d-4428-8e69-430dd2fb388c-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:34:43.154112 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f881473e-60d0-480c-b59d-6661fe0d2b87 tempest-VolumesExtendTest-789413853 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:34:43.489092 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f881473e-60d0-480c-b59d-6661fe0d2b87 tempest-VolumesExtendTest-789413853 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:34:43.489735 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f881473e-60d0-480c-b59d-6661fe0d2b87 tempest-VolumesExtendTest-789413853 None] Volume volume-c8168394-603d-4428-8e69-430dd2fb388c is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:34:43.742948 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f881473e-60d0-480c-b59d-6661fe0d2b87 tempest-VolumesExtendTest-789413853 None] deleting rbd volume volume-c8168394-603d-4428-8e69-430dd2fb388c {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:34:43.754336 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-eb64b724-f7ee-44dd-bbfe-9a060159f9fb tempest-GroupSnapshotsTest-1402242931 None] extra_specs: {} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:34:43.754897 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-eb64b724-f7ee-44dd-bbfe-9a060159f9fb tempest-GroupSnapshotsTest-1402242931 None] extra_specs: {} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:34:43.757334 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-eb64b724-f7ee-44dd-bbfe-9a060159f9fb tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7ce358a-c84c-4c7f-873b-a155f01fe71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d6e5b6f-73e9-464e-b54f-93d9d8ea1421', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:34:43.761431 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-eb64b724-f7ee-44dd-bbfe-9a060159f9fb tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeffd391-1a3f-4d5d-8670-afa1d0171b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:34:43.841602 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-eb64b724-f7ee-44dd-bbfe-9a060159f9fb tempest-GroupSnapshotsTest-1402242931 None] Volume volume-3d6e5b6f-73e9-464e-b54f-93d9d8ea1421 (3d6e5b6f-73e9-464e-b54f-93d9d8ea1421): created successfully Dec 25 21:34:43.844239 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-eb64b724-f7ee-44dd-bbfe-9a060159f9fb tempest-GroupSnapshotsTest-1402242931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeffd391-1a3f-4d5d-8670-afa1d0171b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:34:43.847350 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-eb64b724-f7ee-44dd-bbfe-9a060159f9fb tempest-GroupSnapshotsTest-1402242931 None] Flow 'volume_create_manager' (2f01b9eb-cc33-4254-996e-b0e3a524e103) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:34:43.952732 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-eb64b724-f7ee-44dd-bbfe-9a060159f9fb tempest-GroupSnapshotsTest-1402242931 None] Created volume successfully. Dec 25 21:34:45.345198 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-5417fe5f-61f4-43e5-9cbb-2db86a5cf415 tempest-GroupSnapshotsTest-1402242931 None] GroupSnapshot 57f34759-0e57-4540-8c23-e1cb0ea0998c: creating. Dec 25 21:34:45.364467 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5417fe5f-61f4-43e5-9cbb-2db86a5cf415 tempest-GroupSnapshotsTest-1402242931 None] Group snapshot 57f34759-0e57-4540-8c23-e1cb0ea0998c: creating. {{(pid=129926) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4078}} Dec 25 21:34:45.384681 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-5417fe5f-61f4-43e5-9cbb-2db86a5cf415 tempest-GroupSnapshotsTest-1402242931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:34:46.039651 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-148fd7a8-d857-4bce-88e9-29a8930f6dd0 req-27f2c6c4-7eb2-4256-bc14-2e2f3de94388 tempest-TestVolumeBootPattern-1499667379 None] Terminate volume connection completed successfully. Dec 25 21:34:46.040076 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-148fd7a8-d857-4bce-88e9-29a8930f6dd0 req-27f2c6c4-7eb2-4256-bc14-2e2f3de94388 tempest-TestVolumeBootPattern-1499667379 None] Deleting attachment ae2ea7d3-0909-4c8d-8c1a-948a60d2036e. {{(pid=129926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 25 21:34:46.366540 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [req-148fd7a8-d857-4bce-88e9-29a8930f6dd0 req-e5aa4cb1-0e93-4f98-a673-1736a34e24d8 tempest-TestVolumeBootPattern-1499667379 None] Lock "b'cinder-63db5869-7587-4d2a-ac56-8b2e33092808-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:34:46.475625 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-148fd7a8-d857-4bce-88e9-29a8930f6dd0 req-e5aa4cb1-0e93-4f98-a673-1736a34e24d8 tempest-TestVolumeBootPattern-1499667379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:34:47.098751 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-148fd7a8-d857-4bce-88e9-29a8930f6dd0 req-e5aa4cb1-0e93-4f98-a673-1736a34e24d8 tempest-TestVolumeBootPattern-1499667379 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:34:47.405133 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-148fd7a8-d857-4bce-88e9-29a8930f6dd0 req-e5aa4cb1-0e93-4f98-a673-1736a34e24d8 tempest-TestVolumeBootPattern-1499667379 None] deleting rbd volume volume-63db5869-7587-4d2a-ac56-8b2e33092808 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:34:50.551143 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-5417fe5f-61f4-43e5-9cbb-2db86a5cf415 tempest-GroupSnapshotsTest-1402242931 None] group_snapshot 57f34759-0e57-4540-8c23-e1cb0ea0998c: created successfully Dec 25 21:34:50.900130 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-83fbb6d0-d073-40c5-be2c-20fe6ccbbe1c tempest-GroupSnapshotsTest-1402242931 None] group_snapshot 57f34759-0e57-4540-8c23-e1cb0ea0998c: deleting Dec 25 21:34:50.918469 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-83fbb6d0-d073-40c5-be2c-20fe6ccbbe1c tempest-GroupSnapshotsTest-1402242931 None] group_snapshot 57f34759-0e57-4540-8c23-e1cb0ea0998c: deleting {{(pid=129926) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4253}} Dec 25 21:34:50.933745 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-83fbb6d0-d073-40c5-be2c-20fe6ccbbe1c tempest-GroupSnapshotsTest-1402242931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:34:55.658838 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-f881473e-60d0-480c-b59d-6661fe0d2b87 tempest-VolumesExtendTest-789413853 None] Created reservations ['015cc54d-4044-496e-bf2a-55072017780d', '92fe4c29-04f4-4294-8a9d-259f5518834f', '24c5f9be-b148-4c9e-ad45-4fe7e1969b3a', '9eead8a4-5aa4-4bce-bb4a-54782f0a6078'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:34:55.860581 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f881473e-60d0-480c-b59d-6661fe0d2b87 tempest-VolumesExtendTest-789413853 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:34:55.883186 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f881473e-60d0-480c-b59d-6661fe0d2b87 tempest-VolumesExtendTest-789413853 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:34:55.912693 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-f881473e-60d0-480c-b59d-6661fe0d2b87 tempest-VolumesExtendTest-789413853 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:34:55.917139 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-f881473e-60d0-480c-b59d-6661fe0d2b87 tempest-VolumesExtendTest-789413853 None] Deleted volume successfully. Dec 25 21:34:56.052441 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-f881473e-60d0-480c-b59d-6661fe0d2b87 tempest-VolumesExtendTest-789413853 None] Lock "b'cinder-c8168394-603d-4428-8e69-430dd2fb388c-delete_volume'" released by "delete_volume" :: held 13.007s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:34:56.978190 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-dfd6894b-2be1-4eb5-b843-3de596e9ecfd tempest-VolumesExtendTest-789413853 None] Lock "b'cinder-23c339db-ad89-43c8-81a1-e84ef68c6ced-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:34:57.082608 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-dfd6894b-2be1-4eb5-b843-3de596e9ecfd tempest-VolumesExtendTest-789413853 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:34:57.573805 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-dfd6894b-2be1-4eb5-b843-3de596e9ecfd tempest-VolumesExtendTest-789413853 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:34:57.781942 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-dfd6894b-2be1-4eb5-b843-3de596e9ecfd tempest-VolumesExtendTest-789413853 None] deleting rbd volume volume-23c339db-ad89-43c8-81a1-e84ef68c6ced {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:34:58.251325 ncdv-master-1 cinder-volume[129926]: WARNING cinder.quota [None req-83fbb6d0-d073-40c5-be2c-20fe6ccbbe1c tempest-GroupSnapshotsTest-1402242931 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-550357772 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-550357772, it is now deprecated. Please use the default quota class for default quota. Dec 25 21:34:58.251325 ncdv-master-1 cinder-volume[129926]: WARNING cinder.quota [None req-83fbb6d0-d073-40c5-be2c-20fe6ccbbe1c tempest-GroupSnapshotsTest-1402242931 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-550357772 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-550357772, it is now deprecated. Please use the default quota class for default quota. Dec 25 21:34:58.339998 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-83fbb6d0-d073-40c5-be2c-20fe6ccbbe1c tempest-GroupSnapshotsTest-1402242931 None] Created reservations ['83b26677-bb60-49fa-aa78-3d643d37df47', '59584eee-03fd-45d0-b68b-1a2b3b68c358', '81ca7689-227e-47db-acd9-5884436e7625', '664a610d-cf3c-46d4-9f62-5fb7ee03a58f'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:34:58.681105 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-83fbb6d0-d073-40c5-be2c-20fe6ccbbe1c tempest-GroupSnapshotsTest-1402242931 None] group_snapshot 57f34759-0e57-4540-8c23-e1cb0ea0998c: deleted successfully Dec 25 21:34:59.792106 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-81cb2470-8d67-4e8c-b10d-116d75bdb73b tempest-GroupSnapshotsTest-1402242931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:35:00.198712 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-81cb2470-8d67-4e8c-b10d-116d75bdb73b tempest-GroupSnapshotsTest-1402242931 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:35:00.199169 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-81cb2470-8d67-4e8c-b10d-116d75bdb73b tempest-GroupSnapshotsTest-1402242931 None] Volume volume-3d6e5b6f-73e9-464e-b54f-93d9d8ea1421 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:35:00.743355 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-81cb2470-8d67-4e8c-b10d-116d75bdb73b tempest-GroupSnapshotsTest-1402242931 None] deleting rbd volume volume-3d6e5b6f-73e9-464e-b54f-93d9d8ea1421 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:35:00.746088 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-148fd7a8-d857-4bce-88e9-29a8930f6dd0 req-e5aa4cb1-0e93-4f98-a673-1736a34e24d8 tempest-TestVolumeBootPattern-1499667379 None] volume is a clone so cleaning references {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 25 21:35:01.057149 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-148fd7a8-d857-4bce-88e9-29a8930f6dd0 req-e5aa4cb1-0e93-4f98-a673-1736a34e24d8 tempest-TestVolumeBootPattern-1499667379 None] deleting parent snapshot volume-63db5869-7587-4d2a-ac56-8b2e33092808.clone_snap {{(pid=129926) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 25 21:35:06.047187 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-453934dc-171b-4e97-8e2f-851c8c9314d2 tempest-AttachVolumeShelveTestJSON-1279821748 None] Lock "b'cinder-c6f19b7c-8208-496f-b21d-a897c1383467-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:35:06.151052 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [req-148fd7a8-d857-4bce-88e9-29a8930f6dd0 req-e5aa4cb1-0e93-4f98-a673-1736a34e24d8 tempest-TestVolumeBootPattern-1499667379 None] Created reservations ['650e7aaf-6a26-48ca-9eba-d482662510ed', '869ffe64-1dee-4cbd-9338-d527b9f6622b', '85cb4ebc-b2a6-47f7-96b8-4967541d8224', 'faa7a015-4b6a-4199-9b78-a7a0ff36a939'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:35:06.244136 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-453934dc-171b-4e97-8e2f-851c8c9314d2 tempest-AttachVolumeShelveTestJSON-1279821748 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:35:06.631195 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-453934dc-171b-4e97-8e2f-851c8c9314d2 tempest-AttachVolumeShelveTestJSON-1279821748 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:35:06.633641 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-453934dc-171b-4e97-8e2f-851c8c9314d2 tempest-AttachVolumeShelveTestJSON-1279821748 None] Volume volume-c6f19b7c-8208-496f-b21d-a897c1383467 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:35:07.003025 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-453934dc-171b-4e97-8e2f-851c8c9314d2 tempest-AttachVolumeShelveTestJSON-1279821748 None] deleting rbd volume volume-c6f19b7c-8208-496f-b21d-a897c1383467 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:35:07.094871 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-148fd7a8-d857-4bce-88e9-29a8930f6dd0 req-e5aa4cb1-0e93-4f98-a673-1736a34e24d8 tempest-TestVolumeBootPattern-1499667379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:35:07.119443 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-148fd7a8-d857-4bce-88e9-29a8930f6dd0 req-e5aa4cb1-0e93-4f98-a673-1736a34e24d8 tempest-TestVolumeBootPattern-1499667379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:35:07.153314 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [req-148fd7a8-d857-4bce-88e9-29a8930f6dd0 req-e5aa4cb1-0e93-4f98-a673-1736a34e24d8 tempest-TestVolumeBootPattern-1499667379 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:35:07.157394 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-148fd7a8-d857-4bce-88e9-29a8930f6dd0 req-e5aa4cb1-0e93-4f98-a673-1736a34e24d8 tempest-TestVolumeBootPattern-1499667379 None] Deleted volume successfully. Dec 25 21:35:07.242843 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [req-148fd7a8-d857-4bce-88e9-29a8930f6dd0 req-e5aa4cb1-0e93-4f98-a673-1736a34e24d8 tempest-TestVolumeBootPattern-1499667379 None] Lock "b'cinder-63db5869-7587-4d2a-ac56-8b2e33092808-delete_volume'" released by "delete_volume" :: held 20.876s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:35:08.228536 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-dfd6894b-2be1-4eb5-b843-3de596e9ecfd tempest-VolumesExtendTest-789413853 None] volume is a clone so cleaning references {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 25 21:35:08.604795 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-dfd6894b-2be1-4eb5-b843-3de596e9ecfd tempest-VolumesExtendTest-789413853 None] deleting parent snapshot volume-23c339db-ad89-43c8-81a1-e84ef68c6ced.clone_snap {{(pid=129926) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 25 21:35:14.694604 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-dfd6894b-2be1-4eb5-b843-3de596e9ecfd tempest-VolumesExtendTest-789413853 None] Created reservations ['5064198c-7c27-4809-bde0-72713bc4ec08', '32cf3aa6-f5c2-4796-b38e-2a7f56a01745', 'dfca3d21-21b2-4e72-9b5a-ab4fd4c80fa5', '4ea4eb1d-4ba2-46c9-934a-ffe70cf2b15f'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:35:14.698937 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-faeb857c-9838-401b-b488-2a6fcd959daa tempest-TestVolumeBootPattern-1499667379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:35:14.704359 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-faeb857c-9838-401b-b488-2a6fcd959daa tempest-TestVolumeBootPattern-1499667379 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:35:14.704359 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-faeb857c-9838-401b-b488-2a6fcd959daa tempest-TestVolumeBootPattern-1499667379 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:35:14.715097 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-faeb857c-9838-401b-b488-2a6fcd959daa tempest-TestVolumeBootPattern-1499667379 None] Flow 'volume_create_manager' (62e53966-2f47-47f5-b924-09b46426eccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:35:14.718320 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-faeb857c-9838-401b-b488-2a6fcd959daa tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c46b3c8f-8ac5-40fe-afad-1fb850b56e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:14.725793 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-faeb857c-9838-401b-b488-2a6fcd959daa tempest-TestVolumeBootPattern-1499667379 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:35:14.750351 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-faeb857c-9838-401b-b488-2a6fcd959daa tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c46b3c8f-8ac5-40fe-afad-1fb850b56e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-533265417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1f66629a-ecb8-47cb-8a87-8abb304c2f96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c77dc74a46d64a67991d82bf12adb1dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:35:12Z,use_quota=True,user_id='171c198b6b734cd698b3c1eaf76a0234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:14.752783 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-faeb857c-9838-401b-b488-2a6fcd959daa tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4909a36-6b5e-40c1-a290-0907654a930f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:14.754957 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-faeb857c-9838-401b-b488-2a6fcd959daa tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4909a36-6b5e-40c1-a290-0907654a930f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:14.757446 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-faeb857c-9838-401b-b488-2a6fcd959daa tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31bf4706-7f03-472d-8e1d-2ee190532974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:14.838155 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-faeb857c-9838-401b-b488-2a6fcd959daa tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31bf4706-7f03-472d-8e1d-2ee190532974) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1f66629a-ecb8-47cb-8a87-8abb304c2f96', 'volume_name': 'volume-1f66629a-ecb8-47cb-8a87-8abb304c2f96', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:14.840684 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-faeb857c-9838-401b-b488-2a6fcd959daa tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56777d36-7f79-4524-9c43-03b2fd802c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:14.842947 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-faeb857c-9838-401b-b488-2a6fcd959daa tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56777d36-7f79-4524-9c43-03b2fd802c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:14.845091 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-faeb857c-9838-401b-b488-2a6fcd959daa tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51f49496-173a-4f6e-a5b1-aee7e7231713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:14.846471 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-faeb857c-9838-401b-b488-2a6fcd959daa tempest-TestVolumeBootPattern-1499667379 None] Volume 1f66629a-ecb8-47cb-8a87-8abb304c2f96: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1f66629a-ecb8-47cb-8a87-8abb304c2f96', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 25 21:35:14.847062 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-faeb857c-9838-401b-b488-2a6fcd959daa tempest-TestVolumeBootPattern-1499667379 None] Cloning 1f66629a-ecb8-47cb-8a87-8abb304c2f96 from image aca914d0-5f7b-465f-a024-75efa27d7291 at location (None, None). {{(pid=129926) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Dec 25 21:35:14.861835 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-81cb2470-8d67-4e8c-b10d-116d75bdb73b tempest-GroupSnapshotsTest-1402242931 None] Created reservations ['a93f8d8a-4a99-4d0a-ae7e-43293b466855'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:35:14.869172 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-faeb857c-9838-401b-b488-2a6fcd959daa tempest-TestVolumeBootPattern-1499667379 None] Lock "b'cinder-aca914d0-5f7b-465f-a024-75efa27d7291'" acquired by "_prepare_image_cache_entry" :: waited 0.021s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:35:14.889217 ncdv-master-1 cinder-volume[129926]: WARNING cinder.quota [None req-81cb2470-8d67-4e8c-b10d-116d75bdb73b tempest-GroupSnapshotsTest-1402242931 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-550357772 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-550357772, it is now deprecated. Please use the default quota class for default quota. Dec 25 21:35:14.970115 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-dfd6894b-2be1-4eb5-b843-3de596e9ecfd tempest-VolumesExtendTest-789413853 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:35:14.992289 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-dfd6894b-2be1-4eb5-b843-3de596e9ecfd tempest-VolumesExtendTest-789413853 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:35:15.015296 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-dfd6894b-2be1-4eb5-b843-3de596e9ecfd tempest-VolumesExtendTest-789413853 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:35:15.021090 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-dfd6894b-2be1-4eb5-b843-3de596e9ecfd tempest-VolumesExtendTest-789413853 None] Deleted volume successfully. Dec 25 21:35:15.027688 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-faeb857c-9838-401b-b488-2a6fcd959daa tempest-TestVolumeBootPattern-1499667379 None] Found image-volume cache entry: {'id': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'volume_id': '058f5fb3-51e4-40e3-9c98-542207f1fc1f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31), 'last_used': datetime.datetime(2021, 12, 25, 21, 35, 14, 885124)}. {{(pid=129926) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 25 21:35:15.028121 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-faeb857c-9838-401b-b488-2a6fcd959daa tempest-TestVolumeBootPattern-1499667379 None] Image-volume cache entry image_update_at = 2021-12-25 20:58:31+00:00, requested image updated_at = 2021-12-25 20:58:31+00:00. {{(pid=129926) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 25 21:35:15.028655 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-faeb857c-9838-401b-b488-2a6fcd959daa tempest-TestVolumeBootPattern-1499667379 None] Found cache entry for image = aca914d0-5f7b-465f-a024-75efa27d7291 on host ncdv-master-1@ceph#ceph. {{(pid=129926) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Dec 25 21:35:15.035313 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-faeb857c-9838-401b-b488-2a6fcd959daa tempest-TestVolumeBootPattern-1499667379 None] Lock "b'cinder-aca914d0-5f7b-465f-a024-75efa27d7291'" released by "_prepare_image_cache_entry" :: held 0.166s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:35:15.036474 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-faeb857c-9838-401b-b488-2a6fcd959daa tempest-TestVolumeBootPattern-1499667379 None] Attempting to retrieve cache entry for image = aca914d0-5f7b-465f-a024-75efa27d7291 on host ncdv-master-1@ceph#ceph. {{(pid=129926) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Dec 25 21:35:15.042387 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-faeb857c-9838-401b-b488-2a6fcd959daa tempest-TestVolumeBootPattern-1499667379 None] Found image-volume cache entry: {'id': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'volume_id': '058f5fb3-51e4-40e3-9c98-542207f1fc1f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31), 'last_used': datetime.datetime(2021, 12, 25, 21, 35, 15, 40022)}. {{(pid=129926) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 25 21:35:15.042803 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-faeb857c-9838-401b-b488-2a6fcd959daa tempest-TestVolumeBootPattern-1499667379 None] Image-volume cache entry image_update_at = 2021-12-25 20:58:31+00:00, requested image updated_at = 2021-12-25 20:58:31+00:00. {{(pid=129926) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 25 21:35:15.043249 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-faeb857c-9838-401b-b488-2a6fcd959daa tempest-TestVolumeBootPattern-1499667379 None] Creating from source image-volume 058f5fb3-51e4-40e3-9c98-542207f1fc1f {{(pid=129926) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Dec 25 21:35:15.056547 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-faeb857c-9838-401b-b488-2a6fcd959daa tempest-TestVolumeBootPattern-1499667379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:35:16.025764 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-faeb857c-9838-401b-b488-2a6fcd959daa tempest-TestVolumeBootPattern-1499667379 None] creating snapshot='volume-1f66629a-ecb8-47cb-8a87-8abb304c2f96.clone_snap' {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 25 21:35:19.843414 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-faeb857c-9838-401b-b488-2a6fcd959daa tempest-TestVolumeBootPattern-1499667379 None] cloning 'volume-058f5fb3-51e4-40e3-9c98-542207f1fc1f@volume-1f66629a-ecb8-47cb-8a87-8abb304c2f96.clone_snap' to 'volume-1f66629a-ecb8-47cb-8a87-8abb304c2f96' {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 25 21:35:19.866266 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-81cb2470-8d67-4e8c-b10d-116d75bdb73b tempest-GroupSnapshotsTest-1402242931 None] Created reservations ['766192ac-1054-4f54-beb0-0c3020557544', 'af110806-1bbb-4677-afae-e926636709f6', '66cf037b-0ca2-47d9-a42d-ea3da9073ab3', '35a52700-b529-479a-a9fd-0c8196ff85a1'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:35:19.887807 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-dfd6894b-2be1-4eb5-b843-3de596e9ecfd tempest-VolumesExtendTest-789413853 None] Lock "b'cinder-23c339db-ad89-43c8-81a1-e84ef68c6ced-delete_volume'" released by "delete_volume" :: held 22.910s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:35:19.903964 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-8c90368a-da0f-4d44-97cf-0b5fef3eab5b tempest-GroupsV320Test-1592412609 None] Group tempest-GroupsV320Test-Group-1534424799: creating Dec 25 21:35:19.999307 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-453934dc-171b-4e97-8e2f-851c8c9314d2 tempest-AttachVolumeShelveTestJSON-1279821748 None] Created reservations ['e8b90790-bfcb-4db2-a666-75ef540e5390', '161536a1-cd25-41e3-a3cc-97cba0c53cef', 'a4b903a7-819f-439a-9ba5-6cf4f5c4e222', '1b6f72db-b122-4cf1-887a-5004004ecb45'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:35:20.016865 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-8c90368a-da0f-4d44-97cf-0b5fef3eab5b tempest-GroupsV320Test-1592412609 None] Group tempest-GroupsV320Test-Group-1534424799: created successfully Dec 25 21:35:20.030947 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-8c90368a-da0f-4d44-97cf-0b5fef3eab5b tempest-GroupsV320Test-1592412609 None] Create group completed successfully. Dec 25 21:35:20.061524 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-85a1ebdb-3633-4c17-a50a-1f5281d95687 tempest-VolumesGetTest-758022543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:35:20.065148 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-85a1ebdb-3633-4c17-a50a-1f5281d95687 tempest-VolumesGetTest-758022543 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:35:20.069851 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-85a1ebdb-3633-4c17-a50a-1f5281d95687 tempest-VolumesGetTest-758022543 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:35:20.077589 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-85a1ebdb-3633-4c17-a50a-1f5281d95687 tempest-VolumesGetTest-758022543 None] Flow 'volume_create_manager' (a74bb1bb-ae9c-48c7-b9ea-80948a6e6947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:35:20.080768 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-85a1ebdb-3633-4c17-a50a-1f5281d95687 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2848530f-0990-4b41-80ec-70b4511f66e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:20.087679 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-85a1ebdb-3633-4c17-a50a-1f5281d95687 tempest-VolumesGetTest-758022543 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:35:20.100751 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-85a1ebdb-3633-4c17-a50a-1f5281d95687 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2848530f-0990-4b41-80ec-70b4511f66e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-680966152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=51912ae8-b05e-4878-b55e-625706bf8cbc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='609b19a4efc34c8fa016adb3a5fdb23b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:35:18Z,use_quota=True,user_id='322d719e1dbd4014b58f2f7ed9641f2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:20.103364 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-85a1ebdb-3633-4c17-a50a-1f5281d95687 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b21b95-3756-4791-9ccb-59b5b50c392e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:20.105631 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-85a1ebdb-3633-4c17-a50a-1f5281d95687 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b21b95-3756-4791-9ccb-59b5b50c392e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:20.107996 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-85a1ebdb-3633-4c17-a50a-1f5281d95687 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6de1a335-5520-4c34-ad71-f8e84cfd8fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:20.110572 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-85a1ebdb-3633-4c17-a50a-1f5281d95687 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6de1a335-5520-4c34-ad71-f8e84cfd8fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51912ae8-b05e-4878-b55e-625706bf8cbc', 'volume_name': 'volume-51912ae8-b05e-4878-b55e-625706bf8cbc', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:20.112995 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-85a1ebdb-3633-4c17-a50a-1f5281d95687 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a13b69f-461e-45f9-815e-0126273ce01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:20.115069 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-85a1ebdb-3633-4c17-a50a-1f5281d95687 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a13b69f-461e-45f9-815e-0126273ce01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:20.117348 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-85a1ebdb-3633-4c17-a50a-1f5281d95687 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdf29d06-a496-4107-8c51-6a29b2e3d83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:20.121452 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-85a1ebdb-3633-4c17-a50a-1f5281d95687 tempest-VolumesGetTest-758022543 None] Volume 51912ae8-b05e-4878-b55e-625706bf8cbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51912ae8-b05e-4878-b55e-625706bf8cbc', 'volume_size': 1} Dec 25 21:35:20.121452 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-85a1ebdb-3633-4c17-a50a-1f5281d95687 tempest-VolumesGetTest-758022543 None] creating volume 'volume-51912ae8-b05e-4878-b55e-625706bf8cbc' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:35:20.121452 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-85a1ebdb-3633-4c17-a50a-1f5281d95687 tempest-VolumesGetTest-758022543 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:35:20.248761 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-453934dc-171b-4e97-8e2f-851c8c9314d2 tempest-AttachVolumeShelveTestJSON-1279821748 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:35:20.296747 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-453934dc-171b-4e97-8e2f-851c8c9314d2 tempest-AttachVolumeShelveTestJSON-1279821748 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:35:20.336628 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-453934dc-171b-4e97-8e2f-851c8c9314d2 tempest-AttachVolumeShelveTestJSON-1279821748 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:35:20.344120 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-453934dc-171b-4e97-8e2f-851c8c9314d2 tempest-AttachVolumeShelveTestJSON-1279821748 None] Deleted volume successfully. Dec 25 21:35:20.430682 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-453934dc-171b-4e97-8e2f-851c8c9314d2 tempest-AttachVolumeShelveTestJSON-1279821748 None] Lock "b'cinder-c6f19b7c-8208-496f-b21d-a897c1383467-delete_volume'" released by "delete_volume" :: held 14.383s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:35:20.441993 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-81cb2470-8d67-4e8c-b10d-116d75bdb73b tempest-GroupSnapshotsTest-1402242931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:35:20.487242 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-81cb2470-8d67-4e8c-b10d-116d75bdb73b tempest-GroupSnapshotsTest-1402242931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:35:20.511393 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-81cb2470-8d67-4e8c-b10d-116d75bdb73b tempest-GroupSnapshotsTest-1402242931 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:35:20.515310 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-81cb2470-8d67-4e8c-b10d-116d75bdb73b tempest-GroupSnapshotsTest-1402242931 None] Delete group completed successfully. Dec 25 21:35:20.692681 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-b5b2fe05-dcc7-4787-81b8-18b8848e2661 tempest-AttachVolumeShelveTestJSON-1279821748 None] Lock "b'cinder-06661aab-01cf-4a95-94d1-d80c006009d6-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:35:20.840033 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b5b2fe05-dcc7-4787-81b8-18b8848e2661 tempest-AttachVolumeShelveTestJSON-1279821748 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:35:21.192230 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b5b2fe05-dcc7-4787-81b8-18b8848e2661 tempest-AttachVolumeShelveTestJSON-1279821748 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:35:21.192916 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b5b2fe05-dcc7-4787-81b8-18b8848e2661 tempest-AttachVolumeShelveTestJSON-1279821748 None] Volume volume-06661aab-01cf-4a95-94d1-d80c006009d6 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:35:21.497936 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b5b2fe05-dcc7-4787-81b8-18b8848e2661 tempest-AttachVolumeShelveTestJSON-1279821748 None] deleting rbd volume volume-06661aab-01cf-4a95-94d1-d80c006009d6 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:35:21.728807 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-ae9dfc2f-401b-406e-9631-dc996d32b4dd tempest-GroupsV320Test-1592412609 None] Created reservations ['8d56b633-c5df-45ae-b7d7-b91d5a662fa6'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:35:21.948792 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ae9dfc2f-401b-406e-9631-dc996d32b4dd tempest-GroupsV320Test-1592412609 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:35:21.981429 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ae9dfc2f-401b-406e-9631-dc996d32b4dd tempest-GroupsV320Test-1592412609 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:35:22.009003 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-ae9dfc2f-401b-406e-9631-dc996d32b4dd tempest-GroupsV320Test-1592412609 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:35:22.020026 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-ae9dfc2f-401b-406e-9631-dc996d32b4dd tempest-GroupsV320Test-1592412609 None] Delete group completed successfully. Dec 25 21:35:22.020173 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-85a1ebdb-3633-4c17-a50a-1f5281d95687 tempest-VolumesGetTest-758022543 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:35:22.020540 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-85a1ebdb-3633-4c17-a50a-1f5281d95687 tempest-VolumesGetTest-758022543 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:35:22.022787 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-85a1ebdb-3633-4c17-a50a-1f5281d95687 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdf29d06-a496-4107-8c51-6a29b2e3d83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51912ae8-b05e-4878-b55e-625706bf8cbc', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:22.025123 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-85a1ebdb-3633-4c17-a50a-1f5281d95687 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed4ab3f-b747-4271-8e50-c327d78a0c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:22.093276 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-85a1ebdb-3633-4c17-a50a-1f5281d95687 tempest-VolumesGetTest-758022543 None] Volume volume-51912ae8-b05e-4878-b55e-625706bf8cbc (51912ae8-b05e-4878-b55e-625706bf8cbc): created successfully Dec 25 21:35:22.095303 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-85a1ebdb-3633-4c17-a50a-1f5281d95687 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed4ab3f-b747-4271-8e50-c327d78a0c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:22.098347 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-85a1ebdb-3633-4c17-a50a-1f5281d95687 tempest-VolumesGetTest-758022543 None] Flow 'volume_create_manager' (a74bb1bb-ae9c-48c7-b9ea-80948a6e6947) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:35:22.145957 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-85a1ebdb-3633-4c17-a50a-1f5281d95687 tempest-VolumesGetTest-758022543 None] Created volume successfully. Dec 25 21:35:23.548111 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-faeb857c-9838-401b-b488-2a6fcd959daa tempest-TestVolumeBootPattern-1499667379 None] Volume volume-98b6d31e-e760-499e-8962-7b22479c1e9a.deleted is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:35:23.558019 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-faeb857c-9838-401b-b488-2a6fcd959daa tempest-TestVolumeBootPattern-1499667379 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:35:23.558638 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-faeb857c-9838-401b-b488-2a6fcd959daa tempest-TestVolumeBootPattern-1499667379 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:35:24.365835 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-faeb857c-9838-401b-b488-2a6fcd959daa tempest-TestVolumeBootPattern-1499667379 None] clone created successfully {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 25 21:35:24.366979 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.volume_utils [None req-faeb857c-9838-401b-b488-2a6fcd959daa tempest-TestVolumeBootPattern-1499667379 None] Marking volume 1f66629a-ecb8-47cb-8a87-8abb304c2f96 as bootable. {{(pid=129926) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 25 21:35:24.477462 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-faeb857c-9838-401b-b488-2a6fcd959daa tempest-TestVolumeBootPattern-1499667379 None] Copying metadata from image aca914d0-5f7b-465f-a024-75efa27d7291 to 1f66629a-ecb8-47cb-8a87-8abb304c2f96. {{(pid=129926) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Dec 25 21:35:24.477954 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-faeb857c-9838-401b-b488-2a6fcd959daa tempest-TestVolumeBootPattern-1499667379 None] Creating volume glance metadata for volume 1f66629a-ecb8-47cb-8a87-8abb304c2f96 backed by image aca914d0-5f7b-465f-a024-75efa27d7291 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129926) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Dec 25 21:35:24.530197 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ba0f1e1-a70e-45ed-8e45-b4710e907584 tempest-VolumesGetTest-758022543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:35:24.533392 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-6ba0f1e1-a70e-45ed-8e45-b4710e907584 tempest-VolumesGetTest-758022543 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:35:24.533833 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-6ba0f1e1-a70e-45ed-8e45-b4710e907584 tempest-VolumesGetTest-758022543 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:35:24.549804 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6ba0f1e1-a70e-45ed-8e45-b4710e907584 tempest-VolumesGetTest-758022543 None] Flow 'volume_create_manager' (6e08dab2-1873-40c9-b545-3b70466daf92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:35:24.555508 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6ba0f1e1-a70e-45ed-8e45-b4710e907584 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4778487-34c8-481b-aa36-5820f446f289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:24.559881 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-6ba0f1e1-a70e-45ed-8e45-b4710e907584 tempest-VolumesGetTest-758022543 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:35:24.572474 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6ba0f1e1-a70e-45ed-8e45-b4710e907584 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4778487-34c8-481b-aa36-5820f446f289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:35:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-445451394',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c2fea802-e514-4623-a399-31ad8fd8571d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609b19a4efc34c8fa016adb3a5fdb23b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:35:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:35:24Z,use_quota=True,user_id='322d719e1dbd4014b58f2f7ed9641f2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:24.578797 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6ba0f1e1-a70e-45ed-8e45-b4710e907584 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bca54b5-76e2-4d52-9b9a-c3092a10fd46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:24.578797 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6ba0f1e1-a70e-45ed-8e45-b4710e907584 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bca54b5-76e2-4d52-9b9a-c3092a10fd46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:24.580462 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6ba0f1e1-a70e-45ed-8e45-b4710e907584 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39894f79-d2b2-4b21-af60-c4c4a87877ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:24.584979 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6ba0f1e1-a70e-45ed-8e45-b4710e907584 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39894f79-d2b2-4b21-af60-c4c4a87877ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2fea802-e514-4623-a399-31ad8fd8571d', 'volume_name': 'volume-c2fea802-e514-4623-a399-31ad8fd8571d', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:24.588062 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6ba0f1e1-a70e-45ed-8e45-b4710e907584 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d46b15d-2880-4646-a934-6abd1756d5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:24.590357 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6ba0f1e1-a70e-45ed-8e45-b4710e907584 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d46b15d-2880-4646-a934-6abd1756d5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:24.592815 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6ba0f1e1-a70e-45ed-8e45-b4710e907584 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bb35997-2de2-43d6-8c6a-c04ade2b17bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:24.593745 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-6ba0f1e1-a70e-45ed-8e45-b4710e907584 tempest-VolumesGetTest-758022543 None] Volume c2fea802-e514-4623-a399-31ad8fd8571d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2fea802-e514-4623-a399-31ad8fd8571d', 'volume_size': 1} Dec 25 21:35:24.594142 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-6ba0f1e1-a70e-45ed-8e45-b4710e907584 tempest-VolumesGetTest-758022543 None] creating volume 'volume-c2fea802-e514-4623-a399-31ad8fd8571d' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:35:24.595275 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-6ba0f1e1-a70e-45ed-8e45-b4710e907584 tempest-VolumesGetTest-758022543 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:35:24.674523 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-faeb857c-9838-401b-b488-2a6fcd959daa tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51f49496-173a-4f6e-a5b1-aee7e7231713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f66629a-ecb8-47cb-8a87-8abb304c2f96', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:24.676895 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-faeb857c-9838-401b-b488-2a6fcd959daa tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0b2862d-82ce-4513-99fd-e2a976fbe5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:24.763027 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-faeb857c-9838-401b-b488-2a6fcd959daa tempest-TestVolumeBootPattern-1499667379 None] Volume volume-1f66629a-ecb8-47cb-8a87-8abb304c2f96 (1f66629a-ecb8-47cb-8a87-8abb304c2f96): created successfully Dec 25 21:35:24.765068 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-faeb857c-9838-401b-b488-2a6fcd959daa tempest-TestVolumeBootPattern-1499667379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0b2862d-82ce-4513-99fd-e2a976fbe5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:24.768114 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-faeb857c-9838-401b-b488-2a6fcd959daa tempest-TestVolumeBootPattern-1499667379 None] Flow 'volume_create_manager' (62e53966-2f47-47f5-b924-09b46426eccd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:35:24.926281 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-faeb857c-9838-401b-b488-2a6fcd959daa tempest-TestVolumeBootPattern-1499667379 None] Created volume successfully. Dec 25 21:35:26.179848 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-6ba0f1e1-a70e-45ed-8e45-b4710e907584 tempest-VolumesGetTest-758022543 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:35:26.181089 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-6ba0f1e1-a70e-45ed-8e45-b4710e907584 tempest-VolumesGetTest-758022543 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:35:26.182306 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6ba0f1e1-a70e-45ed-8e45-b4710e907584 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bb35997-2de2-43d6-8c6a-c04ade2b17bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2fea802-e514-4623-a399-31ad8fd8571d', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:26.184467 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6ba0f1e1-a70e-45ed-8e45-b4710e907584 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19da387c-6caa-446c-897c-c4c4b1b71a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:26.271954 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-6ba0f1e1-a70e-45ed-8e45-b4710e907584 tempest-VolumesGetTest-758022543 None] Volume volume-c2fea802-e514-4623-a399-31ad8fd8571d (c2fea802-e514-4623-a399-31ad8fd8571d): created successfully Dec 25 21:35:26.280065 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6ba0f1e1-a70e-45ed-8e45-b4710e907584 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19da387c-6caa-446c-897c-c4c4b1b71a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:26.280065 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6ba0f1e1-a70e-45ed-8e45-b4710e907584 tempest-VolumesGetTest-758022543 None] Flow 'volume_create_manager' (6e08dab2-1873-40c9-b545-3b70466daf92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:35:26.374536 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-6ba0f1e1-a70e-45ed-8e45-b4710e907584 tempest-VolumesGetTest-758022543 None] Created volume successfully. Dec 25 21:35:27.208544 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-0b098c3c-d907-4aaa-9b29-69528471b6ce tempest-VolumesGetTest-758022543 None] Lock "b'cinder-c2fea802-e514-4623-a399-31ad8fd8571d-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:35:27.350066 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0b098c3c-d907-4aaa-9b29-69528471b6ce tempest-VolumesGetTest-758022543 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:35:27.991618 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0b098c3c-d907-4aaa-9b29-69528471b6ce tempest-VolumesGetTest-758022543 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:35:27.992221 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0b098c3c-d907-4aaa-9b29-69528471b6ce tempest-VolumesGetTest-758022543 None] Volume volume-c2fea802-e514-4623-a399-31ad8fd8571d is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:35:28.294358 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0b098c3c-d907-4aaa-9b29-69528471b6ce tempest-VolumesGetTest-758022543 None] deleting rbd volume volume-c2fea802-e514-4623-a399-31ad8fd8571d {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:35:28.405450 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-04d3a93f-097e-4c66-9e6c-41c644fdea9c tempest-VolumeQuotasNegativeTestJSON-369132402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:35:28.410104 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-04d3a93f-097e-4c66-9e6c-41c644fdea9c tempest-VolumeQuotasNegativeTestJSON-369132402 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:35:28.411211 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-04d3a93f-097e-4c66-9e6c-41c644fdea9c tempest-VolumeQuotasNegativeTestJSON-369132402 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:35:28.424426 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-04d3a93f-097e-4c66-9e6c-41c644fdea9c tempest-VolumeQuotasNegativeTestJSON-369132402 None] Flow 'volume_create_manager' (8e5aa3a8-d5e4-4d20-97d7-865fe0e373e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:35:28.427568 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-04d3a93f-097e-4c66-9e6c-41c644fdea9c tempest-VolumeQuotasNegativeTestJSON-369132402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47c4e335-4ee6-4df8-90d4-5496eb263a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:28.433788 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-04d3a93f-097e-4c66-9e6c-41c644fdea9c tempest-VolumeQuotasNegativeTestJSON-369132402 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:35:28.446048 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-04d3a93f-097e-4c66-9e6c-41c644fdea9c tempest-VolumeQuotasNegativeTestJSON-369132402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47c4e335-4ee6-4df8-90d4-5496eb263a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:35:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-594105056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ed405d3f-eacd-4594-8c55-e7f6ee3680cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bc56591137b41fb994355d22d888d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:35:27Z,use_quota=True,user_id='20d2b0754f0a480f87c5fd59ffb453a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:28.448632 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-04d3a93f-097e-4c66-9e6c-41c644fdea9c tempest-VolumeQuotasNegativeTestJSON-369132402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dbcdde7-4011-44b3-8399-ab4bff11b789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:28.450930 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-04d3a93f-097e-4c66-9e6c-41c644fdea9c tempest-VolumeQuotasNegativeTestJSON-369132402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dbcdde7-4011-44b3-8399-ab4bff11b789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:28.453314 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-04d3a93f-097e-4c66-9e6c-41c644fdea9c tempest-VolumeQuotasNegativeTestJSON-369132402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe6dbbb6-d4ac-4fe9-a27f-8e2663fa9f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:28.455522 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-04d3a93f-097e-4c66-9e6c-41c644fdea9c tempest-VolumeQuotasNegativeTestJSON-369132402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe6dbbb6-d4ac-4fe9-a27f-8e2663fa9f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed405d3f-eacd-4594-8c55-e7f6ee3680cb', 'volume_name': 'volume-ed405d3f-eacd-4594-8c55-e7f6ee3680cb', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:28.458400 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-04d3a93f-097e-4c66-9e6c-41c644fdea9c tempest-VolumeQuotasNegativeTestJSON-369132402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dd610c2-8953-4c95-bb46-e1e29c214119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:28.460505 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-04d3a93f-097e-4c66-9e6c-41c644fdea9c tempest-VolumeQuotasNegativeTestJSON-369132402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dd610c2-8953-4c95-bb46-e1e29c214119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:28.462713 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-04d3a93f-097e-4c66-9e6c-41c644fdea9c tempest-VolumeQuotasNegativeTestJSON-369132402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43767bc8-1217-48ec-9411-07320a1b6343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:28.463509 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-04d3a93f-097e-4c66-9e6c-41c644fdea9c tempest-VolumeQuotasNegativeTestJSON-369132402 None] Volume ed405d3f-eacd-4594-8c55-e7f6ee3680cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed405d3f-eacd-4594-8c55-e7f6ee3680cb', 'volume_size': 1} Dec 25 21:35:28.463902 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-04d3a93f-097e-4c66-9e6c-41c644fdea9c tempest-VolumeQuotasNegativeTestJSON-369132402 None] creating volume 'volume-ed405d3f-eacd-4594-8c55-e7f6ee3680cb' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:35:28.464897 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-04d3a93f-097e-4c66-9e6c-41c644fdea9c tempest-VolumeQuotasNegativeTestJSON-369132402 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:35:29.147926 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-4ee845d7-f7b4-4cd4-8432-466b7a61bd02 req-fc6c2466-9df1-4545-a929-9b0b59fac444 tempest-TestVolumeBootPattern-1499667379 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:35:29.867125 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-4ee845d7-f7b4-4cd4-8432-466b7a61bd02 req-fc6c2466-9df1-4545-a929-9b0b59fac444 tempest-TestVolumeBootPattern-1499667379 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.719s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:35:29.867875 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-4ee845d7-f7b4-4cd4-8432-466b7a61bd02 req-fc6c2466-9df1-4545-a929-9b0b59fac444 tempest-TestVolumeBootPattern-1499667379 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1f66629a-ecb8-47cb-8a87-8abb304c2f96', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': '1f66629a-ecb8-47cb-8a87-8abb304c2f96', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 21:35:30.031663 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-4ee845d7-f7b4-4cd4-8432-466b7a61bd02 req-fc6c2466-9df1-4545-a929-9b0b59fac444 tempest-TestVolumeBootPattern-1499667379 None] Connection info returned from driver {'name': 'volumes/volume-1f66629a-ecb8-47cb-8a87-8abb304c2f96', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1f66629a-ecb8-47cb-8a87-8abb304c2f96', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f8168f91-894e-47f0-9cb7-ed54a9fe5a12'} {{(pid=129926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 25 21:35:30.163059 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-4ee845d7-f7b4-4cd4-8432-466b7a61bd02 req-fc6c2466-9df1-4545-a929-9b0b59fac444 tempest-TestVolumeBootPattern-1499667379 None] attachment_update completed successfully. Dec 25 21:35:30.421854 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-04d3a93f-097e-4c66-9e6c-41c644fdea9c tempest-VolumeQuotasNegativeTestJSON-369132402 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:35:30.425781 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-04d3a93f-097e-4c66-9e6c-41c644fdea9c tempest-VolumeQuotasNegativeTestJSON-369132402 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:35:30.429543 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-04d3a93f-097e-4c66-9e6c-41c644fdea9c tempest-VolumeQuotasNegativeTestJSON-369132402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43767bc8-1217-48ec-9411-07320a1b6343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed405d3f-eacd-4594-8c55-e7f6ee3680cb', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:30.433010 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-04d3a93f-097e-4c66-9e6c-41c644fdea9c tempest-VolumeQuotasNegativeTestJSON-369132402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6596fb87-b0e0-4bb1-8af2-a84648dd4708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:30.577307 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-04d3a93f-097e-4c66-9e6c-41c644fdea9c tempest-VolumeQuotasNegativeTestJSON-369132402 None] Volume volume-ed405d3f-eacd-4594-8c55-e7f6ee3680cb (ed405d3f-eacd-4594-8c55-e7f6ee3680cb): created successfully Dec 25 21:35:30.577307 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-04d3a93f-097e-4c66-9e6c-41c644fdea9c tempest-VolumeQuotasNegativeTestJSON-369132402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6596fb87-b0e0-4bb1-8af2-a84648dd4708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:30.585538 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-04d3a93f-097e-4c66-9e6c-41c644fdea9c tempest-VolumeQuotasNegativeTestJSON-369132402 None] Flow 'volume_create_manager' (8e5aa3a8-d5e4-4d20-97d7-865fe0e373e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:35:30.689092 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-04d3a93f-097e-4c66-9e6c-41c644fdea9c tempest-VolumeQuotasNegativeTestJSON-369132402 None] Created volume successfully. Dec 25 21:35:32.058502 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:35:32.059492 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:35:32.096160 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:35:32.131159 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:35:32.325714 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-57b11d7b-ba9e-4e0f-ad2f-45e586bf1a7a tempest-VolumeQuotasNegativeTestJSON-369132402 None] Lock "b'cinder-ed405d3f-eacd-4594-8c55-e7f6ee3680cb-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:35:32.458092 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-57b11d7b-ba9e-4e0f-ad2f-45e586bf1a7a tempest-VolumeQuotasNegativeTestJSON-369132402 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:35:32.860490 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-57b11d7b-ba9e-4e0f-ad2f-45e586bf1a7a tempest-VolumeQuotasNegativeTestJSON-369132402 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:35:32.861184 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-57b11d7b-ba9e-4e0f-ad2f-45e586bf1a7a tempest-VolumeQuotasNegativeTestJSON-369132402 None] Volume volume-ed405d3f-eacd-4594-8c55-e7f6ee3680cb is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:35:33.084001 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-57b11d7b-ba9e-4e0f-ad2f-45e586bf1a7a tempest-VolumeQuotasNegativeTestJSON-369132402 None] deleting rbd volume volume-ed405d3f-eacd-4594-8c55-e7f6ee3680cb {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:35:33.906149 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-b5b2fe05-dcc7-4787-81b8-18b8848e2661 tempest-AttachVolumeShelveTestJSON-1279821748 None] Created reservations ['3ebf7bf5-47b3-4923-85ff-2ceb62c30cb7', '7ca2a425-72aa-48df-a3a9-8f97f03d45b2', '327dd236-0ba4-4f65-8ea3-e6f823a42ecc', 'faf4e390-9b4d-45bf-aa43-c9915061277d'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:35:34.204077 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b5b2fe05-dcc7-4787-81b8-18b8848e2661 tempest-AttachVolumeShelveTestJSON-1279821748 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:35:34.340991 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b5b2fe05-dcc7-4787-81b8-18b8848e2661 tempest-AttachVolumeShelveTestJSON-1279821748 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:35:34.364962 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-b5b2fe05-dcc7-4787-81b8-18b8848e2661 tempest-AttachVolumeShelveTestJSON-1279821748 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:35:34.368905 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-b5b2fe05-dcc7-4787-81b8-18b8848e2661 tempest-AttachVolumeShelveTestJSON-1279821748 None] Deleted volume successfully. Dec 25 21:35:34.465728 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-b5b2fe05-dcc7-4787-81b8-18b8848e2661 tempest-AttachVolumeShelveTestJSON-1279821748 None] Lock "b'cinder-06661aab-01cf-4a95-94d1-d80c006009d6-delete_volume'" released by "delete_volume" :: held 13.773s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:35:39.626567 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-0b098c3c-d907-4aaa-9b29-69528471b6ce tempest-VolumesGetTest-758022543 None] Created reservations ['ea06daae-142f-4fab-a3a7-4bd63ecab17b', 'cd88bbfe-1cd2-4434-86ba-d4dbe7327f3b', '85abe5fe-a9fc-4eb0-97eb-08943adea567', 'd6b44f36-36b9-44eb-a0b9-3e156b17a92c'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:35:40.007785 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0b098c3c-d907-4aaa-9b29-69528471b6ce tempest-VolumesGetTest-758022543 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:35:40.054781 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0b098c3c-d907-4aaa-9b29-69528471b6ce tempest-VolumesGetTest-758022543 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:35:40.277849 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-0b098c3c-d907-4aaa-9b29-69528471b6ce tempest-VolumesGetTest-758022543 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:35:40.283345 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-0b098c3c-d907-4aaa-9b29-69528471b6ce tempest-VolumesGetTest-758022543 None] Deleted volume successfully. Dec 25 21:35:40.368974 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-3e42bfe0-eef9-4c00-bf4c-affa434bba53 tempest-VolumesGetTest-758022543 None] Lock "b'cinder-51912ae8-b05e-4878-b55e-625706bf8cbc-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:35:40.412249 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-0b098c3c-d907-4aaa-9b29-69528471b6ce tempest-VolumesGetTest-758022543 None] Lock "b'cinder-c2fea802-e514-4623-a399-31ad8fd8571d-delete_volume'" released by "delete_volume" :: held 13.204s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:35:40.466098 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-3e42bfe0-eef9-4c00-bf4c-affa434bba53 tempest-VolumesGetTest-758022543 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:35:40.814987 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-3e42bfe0-eef9-4c00-bf4c-affa434bba53 tempest-VolumesGetTest-758022543 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:35:40.816270 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-3e42bfe0-eef9-4c00-bf4c-affa434bba53 tempest-VolumesGetTest-758022543 None] Volume volume-51912ae8-b05e-4878-b55e-625706bf8cbc is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:35:41.142988 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-3e42bfe0-eef9-4c00-bf4c-affa434bba53 tempest-VolumesGetTest-758022543 None] deleting rbd volume volume-51912ae8-b05e-4878-b55e-625706bf8cbc {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:35:42.804620 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [req-918c1d32-4729-4a2c-942c-a8bfb8f8cf4b req-b8fc35f0-89c6-4476-a49d-d80b643d7dcf tempest-VolumesSnapshotsTestJSON-606812821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:35:42.808435 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [req-918c1d32-4729-4a2c-942c-a8bfb8f8cf4b req-b8fc35f0-89c6-4476-a49d-d80b643d7dcf tempest-VolumesSnapshotsTestJSON-606812821 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:35:42.808942 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [req-918c1d32-4729-4a2c-942c-a8bfb8f8cf4b req-b8fc35f0-89c6-4476-a49d-d80b643d7dcf tempest-VolumesSnapshotsTestJSON-606812821 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:35:42.821891 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-918c1d32-4729-4a2c-942c-a8bfb8f8cf4b req-b8fc35f0-89c6-4476-a49d-d80b643d7dcf tempest-VolumesSnapshotsTestJSON-606812821 None] Flow 'volume_create_manager' (a69aa4fc-80e4-4066-8468-62922362fcfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:35:42.825906 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-918c1d32-4729-4a2c-942c-a8bfb8f8cf4b req-b8fc35f0-89c6-4476-a49d-d80b643d7dcf tempest-VolumesSnapshotsTestJSON-606812821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68cfb7db-8ed7-4793-9133-04320b25c906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:42.837772 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [req-918c1d32-4729-4a2c-942c-a8bfb8f8cf4b req-b8fc35f0-89c6-4476-a49d-d80b643d7dcf tempest-VolumesSnapshotsTestJSON-606812821 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:35:42.850385 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-918c1d32-4729-4a2c-942c-a8bfb8f8cf4b req-b8fc35f0-89c6-4476-a49d-d80b643d7dcf tempest-VolumesSnapshotsTestJSON-606812821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68cfb7db-8ed7-4793-9133-04320b25c906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-299267865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=95fba560-1770-4ea5-b1d4-7ba870d51fc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c530b50e6e7943e08432ece63ea91869',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:35:43Z,use_quota=True,user_id='a374b7bb43fb44df8b39ff0bee55d21e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:42.853603 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-918c1d32-4729-4a2c-942c-a8bfb8f8cf4b req-b8fc35f0-89c6-4476-a49d-d80b643d7dcf tempest-VolumesSnapshotsTestJSON-606812821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3559feb-e880-4d5c-9e5e-9ab54138386d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:42.857211 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-918c1d32-4729-4a2c-942c-a8bfb8f8cf4b req-b8fc35f0-89c6-4476-a49d-d80b643d7dcf tempest-VolumesSnapshotsTestJSON-606812821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3559feb-e880-4d5c-9e5e-9ab54138386d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:42.859889 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-918c1d32-4729-4a2c-942c-a8bfb8f8cf4b req-b8fc35f0-89c6-4476-a49d-d80b643d7dcf tempest-VolumesSnapshotsTestJSON-606812821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3939c109-43bc-4cee-800b-839c81870365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:42.862301 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-918c1d32-4729-4a2c-942c-a8bfb8f8cf4b req-b8fc35f0-89c6-4476-a49d-d80b643d7dcf tempest-VolumesSnapshotsTestJSON-606812821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3939c109-43bc-4cee-800b-839c81870365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95fba560-1770-4ea5-b1d4-7ba870d51fc5', 'volume_name': 'volume-95fba560-1770-4ea5-b1d4-7ba870d51fc5', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:42.865102 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-918c1d32-4729-4a2c-942c-a8bfb8f8cf4b req-b8fc35f0-89c6-4476-a49d-d80b643d7dcf tempest-VolumesSnapshotsTestJSON-606812821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63974903-4e22-4776-b7b3-4397b75f93b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:42.867370 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-918c1d32-4729-4a2c-942c-a8bfb8f8cf4b req-b8fc35f0-89c6-4476-a49d-d80b643d7dcf tempest-VolumesSnapshotsTestJSON-606812821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63974903-4e22-4776-b7b3-4397b75f93b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:42.869619 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-918c1d32-4729-4a2c-942c-a8bfb8f8cf4b req-b8fc35f0-89c6-4476-a49d-d80b643d7dcf tempest-VolumesSnapshotsTestJSON-606812821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30da70ab-8530-432e-80e0-54dfe34ad7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:42.870454 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [req-918c1d32-4729-4a2c-942c-a8bfb8f8cf4b req-b8fc35f0-89c6-4476-a49d-d80b643d7dcf tempest-VolumesSnapshotsTestJSON-606812821 None] Volume 95fba560-1770-4ea5-b1d4-7ba870d51fc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95fba560-1770-4ea5-b1d4-7ba870d51fc5', 'volume_size': 1} Dec 25 21:35:42.870907 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-918c1d32-4729-4a2c-942c-a8bfb8f8cf4b req-b8fc35f0-89c6-4476-a49d-d80b643d7dcf tempest-VolumesSnapshotsTestJSON-606812821 None] creating volume 'volume-95fba560-1770-4ea5-b1d4-7ba870d51fc5' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:35:42.871950 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-918c1d32-4729-4a2c-942c-a8bfb8f8cf4b req-b8fc35f0-89c6-4476-a49d-d80b643d7dcf tempest-VolumesSnapshotsTestJSON-606812821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:35:44.569595 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-57b11d7b-ba9e-4e0f-ad2f-45e586bf1a7a tempest-VolumeQuotasNegativeTestJSON-369132402 None] Created reservations ['9f08737a-d2f0-4db4-a53d-9dfa0c0fcd2e', 'f00241f7-8d8b-4c44-a4ae-8d41bd23eaf4', 'ff58f0df-b526-4b54-a427-378a79b97b95', 'c3f963e9-9b09-4f71-a2b4-0db9b50ed46b'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:35:44.627974 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-918c1d32-4729-4a2c-942c-a8bfb8f8cf4b req-b8fc35f0-89c6-4476-a49d-d80b643d7dcf tempest-VolumesSnapshotsTestJSON-606812821 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:35:44.628556 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-918c1d32-4729-4a2c-942c-a8bfb8f8cf4b req-b8fc35f0-89c6-4476-a49d-d80b643d7dcf tempest-VolumesSnapshotsTestJSON-606812821 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:35:44.631496 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-918c1d32-4729-4a2c-942c-a8bfb8f8cf4b req-b8fc35f0-89c6-4476-a49d-d80b643d7dcf tempest-VolumesSnapshotsTestJSON-606812821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30da70ab-8530-432e-80e0-54dfe34ad7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95fba560-1770-4ea5-b1d4-7ba870d51fc5', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:44.635331 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-918c1d32-4729-4a2c-942c-a8bfb8f8cf4b req-b8fc35f0-89c6-4476-a49d-d80b643d7dcf tempest-VolumesSnapshotsTestJSON-606812821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb28f4c2-1da7-4864-9390-8b2a6be64ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:44.751620 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [req-918c1d32-4729-4a2c-942c-a8bfb8f8cf4b req-b8fc35f0-89c6-4476-a49d-d80b643d7dcf tempest-VolumesSnapshotsTestJSON-606812821 None] Volume volume-95fba560-1770-4ea5-b1d4-7ba870d51fc5 (95fba560-1770-4ea5-b1d4-7ba870d51fc5): created successfully Dec 25 21:35:44.753725 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-918c1d32-4729-4a2c-942c-a8bfb8f8cf4b req-b8fc35f0-89c6-4476-a49d-d80b643d7dcf tempest-VolumesSnapshotsTestJSON-606812821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb28f4c2-1da7-4864-9390-8b2a6be64ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:44.757252 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-918c1d32-4729-4a2c-942c-a8bfb8f8cf4b req-b8fc35f0-89c6-4476-a49d-d80b643d7dcf tempest-VolumesSnapshotsTestJSON-606812821 None] Flow 'volume_create_manager' (a69aa4fc-80e4-4066-8468-62922362fcfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:35:44.804386 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-57b11d7b-ba9e-4e0f-ad2f-45e586bf1a7a tempest-VolumeQuotasNegativeTestJSON-369132402 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:35:44.835622 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-57b11d7b-ba9e-4e0f-ad2f-45e586bf1a7a tempest-VolumeQuotasNegativeTestJSON-369132402 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:35:44.865102 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-57b11d7b-ba9e-4e0f-ad2f-45e586bf1a7a tempest-VolumeQuotasNegativeTestJSON-369132402 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:35:44.871311 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-57b11d7b-ba9e-4e0f-ad2f-45e586bf1a7a tempest-VolumeQuotasNegativeTestJSON-369132402 None] Deleted volume successfully. Dec 25 21:35:44.875705 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-918c1d32-4729-4a2c-942c-a8bfb8f8cf4b req-b8fc35f0-89c6-4476-a49d-d80b643d7dcf tempest-VolumesSnapshotsTestJSON-606812821 None] Created volume successfully. Dec 25 21:35:44.982552 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-57b11d7b-ba9e-4e0f-ad2f-45e586bf1a7a tempest-VolumeQuotasNegativeTestJSON-369132402 None] Lock "b'cinder-ed405d3f-eacd-4594-8c55-e7f6ee3680cb-delete_volume'" released by "delete_volume" :: held 12.657s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:35:46.627010 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-f2481281-5cd6-4eb7-aa79-e2310af9b835 req-ddf84007-c085-4794-ab1b-3e3ca7d19e6d tempest-VolumesSnapshotsTestJSON-606812821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:35:49.104286 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebb43a44-e17d-46d6-a100-26aa2c8259a1 tempest-VolumeQuotasAdminTestJSON-1785740317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:35:49.107488 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-ebb43a44-e17d-46d6-a100-26aa2c8259a1 tempest-VolumeQuotasAdminTestJSON-1785740317 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:35:49.107942 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-ebb43a44-e17d-46d6-a100-26aa2c8259a1 tempest-VolumeQuotasAdminTestJSON-1785740317 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:35:49.119936 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ebb43a44-e17d-46d6-a100-26aa2c8259a1 tempest-VolumeQuotasAdminTestJSON-1785740317 None] Flow 'volume_create_manager' (4774789b-b3e1-49f0-8e37-c40adf7ffe4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:35:49.129340 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ebb43a44-e17d-46d6-a100-26aa2c8259a1 tempest-VolumeQuotasAdminTestJSON-1785740317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c99860ea-f464-4597-b8e8-260d43eb2f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:49.130301 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-ebb43a44-e17d-46d6-a100-26aa2c8259a1 tempest-VolumeQuotasAdminTestJSON-1785740317 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:35:49.143436 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ebb43a44-e17d-46d6-a100-26aa2c8259a1 tempest-VolumeQuotasAdminTestJSON-1785740317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c99860ea-f464-4597-b8e8-260d43eb2f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2103158615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d15c4096-ee85-42a6-b807-50aa21b7ea37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a489896e9e44cfab05ddcf2bec0b1f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:35:49Z,use_quota=True,user_id='35e0fca3dd5a40628cf232685f11edf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:49.146669 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ebb43a44-e17d-46d6-a100-26aa2c8259a1 tempest-VolumeQuotasAdminTestJSON-1785740317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77c25630-9025-4c99-bd21-9d399e93be89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:49.148785 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ebb43a44-e17d-46d6-a100-26aa2c8259a1 tempest-VolumeQuotasAdminTestJSON-1785740317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77c25630-9025-4c99-bd21-9d399e93be89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:49.151256 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ebb43a44-e17d-46d6-a100-26aa2c8259a1 tempest-VolumeQuotasAdminTestJSON-1785740317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cfd3aa7-2bc8-45a9-9eee-e9389ba3fc48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:49.158010 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ebb43a44-e17d-46d6-a100-26aa2c8259a1 tempest-VolumeQuotasAdminTestJSON-1785740317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cfd3aa7-2bc8-45a9-9eee-e9389ba3fc48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd15c4096-ee85-42a6-b807-50aa21b7ea37', 'volume_name': 'volume-d15c4096-ee85-42a6-b807-50aa21b7ea37', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:49.158010 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ebb43a44-e17d-46d6-a100-26aa2c8259a1 tempest-VolumeQuotasAdminTestJSON-1785740317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb8714ba-093a-45ef-8e9b-41b8fad5096d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:49.159223 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ebb43a44-e17d-46d6-a100-26aa2c8259a1 tempest-VolumeQuotasAdminTestJSON-1785740317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb8714ba-093a-45ef-8e9b-41b8fad5096d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:49.162072 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ebb43a44-e17d-46d6-a100-26aa2c8259a1 tempest-VolumeQuotasAdminTestJSON-1785740317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (946fcef2-5b60-430d-b992-19bb8a156ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:49.162935 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-ebb43a44-e17d-46d6-a100-26aa2c8259a1 tempest-VolumeQuotasAdminTestJSON-1785740317 None] Volume d15c4096-ee85-42a6-b807-50aa21b7ea37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d15c4096-ee85-42a6-b807-50aa21b7ea37', 'volume_size': 1} Dec 25 21:35:49.163324 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ebb43a44-e17d-46d6-a100-26aa2c8259a1 tempest-VolumeQuotasAdminTestJSON-1785740317 None] creating volume 'volume-d15c4096-ee85-42a6-b807-50aa21b7ea37' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:35:49.164291 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ebb43a44-e17d-46d6-a100-26aa2c8259a1 tempest-VolumeQuotasAdminTestJSON-1785740317 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:35:50.570614 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ebb43a44-e17d-46d6-a100-26aa2c8259a1 tempest-VolumeQuotasAdminTestJSON-1785740317 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:35:50.570614 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ebb43a44-e17d-46d6-a100-26aa2c8259a1 tempest-VolumeQuotasAdminTestJSON-1785740317 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:35:50.570614 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ebb43a44-e17d-46d6-a100-26aa2c8259a1 tempest-VolumeQuotasAdminTestJSON-1785740317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (946fcef2-5b60-430d-b992-19bb8a156ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d15c4096-ee85-42a6-b807-50aa21b7ea37', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:50.571733 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ebb43a44-e17d-46d6-a100-26aa2c8259a1 tempest-VolumeQuotasAdminTestJSON-1785740317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4c790da-e434-4225-8cfd-688fbedec3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:50.614635 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-ebb43a44-e17d-46d6-a100-26aa2c8259a1 tempest-VolumeQuotasAdminTestJSON-1785740317 None] Volume volume-d15c4096-ee85-42a6-b807-50aa21b7ea37 (d15c4096-ee85-42a6-b807-50aa21b7ea37): created successfully Dec 25 21:35:50.616970 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ebb43a44-e17d-46d6-a100-26aa2c8259a1 tempest-VolumeQuotasAdminTestJSON-1785740317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4c790da-e434-4225-8cfd-688fbedec3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:50.620341 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ebb43a44-e17d-46d6-a100-26aa2c8259a1 tempest-VolumeQuotasAdminTestJSON-1785740317 None] Flow 'volume_create_manager' (4774789b-b3e1-49f0-8e37-c40adf7ffe4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:35:50.671678 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-ebb43a44-e17d-46d6-a100-26aa2c8259a1 tempest-VolumeQuotasAdminTestJSON-1785740317 None] Created volume successfully. Dec 25 21:35:51.734616 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-3e42bfe0-eef9-4c00-bf4c-affa434bba53 tempest-VolumesGetTest-758022543 None] Created reservations ['31be52ef-599e-45ec-8487-084b5c5ab95e', '180716c7-9aa1-4b33-abbf-a29a33f55ad4', '1f8e4746-3ada-46df-8c43-2f870d3c7e76', 'bda9aa69-af25-4bcf-bbe3-61d3d18c3803'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:35:51.914829 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-96718a20-67d3-491b-b95e-d980dfe9b53c tempest-VolumeQuotasAdminTestJSON-1785740317 None] Lock "b'cinder-d15c4096-ee85-42a6-b807-50aa21b7ea37-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:35:51.925903 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-3e42bfe0-eef9-4c00-bf4c-affa434bba53 tempest-VolumesGetTest-758022543 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:35:51.970723 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-3e42bfe0-eef9-4c00-bf4c-affa434bba53 tempest-VolumesGetTest-758022543 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:35:51.994182 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-3e42bfe0-eef9-4c00-bf4c-affa434bba53 tempest-VolumesGetTest-758022543 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:35:52.003246 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-3e42bfe0-eef9-4c00-bf4c-affa434bba53 tempest-VolumesGetTest-758022543 None] Deleted volume successfully. Dec 25 21:35:52.147722 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-3e42bfe0-eef9-4c00-bf4c-affa434bba53 tempest-VolumesGetTest-758022543 None] Lock "b'cinder-51912ae8-b05e-4878-b55e-625706bf8cbc-delete_volume'" released by "delete_volume" :: held 11.779s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:35:52.170715 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-96718a20-67d3-491b-b95e-d980dfe9b53c tempest-VolumeQuotasAdminTestJSON-1785740317 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:35:52.678145 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-96718a20-67d3-491b-b95e-d980dfe9b53c tempest-VolumeQuotasAdminTestJSON-1785740317 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:35:52.680253 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-96718a20-67d3-491b-b95e-d980dfe9b53c tempest-VolumeQuotasAdminTestJSON-1785740317 None] Volume volume-d15c4096-ee85-42a6-b807-50aa21b7ea37 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:35:53.198696 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-96718a20-67d3-491b-b95e-d980dfe9b53c tempest-VolumeQuotasAdminTestJSON-1785740317 None] deleting rbd volume volume-d15c4096-ee85-42a6-b807-50aa21b7ea37 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:35:53.213567 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-f2481281-5cd6-4eb7-aa79-e2310af9b835 req-ddf84007-c085-4794-ab1b-3e3ca7d19e6d tempest-VolumesSnapshotsTestJSON-606812821 None] Create snapshot completed successfully Dec 25 21:35:53.228429 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [req-40db6867-75c9-426e-986f-936c90b39f08 req-18968471-c31b-40bf-a76c-fb9890451611 tempest-VolumesSnapshotsTestJSON-606812821 None] Lock "b'cinder-e781a766-01ea-4d7b-8ed5-4c8a2999e449-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.019s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:35:53.229960 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-40db6867-75c9-426e-986f-936c90b39f08 req-18968471-c31b-40bf-a76c-fb9890451611 tempest-VolumesSnapshotsTestJSON-606812821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:35:53.730826 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6b7e388-0c96-41bf-8094-ecd7d0e8d943 tempest-VolumesGetTest-758022543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:35:53.734957 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-a6b7e388-0c96-41bf-8094-ecd7d0e8d943 tempest-VolumesGetTest-758022543 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:35:53.735503 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-a6b7e388-0c96-41bf-8094-ecd7d0e8d943 tempest-VolumesGetTest-758022543 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:35:53.766667 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a6b7e388-0c96-41bf-8094-ecd7d0e8d943 tempest-VolumesGetTest-758022543 None] Flow 'volume_create_manager' (072fe2e9-f55c-427d-9f6b-3a70ed56b8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:35:53.769833 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a6b7e388-0c96-41bf-8094-ecd7d0e8d943 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (957e2f79-6e15-4f75-950e-39ffc597ace3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:53.777137 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-a6b7e388-0c96-41bf-8094-ecd7d0e8d943 tempest-VolumesGetTest-758022543 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:35:53.791072 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a6b7e388-0c96-41bf-8094-ecd7d0e8d943 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (957e2f79-6e15-4f75-950e-39ffc597ace3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1358181204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=80c90346-162a-4a22-98bc-367019c5448e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609b19a4efc34c8fa016adb3a5fdb23b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:35:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:35:53Z,use_quota=True,user_id='322d719e1dbd4014b58f2f7ed9641f2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:53.793768 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a6b7e388-0c96-41bf-8094-ecd7d0e8d943 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64015f74-a879-40c6-b740-5cda6823721d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:53.796237 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a6b7e388-0c96-41bf-8094-ecd7d0e8d943 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64015f74-a879-40c6-b740-5cda6823721d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:53.798843 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a6b7e388-0c96-41bf-8094-ecd7d0e8d943 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e0d2cce-01ff-4501-b4e6-80beabe7b193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:53.801104 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a6b7e388-0c96-41bf-8094-ecd7d0e8d943 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e0d2cce-01ff-4501-b4e6-80beabe7b193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80c90346-162a-4a22-98bc-367019c5448e', 'volume_name': 'volume-80c90346-162a-4a22-98bc-367019c5448e', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:53.803437 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a6b7e388-0c96-41bf-8094-ecd7d0e8d943 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4a7cbe6-0134-48a2-9225-b8b2c688afd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:53.805560 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a6b7e388-0c96-41bf-8094-ecd7d0e8d943 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4a7cbe6-0134-48a2-9225-b8b2c688afd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:53.807761 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a6b7e388-0c96-41bf-8094-ecd7d0e8d943 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86c8be7c-c144-4f58-a8c9-5a5761f4c6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:53.808593 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-a6b7e388-0c96-41bf-8094-ecd7d0e8d943 tempest-VolumesGetTest-758022543 None] Volume 80c90346-162a-4a22-98bc-367019c5448e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80c90346-162a-4a22-98bc-367019c5448e', 'volume_size': 1} Dec 25 21:35:53.809264 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a6b7e388-0c96-41bf-8094-ecd7d0e8d943 tempest-VolumesGetTest-758022543 None] creating volume 'volume-80c90346-162a-4a22-98bc-367019c5448e' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:35:53.810350 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a6b7e388-0c96-41bf-8094-ecd7d0e8d943 tempest-VolumesGetTest-758022543 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:35:55.570707 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6afb9d4-579b-4ec0-a611-e15943fb7279 tempest-VolumesImageMetadata-635732396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:35:55.573864 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-e6afb9d4-579b-4ec0-a611-e15943fb7279 tempest-VolumesImageMetadata-635732396 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:35:55.580722 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-e6afb9d4-579b-4ec0-a611-e15943fb7279 tempest-VolumesImageMetadata-635732396 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:35:55.586441 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e6afb9d4-579b-4ec0-a611-e15943fb7279 tempest-VolumesImageMetadata-635732396 None] Flow 'volume_create_manager' (947bb3fc-f0d6-47a8-a786-864a9cd1b725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:35:55.589628 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e6afb9d4-579b-4ec0-a611-e15943fb7279 tempest-VolumesImageMetadata-635732396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (044ba993-5d77-437f-beb7-290fa7dbbd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:55.603360 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a6b7e388-0c96-41bf-8094-ecd7d0e8d943 tempest-VolumesGetTest-758022543 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:35:55.603735 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a6b7e388-0c96-41bf-8094-ecd7d0e8d943 tempest-VolumesGetTest-758022543 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:35:55.605833 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a6b7e388-0c96-41bf-8094-ecd7d0e8d943 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86c8be7c-c144-4f58-a8c9-5a5761f4c6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80c90346-162a-4a22-98bc-367019c5448e', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:55.608339 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a6b7e388-0c96-41bf-8094-ecd7d0e8d943 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f49015e6-9908-45c4-964f-6f0117bafa35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:55.611932 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-e6afb9d4-579b-4ec0-a611-e15943fb7279 tempest-VolumesImageMetadata-635732396 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:35:55.626661 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e6afb9d4-579b-4ec0-a611-e15943fb7279 tempest-VolumesImageMetadata-635732396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (044ba993-5d77-437f-beb7-290fa7dbbd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-101933007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7d3b74f1-6aef-407b-9ffc-4e47e86880d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b128fa80d8f41ce94e104a231c3069f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:35:55Z,use_quota=True,user_id='ab1d8e3c05a64747b9a159c46820702b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:55.629234 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e6afb9d4-579b-4ec0-a611-e15943fb7279 tempest-VolumesImageMetadata-635732396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c08844a3-c08f-486a-9b2c-3181913c5c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:55.631570 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e6afb9d4-579b-4ec0-a611-e15943fb7279 tempest-VolumesImageMetadata-635732396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c08844a3-c08f-486a-9b2c-3181913c5c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:55.633993 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e6afb9d4-579b-4ec0-a611-e15943fb7279 tempest-VolumesImageMetadata-635732396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e691ee0-3834-444c-983e-6e76acc9aba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:55.714069 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e6afb9d4-579b-4ec0-a611-e15943fb7279 tempest-VolumesImageMetadata-635732396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e691ee0-3834-444c-983e-6e76acc9aba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7d3b74f1-6aef-407b-9ffc-4e47e86880d0', 'volume_name': 'volume-7d3b74f1-6aef-407b-9ffc-4e47e86880d0', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:55.716449 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e6afb9d4-579b-4ec0-a611-e15943fb7279 tempest-VolumesImageMetadata-635732396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bf9c57d-38f0-47e7-a9ea-899405a26e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:55.718688 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e6afb9d4-579b-4ec0-a611-e15943fb7279 tempest-VolumesImageMetadata-635732396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bf9c57d-38f0-47e7-a9ea-899405a26e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:55.722556 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e6afb9d4-579b-4ec0-a611-e15943fb7279 tempest-VolumesImageMetadata-635732396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb41df24-8cd2-4bff-b556-811f3bb12ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:55.722556 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-e6afb9d4-579b-4ec0-a611-e15943fb7279 tempest-VolumesImageMetadata-635732396 None] Volume 7d3b74f1-6aef-407b-9ffc-4e47e86880d0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7d3b74f1-6aef-407b-9ffc-4e47e86880d0', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 25 21:35:55.722780 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6afb9d4-579b-4ec0-a611-e15943fb7279 tempest-VolumesImageMetadata-635732396 None] Cloning 7d3b74f1-6aef-407b-9ffc-4e47e86880d0 from image aca914d0-5f7b-465f-a024-75efa27d7291 at location (None, None). {{(pid=129926) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Dec 25 21:35:55.726203 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-a6b7e388-0c96-41bf-8094-ecd7d0e8d943 tempest-VolumesGetTest-758022543 None] Volume volume-80c90346-162a-4a22-98bc-367019c5448e (80c90346-162a-4a22-98bc-367019c5448e): created successfully Dec 25 21:35:55.728165 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a6b7e388-0c96-41bf-8094-ecd7d0e8d943 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f49015e6-9908-45c4-964f-6f0117bafa35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:55.731094 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a6b7e388-0c96-41bf-8094-ecd7d0e8d943 tempest-VolumesGetTest-758022543 None] Flow 'volume_create_manager' (072fe2e9-f55c-427d-9f6b-3a70ed56b8c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:35:55.741201 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-e6afb9d4-579b-4ec0-a611-e15943fb7279 tempest-VolumesImageMetadata-635732396 None] Lock "b'cinder-aca914d0-5f7b-465f-a024-75efa27d7291'" acquired by "_prepare_image_cache_entry" :: waited 0.018s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:35:55.838057 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-a6b7e388-0c96-41bf-8094-ecd7d0e8d943 tempest-VolumesGetTest-758022543 None] Created volume successfully. Dec 25 21:35:55.860689 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-e6afb9d4-579b-4ec0-a611-e15943fb7279 tempest-VolumesImageMetadata-635732396 None] Found image-volume cache entry: {'id': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'volume_id': '058f5fb3-51e4-40e3-9c98-542207f1fc1f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31), 'last_used': datetime.datetime(2021, 12, 25, 21, 35, 55, 745711)}. {{(pid=129926) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 25 21:35:55.861171 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-e6afb9d4-579b-4ec0-a611-e15943fb7279 tempest-VolumesImageMetadata-635732396 None] Image-volume cache entry image_update_at = 2021-12-25 20:58:31+00:00, requested image updated_at = 2021-12-25 20:58:31+00:00. {{(pid=129926) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 25 21:35:55.861584 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6afb9d4-579b-4ec0-a611-e15943fb7279 tempest-VolumesImageMetadata-635732396 None] Found cache entry for image = aca914d0-5f7b-465f-a024-75efa27d7291 on host ncdv-master-1@ceph#ceph. {{(pid=129926) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Dec 25 21:35:55.867275 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-e6afb9d4-579b-4ec0-a611-e15943fb7279 tempest-VolumesImageMetadata-635732396 None] Lock "b'cinder-aca914d0-5f7b-465f-a024-75efa27d7291'" released by "_prepare_image_cache_entry" :: held 0.127s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:35:55.868288 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6afb9d4-579b-4ec0-a611-e15943fb7279 tempest-VolumesImageMetadata-635732396 None] Attempting to retrieve cache entry for image = aca914d0-5f7b-465f-a024-75efa27d7291 on host ncdv-master-1@ceph#ceph. {{(pid=129926) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Dec 25 21:35:55.873889 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-e6afb9d4-579b-4ec0-a611-e15943fb7279 tempest-VolumesImageMetadata-635732396 None] Found image-volume cache entry: {'id': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'volume_id': '058f5fb3-51e4-40e3-9c98-542207f1fc1f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31), 'last_used': datetime.datetime(2021, 12, 25, 21, 35, 55, 871585)}. {{(pid=129926) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 25 21:35:55.874305 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-e6afb9d4-579b-4ec0-a611-e15943fb7279 tempest-VolumesImageMetadata-635732396 None] Image-volume cache entry image_update_at = 2021-12-25 20:58:31+00:00, requested image updated_at = 2021-12-25 20:58:31+00:00. {{(pid=129926) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 25 21:35:55.874757 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6afb9d4-579b-4ec0-a611-e15943fb7279 tempest-VolumesImageMetadata-635732396 None] Creating from source image-volume 058f5fb3-51e4-40e3-9c98-542207f1fc1f {{(pid=129926) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Dec 25 21:35:55.887217 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e6afb9d4-579b-4ec0-a611-e15943fb7279 tempest-VolumesImageMetadata-635732396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:35:56.672612 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e6afb9d4-579b-4ec0-a611-e15943fb7279 tempest-VolumesImageMetadata-635732396 None] creating snapshot='volume-7d3b74f1-6aef-407b-9ffc-4e47e86880d0.clone_snap' {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 25 21:35:59.484312 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e6afb9d4-579b-4ec0-a611-e15943fb7279 tempest-VolumesImageMetadata-635732396 None] cloning 'volume-058f5fb3-51e4-40e3-9c98-542207f1fc1f@volume-7d3b74f1-6aef-407b-9ffc-4e47e86880d0.clone_snap' to 'volume-7d3b74f1-6aef-407b-9ffc-4e47e86880d0' {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 25 21:35:59.589021 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-aadffcc9-d5d7-4e59-9d28-d9e6608892aa tempest-VolumesGetTest-758022543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:35:59.592900 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-aadffcc9-d5d7-4e59-9d28-d9e6608892aa tempest-VolumesGetTest-758022543 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:35:59.593347 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-aadffcc9-d5d7-4e59-9d28-d9e6608892aa tempest-VolumesGetTest-758022543 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:35:59.617541 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-aadffcc9-d5d7-4e59-9d28-d9e6608892aa tempest-VolumesGetTest-758022543 None] Flow 'volume_create_manager' (fb373aa4-dbb6-4c6b-89bc-1f80d4413b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:35:59.620748 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-aadffcc9-d5d7-4e59-9d28-d9e6608892aa tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d7819e9-ee8e-4680-9231-52d23546044a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:59.627107 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-aadffcc9-d5d7-4e59-9d28-d9e6608892aa tempest-VolumesGetTest-758022543 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:35:59.640109 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-aadffcc9-d5d7-4e59-9d28-d9e6608892aa tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d7819e9-ee8e-4680-9231-52d23546044a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-985316028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b9eedcb8-78bb-4435-af45-cf2c39c9cbdc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='609b19a4efc34c8fa016adb3a5fdb23b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=80c90346-162a-4a22-98bc-367019c5448e,status='creating',terminated_at=None,updated_at=2021-12-25T21:35:57Z,use_quota=True,user_id='322d719e1dbd4014b58f2f7ed9641f2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:59.642968 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-aadffcc9-d5d7-4e59-9d28-d9e6608892aa tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (665136af-bfe4-42f4-bef6-76ef8761cb6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:59.646793 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-aadffcc9-d5d7-4e59-9d28-d9e6608892aa tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (665136af-bfe4-42f4-bef6-76ef8761cb6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:59.647348 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-aadffcc9-d5d7-4e59-9d28-d9e6608892aa tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1019583f-eb88-4318-b17f-6612dc9d39fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:59.661535 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-aadffcc9-d5d7-4e59-9d28-d9e6608892aa tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1019583f-eb88-4318-b17f-6612dc9d39fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b9eedcb8-78bb-4435-af45-cf2c39c9cbdc', 'volume_name': 'volume-b9eedcb8-78bb-4435-af45-cf2c39c9cbdc', 'volume_size': 1, 'source_volid': '80c90346-162a-4a22-98bc-367019c5448e', 'source_volstatus': 'available'}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:59.664572 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-aadffcc9-d5d7-4e59-9d28-d9e6608892aa tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15bbdf82-45ea-427f-b537-13862363f103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:59.666739 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-aadffcc9-d5d7-4e59-9d28-d9e6608892aa tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15bbdf82-45ea-427f-b537-13862363f103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:35:59.668949 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-aadffcc9-d5d7-4e59-9d28-d9e6608892aa tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (441a3f40-eedb-439f-803d-1e9decb7412f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:35:59.669746 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-aadffcc9-d5d7-4e59-9d28-d9e6608892aa tempest-VolumesGetTest-758022543 None] Volume b9eedcb8-78bb-4435-af45-cf2c39c9cbdc: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b9eedcb8-78bb-4435-af45-cf2c39c9cbdc', 'volume_size': 1, 'source_volid': '80c90346-162a-4a22-98bc-367019c5448e', 'source_volstatus': 'available'} Dec 25 21:35:59.682582 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-aadffcc9-d5d7-4e59-9d28-d9e6608892aa tempest-VolumesGetTest-758022543 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:36:02.180975 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-aadffcc9-d5d7-4e59-9d28-d9e6608892aa tempest-VolumesGetTest-758022543 None] creating snapshot='volume-b9eedcb8-78bb-4435-af45-cf2c39c9cbdc.clone_snap' {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 25 21:36:05.021461 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-aadffcc9-d5d7-4e59-9d28-d9e6608892aa tempest-VolumesGetTest-758022543 None] cloning 'volume-80c90346-162a-4a22-98bc-367019c5448e@volume-b9eedcb8-78bb-4435-af45-cf2c39c9cbdc.clone_snap' to 'volume-b9eedcb8-78bb-4435-af45-cf2c39c9cbdc' {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 25 21:36:05.589134 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e6afb9d4-579b-4ec0-a611-e15943fb7279 tempest-VolumesImageMetadata-635732396 None] Volume volume-98b6d31e-e760-499e-8962-7b22479c1e9a.deleted is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:36:05.591368 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e6afb9d4-579b-4ec0-a611-e15943fb7279 tempest-VolumesImageMetadata-635732396 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:36:05.591846 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e6afb9d4-579b-4ec0-a611-e15943fb7279 tempest-VolumesImageMetadata-635732396 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:36:06.671768 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e6afb9d4-579b-4ec0-a611-e15943fb7279 tempest-VolumesImageMetadata-635732396 None] clone created successfully {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 25 21:36:06.672466 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.volume_utils [None req-e6afb9d4-579b-4ec0-a611-e15943fb7279 tempest-VolumesImageMetadata-635732396 None] Marking volume 7d3b74f1-6aef-407b-9ffc-4e47e86880d0 as bootable. {{(pid=129926) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 25 21:36:06.810477 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-96718a20-67d3-491b-b95e-d980dfe9b53c tempest-VolumeQuotasAdminTestJSON-1785740317 None] Created reservations ['11465de9-4a09-43fa-abbc-c6ffd44d7769', '97121713-06b7-41ec-81af-f3c485973248', '306734a4-e161-4f48-90c5-26e9906a0886', 'c1439c8c-0618-46f3-b5f4-929f9075652c'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:36:06.813453 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6afb9d4-579b-4ec0-a611-e15943fb7279 tempest-VolumesImageMetadata-635732396 None] Copying metadata from image aca914d0-5f7b-465f-a024-75efa27d7291 to 7d3b74f1-6aef-407b-9ffc-4e47e86880d0. {{(pid=129926) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Dec 25 21:36:06.813909 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6afb9d4-579b-4ec0-a611-e15943fb7279 tempest-VolumesImageMetadata-635732396 None] Creating volume glance metadata for volume 7d3b74f1-6aef-407b-9ffc-4e47e86880d0 backed by image aca914d0-5f7b-465f-a024-75efa27d7291 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129926) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Dec 25 21:36:06.850792 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [req-40db6867-75c9-426e-986f-936c90b39f08 req-18968471-c31b-40bf-a76c-fb9890451611 tempest-VolumesSnapshotsTestJSON-606812821 None] Created reservations ['ebf3410a-acc0-442f-b983-acc164830244', '601b4d61-7da5-4dc9-8a53-8ae26ae28f6c', '1bfdbbb1-108d-417a-a4c9-749124bc821c', '517a1488-3202-4f99-b5df-2e171dd4a989'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:36:06.980602 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e6afb9d4-579b-4ec0-a611-e15943fb7279 tempest-VolumesImageMetadata-635732396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb41df24-8cd2-4bff-b556-811f3bb12ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d3b74f1-6aef-407b-9ffc-4e47e86880d0', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:06.983137 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e6afb9d4-579b-4ec0-a611-e15943fb7279 tempest-VolumesImageMetadata-635732396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (768a9565-335e-4796-9879-031ea309093e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:07.044221 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-e6afb9d4-579b-4ec0-a611-e15943fb7279 tempest-VolumesImageMetadata-635732396 None] Volume volume-7d3b74f1-6aef-407b-9ffc-4e47e86880d0 (7d3b74f1-6aef-407b-9ffc-4e47e86880d0): created successfully Dec 25 21:36:07.046728 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e6afb9d4-579b-4ec0-a611-e15943fb7279 tempest-VolumesImageMetadata-635732396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (768a9565-335e-4796-9879-031ea309093e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:07.049959 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e6afb9d4-579b-4ec0-a611-e15943fb7279 tempest-VolumesImageMetadata-635732396 None] Flow 'volume_create_manager' (947bb3fc-f0d6-47a8-a786-864a9cd1b725) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:36:07.058362 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-96718a20-67d3-491b-b95e-d980dfe9b53c tempest-VolumeQuotasAdminTestJSON-1785740317 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:36:07.086618 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-96718a20-67d3-491b-b95e-d980dfe9b53c tempest-VolumeQuotasAdminTestJSON-1785740317 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:36:07.110353 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-96718a20-67d3-491b-b95e-d980dfe9b53c tempest-VolumeQuotasAdminTestJSON-1785740317 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:36:07.120707 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-96718a20-67d3-491b-b95e-d980dfe9b53c tempest-VolumeQuotasAdminTestJSON-1785740317 None] Deleted volume successfully. Dec 25 21:36:07.186528 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-e6afb9d4-579b-4ec0-a611-e15943fb7279 tempest-VolumesImageMetadata-635732396 None] Created volume successfully. Dec 25 21:36:07.208703 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-40db6867-75c9-426e-986f-936c90b39f08 req-18968471-c31b-40bf-a76c-fb9890451611 tempest-VolumesSnapshotsTestJSON-606812821 None] Delete snapshot completed successfully. Dec 25 21:36:07.212105 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-96718a20-67d3-491b-b95e-d980dfe9b53c tempest-VolumeQuotasAdminTestJSON-1785740317 None] Lock "b'cinder-d15c4096-ee85-42a6-b807-50aa21b7ea37-delete_volume'" released by "delete_volume" :: held 15.297s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:36:07.213914 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [req-40db6867-75c9-426e-986f-936c90b39f08 req-18968471-c31b-40bf-a76c-fb9890451611 tempest-VolumesSnapshotsTestJSON-606812821 None] Lock "b'cinder-e781a766-01ea-4d7b-8ed5-4c8a2999e449-delete_snapshot'" released by "delete_snapshot" :: held 13.986s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:36:08.002207 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [req-723d6a63-5d62-45be-b88d-c106da8eec13 req-c26c65c3-12d0-47ef-be11-8dbb8d2a5833 tempest-VolumesSnapshotsTestJSON-606812821 None] Lock "b'cinder-95fba560-1770-4ea5-b1d4-7ba870d51fc5-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:36:08.127804 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-723d6a63-5d62-45be-b88d-c106da8eec13 req-c26c65c3-12d0-47ef-be11-8dbb8d2a5833 tempest-VolumesSnapshotsTestJSON-606812821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:36:08.775770 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-723d6a63-5d62-45be-b88d-c106da8eec13 req-c26c65c3-12d0-47ef-be11-8dbb8d2a5833 tempest-VolumesSnapshotsTestJSON-606812821 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:36:08.778668 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-723d6a63-5d62-45be-b88d-c106da8eec13 req-c26c65c3-12d0-47ef-be11-8dbb8d2a5833 tempest-VolumesSnapshotsTestJSON-606812821 None] Volume volume-95fba560-1770-4ea5-b1d4-7ba870d51fc5 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:36:09.073632 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-723d6a63-5d62-45be-b88d-c106da8eec13 req-c26c65c3-12d0-47ef-be11-8dbb8d2a5833 tempest-VolumesSnapshotsTestJSON-606812821 None] deleting rbd volume volume-95fba560-1770-4ea5-b1d4-7ba870d51fc5 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:36:09.100224 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-886fd7f8-689f-48b6-937c-8c271341f67d tempest-VolumesImageMetadata-635732396 None] Lock "b'cinder-7d3b74f1-6aef-407b-9ffc-4e47e86880d0-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:36:09.148429 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-62ab2add-bdff-4167-aa92-a16a5ebea9da tempest-VolumeQuotasAdminTestJSON-1785740317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:36:09.152049 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-62ab2add-bdff-4167-aa92-a16a5ebea9da tempest-VolumeQuotasAdminTestJSON-1785740317 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:36:09.152678 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-62ab2add-bdff-4167-aa92-a16a5ebea9da tempest-VolumeQuotasAdminTestJSON-1785740317 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:36:09.170744 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-62ab2add-bdff-4167-aa92-a16a5ebea9da tempest-VolumeQuotasAdminTestJSON-1785740317 None] Flow 'volume_create_manager' (568322ae-6237-4c0b-b571-fb2258ab0ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:36:09.174619 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-62ab2add-bdff-4167-aa92-a16a5ebea9da tempest-VolumeQuotasAdminTestJSON-1785740317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6cea906-c826-4d72-9a82-e7d4a50be097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:09.186173 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-62ab2add-bdff-4167-aa92-a16a5ebea9da tempest-VolumeQuotasAdminTestJSON-1785740317 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:36:09.211157 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-62ab2add-bdff-4167-aa92-a16a5ebea9da tempest-VolumeQuotasAdminTestJSON-1785740317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6cea906-c826-4d72-9a82-e7d4a50be097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-114563593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e9917ddf-612b-4351-a781-48cf769722b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a489896e9e44cfab05ddcf2bec0b1f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:36:08Z,use_quota=True,user_id='35e0fca3dd5a40628cf232685f11edf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:09.214771 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-62ab2add-bdff-4167-aa92-a16a5ebea9da tempest-VolumeQuotasAdminTestJSON-1785740317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (439ca098-4bf1-4607-af3b-24ddb1748958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:09.217390 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-62ab2add-bdff-4167-aa92-a16a5ebea9da tempest-VolumeQuotasAdminTestJSON-1785740317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (439ca098-4bf1-4607-af3b-24ddb1748958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:09.220674 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-62ab2add-bdff-4167-aa92-a16a5ebea9da tempest-VolumeQuotasAdminTestJSON-1785740317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bb67ac3-c3e7-4d39-8510-9ab5dfaac35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:09.223676 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-62ab2add-bdff-4167-aa92-a16a5ebea9da tempest-VolumeQuotasAdminTestJSON-1785740317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bb67ac3-c3e7-4d39-8510-9ab5dfaac35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9917ddf-612b-4351-a781-48cf769722b1', 'volume_name': 'volume-e9917ddf-612b-4351-a781-48cf769722b1', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:09.226481 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-62ab2add-bdff-4167-aa92-a16a5ebea9da tempest-VolumeQuotasAdminTestJSON-1785740317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e3e1783-977e-4578-9f9b-974e7d493c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:09.229118 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-62ab2add-bdff-4167-aa92-a16a5ebea9da tempest-VolumeQuotasAdminTestJSON-1785740317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e3e1783-977e-4578-9f9b-974e7d493c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:09.232017 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-62ab2add-bdff-4167-aa92-a16a5ebea9da tempest-VolumeQuotasAdminTestJSON-1785740317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a87bbc2-e076-42c3-9790-063619a9ac69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:09.232966 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-62ab2add-bdff-4167-aa92-a16a5ebea9da tempest-VolumeQuotasAdminTestJSON-1785740317 None] Volume e9917ddf-612b-4351-a781-48cf769722b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9917ddf-612b-4351-a781-48cf769722b1', 'volume_size': 1} Dec 25 21:36:09.233474 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-62ab2add-bdff-4167-aa92-a16a5ebea9da tempest-VolumeQuotasAdminTestJSON-1785740317 None] creating volume 'volume-e9917ddf-612b-4351-a781-48cf769722b1' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:36:09.234576 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-62ab2add-bdff-4167-aa92-a16a5ebea9da tempest-VolumeQuotasAdminTestJSON-1785740317 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:36:09.362811 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-886fd7f8-689f-48b6-937c-8c271341f67d tempest-VolumesImageMetadata-635732396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:36:09.965209 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-886fd7f8-689f-48b6-937c-8c271341f67d tempest-VolumesImageMetadata-635732396 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:36:10.193665 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-886fd7f8-689f-48b6-937c-8c271341f67d tempest-VolumesImageMetadata-635732396 None] deleting rbd volume volume-7d3b74f1-6aef-407b-9ffc-4e47e86880d0 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:36:10.212008 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-aadffcc9-d5d7-4e59-9d28-d9e6608892aa tempest-VolumesGetTest-758022543 None] Volume volume-80c90346-162a-4a22-98bc-367019c5448e is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:36:10.214054 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-aadffcc9-d5d7-4e59-9d28-d9e6608892aa tempest-VolumesGetTest-758022543 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:36:10.214345 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-aadffcc9-d5d7-4e59-9d28-d9e6608892aa tempest-VolumesGetTest-758022543 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:36:11.498473 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-aadffcc9-d5d7-4e59-9d28-d9e6608892aa tempest-VolumesGetTest-758022543 None] clone created successfully {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 25 21:36:11.502960 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-aadffcc9-d5d7-4e59-9d28-d9e6608892aa tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (441a3f40-eedb-439f-803d-1e9decb7412f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9eedcb8-78bb-4435-af45-cf2c39c9cbdc', 'volume_size': 1, 'source_volid': '80c90346-162a-4a22-98bc-367019c5448e', 'source_volstatus': 'available'}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:11.503325 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-aadffcc9-d5d7-4e59-9d28-d9e6608892aa tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97c3750e-2aa1-42a1-a482-561b3a33d8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:11.512234 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-62ab2add-bdff-4167-aa92-a16a5ebea9da tempest-VolumeQuotasAdminTestJSON-1785740317 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:36:11.512711 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-62ab2add-bdff-4167-aa92-a16a5ebea9da tempest-VolumeQuotasAdminTestJSON-1785740317 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:36:11.514697 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-62ab2add-bdff-4167-aa92-a16a5ebea9da tempest-VolumeQuotasAdminTestJSON-1785740317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a87bbc2-e076-42c3-9790-063619a9ac69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9917ddf-612b-4351-a781-48cf769722b1', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:11.516828 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-62ab2add-bdff-4167-aa92-a16a5ebea9da tempest-VolumeQuotasAdminTestJSON-1785740317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aba37cf9-d6aa-41f8-9711-fe1a04ab0ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:11.581048 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-aadffcc9-d5d7-4e59-9d28-d9e6608892aa tempest-VolumesGetTest-758022543 None] Volume volume-b9eedcb8-78bb-4435-af45-cf2c39c9cbdc (b9eedcb8-78bb-4435-af45-cf2c39c9cbdc): created successfully Dec 25 21:36:11.583149 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-aadffcc9-d5d7-4e59-9d28-d9e6608892aa tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97c3750e-2aa1-42a1-a482-561b3a33d8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:11.586273 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-aadffcc9-d5d7-4e59-9d28-d9e6608892aa tempest-VolumesGetTest-758022543 None] Flow 'volume_create_manager' (fb373aa4-dbb6-4c6b-89bc-1f80d4413b90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:36:11.589192 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-62ab2add-bdff-4167-aa92-a16a5ebea9da tempest-VolumeQuotasAdminTestJSON-1785740317 None] Volume volume-e9917ddf-612b-4351-a781-48cf769722b1 (e9917ddf-612b-4351-a781-48cf769722b1): created successfully Dec 25 21:36:11.591637 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-62ab2add-bdff-4167-aa92-a16a5ebea9da tempest-VolumeQuotasAdminTestJSON-1785740317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aba37cf9-d6aa-41f8-9711-fe1a04ab0ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:11.594570 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-62ab2add-bdff-4167-aa92-a16a5ebea9da tempest-VolumeQuotasAdminTestJSON-1785740317 None] Flow 'volume_create_manager' (568322ae-6237-4c0b-b571-fb2258ab0ef8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:36:11.654561 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-62ab2add-bdff-4167-aa92-a16a5ebea9da tempest-VolumeQuotasAdminTestJSON-1785740317 None] Created volume successfully. Dec 25 21:36:11.671549 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-aadffcc9-d5d7-4e59-9d28-d9e6608892aa tempest-VolumesGetTest-758022543 None] Created volume successfully. Dec 25 21:36:13.308384 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-34cb7ce1-e7f2-42a2-aa7f-b3f75b80a0c5 tempest-VolumesGetTest-758022543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:36:13.311849 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-34cb7ce1-e7f2-42a2-aa7f-b3f75b80a0c5 tempest-VolumesGetTest-758022543 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:36:13.312294 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-34cb7ce1-e7f2-42a2-aa7f-b3f75b80a0c5 tempest-VolumesGetTest-758022543 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:36:13.326315 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-34cb7ce1-e7f2-42a2-aa7f-b3f75b80a0c5 tempest-VolumesGetTest-758022543 None] Flow 'volume_create_manager' (86f40ad3-1843-4213-ab06-bb349d91217d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:36:13.329514 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-34cb7ce1-e7f2-42a2-aa7f-b3f75b80a0c5 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34d1bd2f-fffe-440a-9aac-67b955eaae19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:13.335493 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-34cb7ce1-e7f2-42a2-aa7f-b3f75b80a0c5 tempest-VolumesGetTest-758022543 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:36:13.350833 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-34cb7ce1-e7f2-42a2-aa7f-b3f75b80a0c5 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34d1bd2f-fffe-440a-9aac-67b955eaae19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:36:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-385492000',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4d659bcc-1afa-4273-94f3-ec51056b765e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609b19a4efc34c8fa016adb3a5fdb23b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:36:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:36:13Z,use_quota=True,user_id='322d719e1dbd4014b58f2f7ed9641f2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:13.353405 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-34cb7ce1-e7f2-42a2-aa7f-b3f75b80a0c5 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e0d287f-9acc-4193-bd7a-2218db4dafc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:13.355591 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-34cb7ce1-e7f2-42a2-aa7f-b3f75b80a0c5 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e0d287f-9acc-4193-bd7a-2218db4dafc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:13.357924 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-34cb7ce1-e7f2-42a2-aa7f-b3f75b80a0c5 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d112301-e00a-4438-98b1-21aa915ce6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:13.360144 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-34cb7ce1-e7f2-42a2-aa7f-b3f75b80a0c5 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d112301-e00a-4438-98b1-21aa915ce6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d659bcc-1afa-4273-94f3-ec51056b765e', 'volume_name': 'volume-4d659bcc-1afa-4273-94f3-ec51056b765e', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:13.362457 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-34cb7ce1-e7f2-42a2-aa7f-b3f75b80a0c5 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7efef218-3f11-4f6b-a16e-9745e0fdc7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:13.364545 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-34cb7ce1-e7f2-42a2-aa7f-b3f75b80a0c5 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7efef218-3f11-4f6b-a16e-9745e0fdc7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:13.366764 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-34cb7ce1-e7f2-42a2-aa7f-b3f75b80a0c5 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1666d9a-1092-48f0-97d8-c912d0371410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:13.367556 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-34cb7ce1-e7f2-42a2-aa7f-b3f75b80a0c5 tempest-VolumesGetTest-758022543 None] Volume 4d659bcc-1afa-4273-94f3-ec51056b765e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d659bcc-1afa-4273-94f3-ec51056b765e', 'volume_size': 1} Dec 25 21:36:13.367961 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-34cb7ce1-e7f2-42a2-aa7f-b3f75b80a0c5 tempest-VolumesGetTest-758022543 None] creating volume 'volume-4d659bcc-1afa-4273-94f3-ec51056b765e' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:36:13.368954 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-34cb7ce1-e7f2-42a2-aa7f-b3f75b80a0c5 tempest-VolumesGetTest-758022543 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:36:13.791291 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-bbaaf859-7092-45a8-9499-70964328b6e8 tempest-VolumeQuotasAdminTestJSON-2005932339 None] Transfer volume completed successfully. Dec 25 21:36:14.699363 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-6616dd21-6bad-4d92-8015-6a6cb785fc65 tempest-VolumeQuotasAdminTestJSON-1912249918 None] Lock "b'cinder-e9917ddf-612b-4351-a781-48cf769722b1-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:36:14.797620 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-6616dd21-6bad-4d92-8015-6a6cb785fc65 tempest-VolumeQuotasAdminTestJSON-1912249918 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:36:15.129973 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-6616dd21-6bad-4d92-8015-6a6cb785fc65 tempest-VolumeQuotasAdminTestJSON-1912249918 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:36:15.135945 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-6616dd21-6bad-4d92-8015-6a6cb785fc65 tempest-VolumeQuotasAdminTestJSON-1912249918 None] Volume volume-e9917ddf-612b-4351-a781-48cf769722b1 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:36:15.432432 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-6616dd21-6bad-4d92-8015-6a6cb785fc65 tempest-VolumeQuotasAdminTestJSON-1912249918 None] deleting rbd volume volume-e9917ddf-612b-4351-a781-48cf769722b1 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:36:15.439265 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-34cb7ce1-e7f2-42a2-aa7f-b3f75b80a0c5 tempest-VolumesGetTest-758022543 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:36:15.439638 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-34cb7ce1-e7f2-42a2-aa7f-b3f75b80a0c5 tempest-VolumesGetTest-758022543 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:36:15.441757 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-34cb7ce1-e7f2-42a2-aa7f-b3f75b80a0c5 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1666d9a-1092-48f0-97d8-c912d0371410) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d659bcc-1afa-4273-94f3-ec51056b765e', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:15.445116 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-34cb7ce1-e7f2-42a2-aa7f-b3f75b80a0c5 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7628ce7-cbeb-47e5-a179-893603a9564f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:15.540226 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-34cb7ce1-e7f2-42a2-aa7f-b3f75b80a0c5 tempest-VolumesGetTest-758022543 None] Volume volume-4d659bcc-1afa-4273-94f3-ec51056b765e (4d659bcc-1afa-4273-94f3-ec51056b765e): created successfully Dec 25 21:36:15.542255 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-34cb7ce1-e7f2-42a2-aa7f-b3f75b80a0c5 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7628ce7-cbeb-47e5-a179-893603a9564f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:15.545235 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-34cb7ce1-e7f2-42a2-aa7f-b3f75b80a0c5 tempest-VolumesGetTest-758022543 None] Flow 'volume_create_manager' (86f40ad3-1843-4213-ab06-bb349d91217d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:36:15.620649 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-34cb7ce1-e7f2-42a2-aa7f-b3f75b80a0c5 tempest-VolumesGetTest-758022543 None] Created volume successfully. Dec 25 21:36:16.662692 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-910aff38-1509-40b5-a2d8-075a90ab2ff3 tempest-VolumesGetTest-758022543 None] Lock "b'cinder-4d659bcc-1afa-4273-94f3-ec51056b765e-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:36:16.789203 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-910aff38-1509-40b5-a2d8-075a90ab2ff3 tempest-VolumesGetTest-758022543 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:36:16.998288 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-910aff38-1509-40b5-a2d8-075a90ab2ff3 tempest-VolumesGetTest-758022543 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:36:16.998975 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-910aff38-1509-40b5-a2d8-075a90ab2ff3 tempest-VolumesGetTest-758022543 None] Volume volume-4d659bcc-1afa-4273-94f3-ec51056b765e is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:36:17.267441 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-910aff38-1509-40b5-a2d8-075a90ab2ff3 tempest-VolumesGetTest-758022543 None] deleting rbd volume volume-4d659bcc-1afa-4273-94f3-ec51056b765e {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:36:19.272498 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [req-723d6a63-5d62-45be-b88d-c106da8eec13 req-c26c65c3-12d0-47ef-be11-8dbb8d2a5833 tempest-VolumesSnapshotsTestJSON-606812821 None] Created reservations ['ade154df-e93f-4f50-90a9-ea633f608a60', 'da78e37d-6b8d-40e3-8bf0-4104f8991cb8', '12ec0caa-eddc-48d5-b9c5-e7d24bf74310', '9845cfd0-32a2-4138-96d9-5d27c0ca56ae'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:36:19.455878 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-723d6a63-5d62-45be-b88d-c106da8eec13 req-c26c65c3-12d0-47ef-be11-8dbb8d2a5833 tempest-VolumesSnapshotsTestJSON-606812821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:36:19.477746 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-723d6a63-5d62-45be-b88d-c106da8eec13 req-c26c65c3-12d0-47ef-be11-8dbb8d2a5833 tempest-VolumesSnapshotsTestJSON-606812821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:36:19.499957 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [req-723d6a63-5d62-45be-b88d-c106da8eec13 req-c26c65c3-12d0-47ef-be11-8dbb8d2a5833 tempest-VolumesSnapshotsTestJSON-606812821 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:36:19.503840 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-723d6a63-5d62-45be-b88d-c106da8eec13 req-c26c65c3-12d0-47ef-be11-8dbb8d2a5833 tempest-VolumesSnapshotsTestJSON-606812821 None] Deleted volume successfully. Dec 25 21:36:19.556513 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [req-723d6a63-5d62-45be-b88d-c106da8eec13 req-c26c65c3-12d0-47ef-be11-8dbb8d2a5833 tempest-VolumesSnapshotsTestJSON-606812821 None] Lock "b'cinder-95fba560-1770-4ea5-b1d4-7ba870d51fc5-delete_volume'" released by "delete_volume" :: held 11.554s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:36:19.771231 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-886fd7f8-689f-48b6-937c-8c271341f67d tempest-VolumesImageMetadata-635732396 None] volume is a clone so cleaning references {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 25 21:36:20.222052 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-886fd7f8-689f-48b6-937c-8c271341f67d tempest-VolumesImageMetadata-635732396 None] deleting parent snapshot volume-7d3b74f1-6aef-407b-9ffc-4e47e86880d0.clone_snap {{(pid=129926) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 25 21:36:24.489577 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-1125206f-c370-4113-9b5e-cc680b2bd33a tempest-VolumesSnapshotTestJSON-639273304 None] Terminate volume connection completed successfully. Dec 25 21:36:24.515160 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-1125206f-c370-4113-9b5e-cc680b2bd33a tempest-VolumesSnapshotTestJSON-639273304 None] Remove volume export completed successfully. Dec 25 21:36:24.552068 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-1125206f-c370-4113-9b5e-cc680b2bd33a tempest-VolumesSnapshotTestJSON-639273304 None] Lock "b'cinder-69fd46b7-dacb-409d-88c5-27d9657b39f5-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:36:24.566921 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-1125206f-c370-4113-9b5e-cc680b2bd33a tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:36:24.753155 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-1125206f-c370-4113-9b5e-cc680b2bd33a tempest-VolumesSnapshotTestJSON-639273304 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:36:24.953340 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-1125206f-c370-4113-9b5e-cc680b2bd33a tempest-VolumesSnapshotTestJSON-639273304 None] deleting rbd volume volume-69fd46b7-dacb-409d-88c5-27d9657b39f5 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:36:24.967587 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-886fd7f8-689f-48b6-937c-8c271341f67d tempest-VolumesImageMetadata-635732396 None] Created reservations ['116247c0-c9af-4eea-8883-ddae68a6cfbe', 'f0bf4a7c-b678-43d3-b80f-b87064f2866e', '2848b5ec-bafa-4901-92bb-7cd69baaea18', '44f89e17-50f1-4419-ba4a-e36ef8d6afc3'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:36:25.060116 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-6616dd21-6bad-4d92-8015-6a6cb785fc65 tempest-VolumeQuotasAdminTestJSON-1912249918 None] Created reservations ['701b125f-aa69-44f4-a5b7-f0901fedea1f', 'd83754ae-8040-4061-9de5-9fcf7a33ea72', '36d53b22-bb28-4743-9295-90885e9e6809', 'c5e91715-3b55-4353-96e2-ab2300a28573'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:36:25.171490 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-886fd7f8-689f-48b6-937c-8c271341f67d tempest-VolumesImageMetadata-635732396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:36:25.196130 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-886fd7f8-689f-48b6-937c-8c271341f67d tempest-VolumesImageMetadata-635732396 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:36:25.219725 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-886fd7f8-689f-48b6-937c-8c271341f67d tempest-VolumesImageMetadata-635732396 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:36:25.226174 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-886fd7f8-689f-48b6-937c-8c271341f67d tempest-VolumesImageMetadata-635732396 None] Deleted volume successfully. Dec 25 21:36:25.366097 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-910aff38-1509-40b5-a2d8-075a90ab2ff3 tempest-VolumesGetTest-758022543 None] Created reservations ['9f01566c-1c7f-41e4-baac-eb700ff90671', '450bb41b-083a-43f2-b0f2-4a49c67fb12f', 'd1dafea3-996a-4a96-bb8d-a9b906ca4ec4', '3b99528e-a63d-4e98-9cfa-5510c922ed3f'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:36:25.391638 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-886fd7f8-689f-48b6-937c-8c271341f67d tempest-VolumesImageMetadata-635732396 None] Lock "b'cinder-7d3b74f1-6aef-407b-9ffc-4e47e86880d0-delete_volume'" released by "delete_volume" :: held 16.291s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:36:25.493562 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-6616dd21-6bad-4d92-8015-6a6cb785fc65 tempest-VolumeQuotasAdminTestJSON-1912249918 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:36:25.518697 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-6616dd21-6bad-4d92-8015-6a6cb785fc65 tempest-VolumeQuotasAdminTestJSON-1912249918 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:36:25.551179 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-6616dd21-6bad-4d92-8015-6a6cb785fc65 tempest-VolumeQuotasAdminTestJSON-1912249918 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:36:25.555896 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-6616dd21-6bad-4d92-8015-6a6cb785fc65 tempest-VolumeQuotasAdminTestJSON-1912249918 None] Deleted volume successfully. Dec 25 21:36:25.666240 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-6616dd21-6bad-4d92-8015-6a6cb785fc65 tempest-VolumeQuotasAdminTestJSON-1912249918 None] Lock "b'cinder-e9917ddf-612b-4351-a781-48cf769722b1-delete_volume'" released by "delete_volume" :: held 10.967s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:36:25.712851 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-910aff38-1509-40b5-a2d8-075a90ab2ff3 tempest-VolumesGetTest-758022543 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:36:25.737094 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-910aff38-1509-40b5-a2d8-075a90ab2ff3 tempest-VolumesGetTest-758022543 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:36:25.768020 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-910aff38-1509-40b5-a2d8-075a90ab2ff3 tempest-VolumesGetTest-758022543 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:36:25.772355 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-910aff38-1509-40b5-a2d8-075a90ab2ff3 tempest-VolumesGetTest-758022543 None] Deleted volume successfully. Dec 25 21:36:25.832171 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-910aff38-1509-40b5-a2d8-075a90ab2ff3 tempest-VolumesGetTest-758022543 None] Lock "b'cinder-4d659bcc-1afa-4273-94f3-ec51056b765e-delete_volume'" released by "delete_volume" :: held 9.170s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:36:26.299269 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-6f472ff0-17da-45a8-8b56-9553d4b2c96d tempest-VolumesGetTest-758022543 None] Lock "b'cinder-b9eedcb8-78bb-4435-af45-cf2c39c9cbdc-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:36:26.404368 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-6f472ff0-17da-45a8-8b56-9553d4b2c96d tempest-VolumesGetTest-758022543 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:36:26.743094 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-6f472ff0-17da-45a8-8b56-9553d4b2c96d tempest-VolumesGetTest-758022543 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:36:27.110060 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-6f472ff0-17da-45a8-8b56-9553d4b2c96d tempest-VolumesGetTest-758022543 None] deleting rbd volume volume-b9eedcb8-78bb-4435-af45-cf2c39c9cbdc {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:36:30.863168 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-00fdfc96-649e-49d8-bfca-743a77708f9a tempest-AbsoluteLimitsTests-1058956861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:36:30.867664 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-00fdfc96-649e-49d8-bfca-743a77708f9a tempest-AbsoluteLimitsTests-1058956861 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:36:30.868113 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-00fdfc96-649e-49d8-bfca-743a77708f9a tempest-AbsoluteLimitsTests-1058956861 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:36:30.881441 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-00fdfc96-649e-49d8-bfca-743a77708f9a tempest-AbsoluteLimitsTests-1058956861 None] Flow 'volume_create_manager' (e4ea3436-2f50-45b7-a5f8-db461664b040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:36:30.887645 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-00fdfc96-649e-49d8-bfca-743a77708f9a tempest-AbsoluteLimitsTests-1058956861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e43c1e9f-f4af-4b61-902d-e5275d57beea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:30.894044 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-00fdfc96-649e-49d8-bfca-743a77708f9a tempest-AbsoluteLimitsTests-1058956861 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:36:30.909235 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-00fdfc96-649e-49d8-bfca-743a77708f9a tempest-AbsoluteLimitsTests-1058956861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e43c1e9f-f4af-4b61-902d-e5275d57beea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-609806141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0fcb54f5-2280-42ee-8902-7d3c4204bfb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be78166c9f60433db2d55212d563610b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:36:31Z,use_quota=True,user_id='d5401ab34b3b4de1b516d5d367b9748b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:30.911952 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-00fdfc96-649e-49d8-bfca-743a77708f9a tempest-AbsoluteLimitsTests-1058956861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00ece888-6744-4aef-9fd0-8cedc143332d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:30.915301 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-00fdfc96-649e-49d8-bfca-743a77708f9a tempest-AbsoluteLimitsTests-1058956861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00ece888-6744-4aef-9fd0-8cedc143332d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:30.918732 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-00fdfc96-649e-49d8-bfca-743a77708f9a tempest-AbsoluteLimitsTests-1058956861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (019d91dd-e4a9-44b6-8400-5a78d5c71833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:30.921515 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-00fdfc96-649e-49d8-bfca-743a77708f9a tempest-AbsoluteLimitsTests-1058956861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (019d91dd-e4a9-44b6-8400-5a78d5c71833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fcb54f5-2280-42ee-8902-7d3c4204bfb8', 'volume_name': 'volume-0fcb54f5-2280-42ee-8902-7d3c4204bfb8', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:30.925476 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-00fdfc96-649e-49d8-bfca-743a77708f9a tempest-AbsoluteLimitsTests-1058956861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40f6879c-c545-4026-8aa3-22c470cfdaad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:30.926428 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-00fdfc96-649e-49d8-bfca-743a77708f9a tempest-AbsoluteLimitsTests-1058956861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40f6879c-c545-4026-8aa3-22c470cfdaad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:30.929048 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-00fdfc96-649e-49d8-bfca-743a77708f9a tempest-AbsoluteLimitsTests-1058956861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b95fd59-6762-43d6-89ae-f36c659b14dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:30.929940 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-00fdfc96-649e-49d8-bfca-743a77708f9a tempest-AbsoluteLimitsTests-1058956861 None] Volume 0fcb54f5-2280-42ee-8902-7d3c4204bfb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fcb54f5-2280-42ee-8902-7d3c4204bfb8', 'volume_size': 1} Dec 25 21:36:30.930330 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-00fdfc96-649e-49d8-bfca-743a77708f9a tempest-AbsoluteLimitsTests-1058956861 None] creating volume 'volume-0fcb54f5-2280-42ee-8902-7d3c4204bfb8' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:36:30.931305 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-00fdfc96-649e-49d8-bfca-743a77708f9a tempest-AbsoluteLimitsTests-1058956861 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:36:32.037951 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-00fdfc96-649e-49d8-bfca-743a77708f9a tempest-AbsoluteLimitsTests-1058956861 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:36:32.038514 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-00fdfc96-649e-49d8-bfca-743a77708f9a tempest-AbsoluteLimitsTests-1058956861 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:36:32.040224 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-00fdfc96-649e-49d8-bfca-743a77708f9a tempest-AbsoluteLimitsTests-1058956861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b95fd59-6762-43d6-89ae-f36c659b14dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fcb54f5-2280-42ee-8902-7d3c4204bfb8', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:32.042446 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-00fdfc96-649e-49d8-bfca-743a77708f9a tempest-AbsoluteLimitsTests-1058956861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c30fa09-0606-4009-b4db-a7ba6018c69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:32.055758 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:36:32.056556 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:36:32.079495 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:36:32.103211 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:36:32.105739 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-00fdfc96-649e-49d8-bfca-743a77708f9a tempest-AbsoluteLimitsTests-1058956861 None] Volume volume-0fcb54f5-2280-42ee-8902-7d3c4204bfb8 (0fcb54f5-2280-42ee-8902-7d3c4204bfb8): created successfully Dec 25 21:36:32.108360 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-00fdfc96-649e-49d8-bfca-743a77708f9a tempest-AbsoluteLimitsTests-1058956861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c30fa09-0606-4009-b4db-a7ba6018c69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:32.110724 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-00fdfc96-649e-49d8-bfca-743a77708f9a tempest-AbsoluteLimitsTests-1058956861 None] Flow 'volume_create_manager' (e4ea3436-2f50-45b7-a5f8-db461664b040) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:36:32.215998 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-00fdfc96-649e-49d8-bfca-743a77708f9a tempest-AbsoluteLimitsTests-1058956861 None] Created volume successfully. Dec 25 21:36:33.038432 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-638ecd23-c6da-4eb0-8ad4-e09b6143d32f tempest-AbsoluteLimitsTests-1058956861 None] Lock "b'cinder-0fcb54f5-2280-42ee-8902-7d3c4204bfb8-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:36:33.142316 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-638ecd23-c6da-4eb0-8ad4-e09b6143d32f tempest-AbsoluteLimitsTests-1058956861 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:36:33.569503 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-638ecd23-c6da-4eb0-8ad4-e09b6143d32f tempest-AbsoluteLimitsTests-1058956861 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:36:33.569939 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-638ecd23-c6da-4eb0-8ad4-e09b6143d32f tempest-AbsoluteLimitsTests-1058956861 None] Volume volume-0fcb54f5-2280-42ee-8902-7d3c4204bfb8 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:36:33.786993 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-638ecd23-c6da-4eb0-8ad4-e09b6143d32f tempest-AbsoluteLimitsTests-1058956861 None] deleting rbd volume volume-0fcb54f5-2280-42ee-8902-7d3c4204bfb8 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:36:33.913010 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-1125206f-c370-4113-9b5e-cc680b2bd33a tempest-VolumesSnapshotTestJSON-639273304 None] Deleted volume successfully. Dec 25 21:36:33.917851 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-1125206f-c370-4113-9b5e-cc680b2bd33a tempest-VolumesSnapshotTestJSON-639273304 None] Lock "b'cinder-69fd46b7-dacb-409d-88c5-27d9657b39f5-delete_volume'" released by "delete_volume" :: held 9.366s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:36:34.611355 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-15590982-c44a-4cd0-a356-84169c5a40e9 tempest-VolumeRetypeWithoutMigrationTest-493519886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:36:34.614603 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-15590982-c44a-4cd0-a356-84169c5a40e9 tempest-VolumeRetypeWithoutMigrationTest-493519886 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:36:34.615049 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-15590982-c44a-4cd0-a356-84169c5a40e9 tempest-VolumeRetypeWithoutMigrationTest-493519886 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:36:34.627526 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-15590982-c44a-4cd0-a356-84169c5a40e9 tempest-VolumeRetypeWithoutMigrationTest-493519886 None] Flow 'volume_create_manager' (1c9e94e6-4308-4f71-9e53-071df197a7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:36:34.630734 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-15590982-c44a-4cd0-a356-84169c5a40e9 tempest-VolumeRetypeWithoutMigrationTest-493519886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc248574-772b-4136-8449-3a3cfa84e502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:34.637146 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-15590982-c44a-4cd0-a356-84169c5a40e9 tempest-VolumeRetypeWithoutMigrationTest-493519886 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:36:34.654067 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-15590982-c44a-4cd0-a356-84169c5a40e9 tempest-VolumeRetypeWithoutMigrationTest-493519886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc248574-772b-4136-8449-3a3cfa84e502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2043955008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f0908fb9-5619-4fc9-be6f-42db105747b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86b8877084634b8da7fbff8c88e8621f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:36:34Z,use_quota=True,user_id='785ab23935ec489fb8e8563e95f38caf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79903079-ee49-40f8-bc08-66777241ca97),volume_type_id=79903079-ee49-40f8-bc08-66777241ca97)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:34.654227 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-15590982-c44a-4cd0-a356-84169c5a40e9 tempest-VolumeRetypeWithoutMigrationTest-493519886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed3fe64f-cbae-48d2-869a-7d2e49b43b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:34.655762 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-15590982-c44a-4cd0-a356-84169c5a40e9 tempest-VolumeRetypeWithoutMigrationTest-493519886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed3fe64f-cbae-48d2-869a-7d2e49b43b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:34.658584 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-15590982-c44a-4cd0-a356-84169c5a40e9 tempest-VolumeRetypeWithoutMigrationTest-493519886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fd17725-0c5f-4312-b9c0-d32da01d4d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:34.660938 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-15590982-c44a-4cd0-a356-84169c5a40e9 tempest-VolumeRetypeWithoutMigrationTest-493519886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fd17725-0c5f-4312-b9c0-d32da01d4d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0908fb9-5619-4fc9-be6f-42db105747b8', 'volume_name': 'volume-f0908fb9-5619-4fc9-be6f-42db105747b8', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:34.663265 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-15590982-c44a-4cd0-a356-84169c5a40e9 tempest-VolumeRetypeWithoutMigrationTest-493519886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8430272-e027-49d1-8c6d-f7a51e3119c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:34.665442 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-15590982-c44a-4cd0-a356-84169c5a40e9 tempest-VolumeRetypeWithoutMigrationTest-493519886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8430272-e027-49d1-8c6d-f7a51e3119c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:34.667666 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-15590982-c44a-4cd0-a356-84169c5a40e9 tempest-VolumeRetypeWithoutMigrationTest-493519886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17a6a8a8-b77f-4832-a374-e7297de0c42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:34.669084 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-15590982-c44a-4cd0-a356-84169c5a40e9 tempest-VolumeRetypeWithoutMigrationTest-493519886 None] Volume f0908fb9-5619-4fc9-be6f-42db105747b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0908fb9-5619-4fc9-be6f-42db105747b8', 'volume_size': 1} Dec 25 21:36:34.669484 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-15590982-c44a-4cd0-a356-84169c5a40e9 tempest-VolumeRetypeWithoutMigrationTest-493519886 None] creating volume 'volume-f0908fb9-5619-4fc9-be6f-42db105747b8' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:36:34.670589 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-15590982-c44a-4cd0-a356-84169c5a40e9 tempest-VolumeRetypeWithoutMigrationTest-493519886 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:36:35.710699 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-15590982-c44a-4cd0-a356-84169c5a40e9 tempest-VolumeRetypeWithoutMigrationTest-493519886 None] extra_specs: {} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:36:35.711350 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-15590982-c44a-4cd0-a356-84169c5a40e9 tempest-VolumeRetypeWithoutMigrationTest-493519886 None] extra_specs: {} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:36:35.713219 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-15590982-c44a-4cd0-a356-84169c5a40e9 tempest-VolumeRetypeWithoutMigrationTest-493519886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17a6a8a8-b77f-4832-a374-e7297de0c42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0908fb9-5619-4fc9-be6f-42db105747b8', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:35.715411 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-15590982-c44a-4cd0-a356-84169c5a40e9 tempest-VolumeRetypeWithoutMigrationTest-493519886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5bf4759-c12d-4e1b-a4af-2a55297dd5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:35.884427 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-15590982-c44a-4cd0-a356-84169c5a40e9 tempest-VolumeRetypeWithoutMigrationTest-493519886 None] Volume volume-f0908fb9-5619-4fc9-be6f-42db105747b8 (f0908fb9-5619-4fc9-be6f-42db105747b8): created successfully Dec 25 21:36:35.887154 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-15590982-c44a-4cd0-a356-84169c5a40e9 tempest-VolumeRetypeWithoutMigrationTest-493519886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5bf4759-c12d-4e1b-a4af-2a55297dd5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:35.890945 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-15590982-c44a-4cd0-a356-84169c5a40e9 tempest-VolumeRetypeWithoutMigrationTest-493519886 None] Flow 'volume_create_manager' (1c9e94e6-4308-4f71-9e53-071df197a7e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:36:35.965359 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-15590982-c44a-4cd0-a356-84169c5a40e9 tempest-VolumeRetypeWithoutMigrationTest-493519886 None] Created volume successfully. Dec 25 21:36:35.985835 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-6f472ff0-17da-45a8-8b56-9553d4b2c96d tempest-VolumesGetTest-758022543 None] volume is a clone so cleaning references {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 25 21:36:36.222935 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-6f472ff0-17da-45a8-8b56-9553d4b2c96d tempest-VolumesGetTest-758022543 None] Volume volume-80c90346-162a-4a22-98bc-367019c5448e is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:36:36.223904 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-6f472ff0-17da-45a8-8b56-9553d4b2c96d tempest-VolumesGetTest-758022543 None] deleting parent snapshot volume-b9eedcb8-78bb-4435-af45-cf2c39c9cbdc.clone_snap {{(pid=129926) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 25 21:36:39.633256 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-6f472ff0-17da-45a8-8b56-9553d4b2c96d tempest-VolumesGetTest-758022543 None] Created reservations ['7929991c-a4b0-41fd-9fb7-81e40df72cd3', 'cf94ee8b-679f-4bb9-a692-2438541aed90', 'fb4bce3c-58bf-4c3b-b28c-a80fd7f15bbf', '4b329ee8-ea25-47f7-9da1-2d3c62332c84'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:36:39.916035 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-6f472ff0-17da-45a8-8b56-9553d4b2c96d tempest-VolumesGetTest-758022543 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:36:39.938346 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-6f472ff0-17da-45a8-8b56-9553d4b2c96d tempest-VolumesGetTest-758022543 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:36:39.982659 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-6f472ff0-17da-45a8-8b56-9553d4b2c96d tempest-VolumesGetTest-758022543 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:36:39.992088 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-6f472ff0-17da-45a8-8b56-9553d4b2c96d tempest-VolumesGetTest-758022543 None] Deleted volume successfully. Dec 25 21:36:40.084454 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-6f472ff0-17da-45a8-8b56-9553d4b2c96d tempest-VolumesGetTest-758022543 None] Lock "b'cinder-b9eedcb8-78bb-4435-af45-cf2c39c9cbdc-delete_volume'" released by "delete_volume" :: held 13.785s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:36:40.130552 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-8cfa3016-3d1b-46aa-8f18-430f50f70948 tempest-VolumeRetypeWithoutMigrationTest-493519886 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:36:40.179477 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-8cfa3016-3d1b-46aa-8f18-430f50f70948 tempest-VolumeRetypeWithoutMigrationTest-493519886 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:36:40.218271 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-8cfa3016-3d1b-46aa-8f18-430f50f70948 tempest-VolumeRetypeWithoutMigrationTest-493519886 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:36:40.223273 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-8cfa3016-3d1b-46aa-8f18-430f50f70948 tempest-VolumeRetypeWithoutMigrationTest-493519886 None] Retype volume completed successfully. Dec 25 21:36:40.363726 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-4ca11c96-06b8-4a9d-b160-50b795f59db2 tempest-VolumeRetypeWithoutMigrationTest-493519886 None] Lock "b'cinder-f0908fb9-5619-4fc9-be6f-42db105747b8-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:36:40.519243 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-4ca11c96-06b8-4a9d-b160-50b795f59db2 tempest-VolumeRetypeWithoutMigrationTest-493519886 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:36:40.815690 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-4ca11c96-06b8-4a9d-b160-50b795f59db2 tempest-VolumeRetypeWithoutMigrationTest-493519886 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:36:40.816346 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-4ca11c96-06b8-4a9d-b160-50b795f59db2 tempest-VolumeRetypeWithoutMigrationTest-493519886 None] Volume volume-f0908fb9-5619-4fc9-be6f-42db105747b8 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:36:41.119100 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-4ca11c96-06b8-4a9d-b160-50b795f59db2 tempest-VolumeRetypeWithoutMigrationTest-493519886 None] deleting rbd volume volume-f0908fb9-5619-4fc9-be6f-42db105747b8 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:36:41.234837 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-45bf0372-bdd6-44ef-a6a9-2396202e7ee0 tempest-VolumesGetTest-758022543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:36:41.238614 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-45bf0372-bdd6-44ef-a6a9-2396202e7ee0 tempest-VolumesGetTest-758022543 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:36:41.239061 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-45bf0372-bdd6-44ef-a6a9-2396202e7ee0 tempest-VolumesGetTest-758022543 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:36:41.250616 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-45bf0372-bdd6-44ef-a6a9-2396202e7ee0 tempest-VolumesGetTest-758022543 None] Flow 'volume_create_manager' (1a3f15f4-0902-484e-ba88-cdbe39f69338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:36:41.254129 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-45bf0372-bdd6-44ef-a6a9-2396202e7ee0 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62addcee-9535-4332-88df-febf5092a132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:41.259872 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-45bf0372-bdd6-44ef-a6a9-2396202e7ee0 tempest-VolumesGetTest-758022543 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:36:41.275268 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-45bf0372-bdd6-44ef-a6a9-2396202e7ee0 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62addcee-9535-4332-88df-febf5092a132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:36:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-699422261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=72a6908b-74f0-4a70-b157-f08788a4d9ee,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='609b19a4efc34c8fa016adb3a5fdb23b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:36:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:36:41Z,use_quota=True,user_id='322d719e1dbd4014b58f2f7ed9641f2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:41.277849 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-45bf0372-bdd6-44ef-a6a9-2396202e7ee0 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac404bc3-b269-4ec7-82c5-55cbc8fbef96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:41.280529 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-45bf0372-bdd6-44ef-a6a9-2396202e7ee0 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac404bc3-b269-4ec7-82c5-55cbc8fbef96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:41.286429 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-45bf0372-bdd6-44ef-a6a9-2396202e7ee0 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (473924f1-4454-41ed-b0cb-1273909efde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:41.369722 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-45bf0372-bdd6-44ef-a6a9-2396202e7ee0 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (473924f1-4454-41ed-b0cb-1273909efde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '72a6908b-74f0-4a70-b157-f08788a4d9ee', 'volume_name': 'volume-72a6908b-74f0-4a70-b157-f08788a4d9ee', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:41.372161 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-45bf0372-bdd6-44ef-a6a9-2396202e7ee0 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c04e5f0-b316-4f77-af9d-7a94939d3cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:41.374473 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-45bf0372-bdd6-44ef-a6a9-2396202e7ee0 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c04e5f0-b316-4f77-af9d-7a94939d3cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:41.376717 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-45bf0372-bdd6-44ef-a6a9-2396202e7ee0 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89ba267a-c13e-4703-a838-7c7e9c6bfe5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:41.377802 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-45bf0372-bdd6-44ef-a6a9-2396202e7ee0 tempest-VolumesGetTest-758022543 None] Volume 72a6908b-74f0-4a70-b157-f08788a4d9ee: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-72a6908b-74f0-4a70-b157-f08788a4d9ee', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 25 21:36:41.378387 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-45bf0372-bdd6-44ef-a6a9-2396202e7ee0 tempest-VolumesGetTest-758022543 None] Cloning 72a6908b-74f0-4a70-b157-f08788a4d9ee from image aca914d0-5f7b-465f-a024-75efa27d7291 at location (None, None). {{(pid=129926) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Dec 25 21:36:41.389008 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-45bf0372-bdd6-44ef-a6a9-2396202e7ee0 tempest-VolumesGetTest-758022543 None] Lock "b'cinder-aca914d0-5f7b-465f-a024-75efa27d7291'" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:36:41.473021 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-45bf0372-bdd6-44ef-a6a9-2396202e7ee0 tempest-VolumesGetTest-758022543 None] Found image-volume cache entry: {'id': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'volume_id': '058f5fb3-51e4-40e3-9c98-542207f1fc1f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31), 'last_used': datetime.datetime(2021, 12, 25, 21, 36, 41, 393839)}. {{(pid=129926) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 25 21:36:41.474061 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-45bf0372-bdd6-44ef-a6a9-2396202e7ee0 tempest-VolumesGetTest-758022543 None] Image-volume cache entry image_update_at = 2021-12-25 20:58:31+00:00, requested image updated_at = 2021-12-25 20:58:31+00:00. {{(pid=129926) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 25 21:36:41.474061 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-45bf0372-bdd6-44ef-a6a9-2396202e7ee0 tempest-VolumesGetTest-758022543 None] Found cache entry for image = aca914d0-5f7b-465f-a024-75efa27d7291 on host ncdv-master-1@ceph#ceph. {{(pid=129926) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Dec 25 21:36:41.484504 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-45bf0372-bdd6-44ef-a6a9-2396202e7ee0 tempest-VolumesGetTest-758022543 None] Lock "b'cinder-aca914d0-5f7b-465f-a024-75efa27d7291'" released by "_prepare_image_cache_entry" :: held 0.096s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:36:41.485402 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-45bf0372-bdd6-44ef-a6a9-2396202e7ee0 tempest-VolumesGetTest-758022543 None] Attempting to retrieve cache entry for image = aca914d0-5f7b-465f-a024-75efa27d7291 on host ncdv-master-1@ceph#ceph. {{(pid=129926) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Dec 25 21:36:41.491499 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-45bf0372-bdd6-44ef-a6a9-2396202e7ee0 tempest-VolumesGetTest-758022543 None] Found image-volume cache entry: {'id': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'volume_id': '058f5fb3-51e4-40e3-9c98-542207f1fc1f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31), 'last_used': datetime.datetime(2021, 12, 25, 21, 36, 41, 488942)}. {{(pid=129926) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 25 21:36:41.491918 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-45bf0372-bdd6-44ef-a6a9-2396202e7ee0 tempest-VolumesGetTest-758022543 None] Image-volume cache entry image_update_at = 2021-12-25 20:58:31+00:00, requested image updated_at = 2021-12-25 20:58:31+00:00. {{(pid=129926) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 25 21:36:41.492310 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-45bf0372-bdd6-44ef-a6a9-2396202e7ee0 tempest-VolumesGetTest-758022543 None] Creating from source image-volume 058f5fb3-51e4-40e3-9c98-542207f1fc1f {{(pid=129926) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Dec 25 21:36:41.505350 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-45bf0372-bdd6-44ef-a6a9-2396202e7ee0 tempest-VolumesGetTest-758022543 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:36:41.758369 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-45bf0372-bdd6-44ef-a6a9-2396202e7ee0 tempest-VolumesGetTest-758022543 None] creating snapshot='volume-72a6908b-74f0-4a70-b157-f08788a4d9ee.clone_snap' {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 25 21:36:44.948297 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-45bf0372-bdd6-44ef-a6a9-2396202e7ee0 tempest-VolumesGetTest-758022543 None] cloning 'volume-058f5fb3-51e4-40e3-9c98-542207f1fc1f@volume-72a6908b-74f0-4a70-b157-f08788a4d9ee.clone_snap' to 'volume-72a6908b-74f0-4a70-b157-f08788a4d9ee' {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 25 21:36:45.153026 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-638ecd23-c6da-4eb0-8ad4-e09b6143d32f tempest-AbsoluteLimitsTests-1058956861 None] Created reservations ['a99a0370-87c4-417b-8817-b1ba81e1dfbb', '49446f77-7040-4538-8b4f-c7b7578b4cc3', 'd2de666b-f0ec-4436-9258-21c3af328c37', 'efa1257b-6fc3-40c6-b335-24e2bd780420'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:36:45.359541 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-638ecd23-c6da-4eb0-8ad4-e09b6143d32f tempest-AbsoluteLimitsTests-1058956861 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:36:45.384372 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-638ecd23-c6da-4eb0-8ad4-e09b6143d32f tempest-AbsoluteLimitsTests-1058956861 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:36:45.409577 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-638ecd23-c6da-4eb0-8ad4-e09b6143d32f tempest-AbsoluteLimitsTests-1058956861 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:36:45.424706 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-638ecd23-c6da-4eb0-8ad4-e09b6143d32f tempest-AbsoluteLimitsTests-1058956861 None] Deleted volume successfully. Dec 25 21:36:45.534487 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-638ecd23-c6da-4eb0-8ad4-e09b6143d32f tempest-AbsoluteLimitsTests-1058956861 None] Lock "b'cinder-0fcb54f5-2280-42ee-8902-7d3c4204bfb8-delete_volume'" released by "delete_volume" :: held 12.496s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:36:47.285838 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-45bf0372-bdd6-44ef-a6a9-2396202e7ee0 tempest-VolumesGetTest-758022543 None] Volume volume-98b6d31e-e760-499e-8962-7b22479c1e9a.deleted is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:36:47.287249 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-45bf0372-bdd6-44ef-a6a9-2396202e7ee0 tempest-VolumesGetTest-758022543 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:36:47.287639 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-45bf0372-bdd6-44ef-a6a9-2396202e7ee0 tempest-VolumesGetTest-758022543 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:36:48.050711 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-45bf0372-bdd6-44ef-a6a9-2396202e7ee0 tempest-VolumesGetTest-758022543 None] clone created successfully {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 25 21:36:48.057703 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.volume_utils [None req-45bf0372-bdd6-44ef-a6a9-2396202e7ee0 tempest-VolumesGetTest-758022543 None] Marking volume 72a6908b-74f0-4a70-b157-f08788a4d9ee as bootable. {{(pid=129926) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 25 21:36:48.124959 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-45bf0372-bdd6-44ef-a6a9-2396202e7ee0 tempest-VolumesGetTest-758022543 None] Copying metadata from image aca914d0-5f7b-465f-a024-75efa27d7291 to 72a6908b-74f0-4a70-b157-f08788a4d9ee. {{(pid=129926) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Dec 25 21:36:48.125692 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-45bf0372-bdd6-44ef-a6a9-2396202e7ee0 tempest-VolumesGetTest-758022543 None] Creating volume glance metadata for volume 72a6908b-74f0-4a70-b157-f08788a4d9ee backed by image aca914d0-5f7b-465f-a024-75efa27d7291 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129926) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Dec 25 21:36:48.269082 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-45bf0372-bdd6-44ef-a6a9-2396202e7ee0 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89ba267a-c13e-4703-a838-7c7e9c6bfe5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72a6908b-74f0-4a70-b157-f08788a4d9ee', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:48.272579 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-45bf0372-bdd6-44ef-a6a9-2396202e7ee0 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc0a928f-564e-419a-938c-4ca44d26ca70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:48.405168 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-45bf0372-bdd6-44ef-a6a9-2396202e7ee0 tempest-VolumesGetTest-758022543 None] Volume volume-72a6908b-74f0-4a70-b157-f08788a4d9ee (72a6908b-74f0-4a70-b157-f08788a4d9ee): created successfully Dec 25 21:36:48.405168 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-45bf0372-bdd6-44ef-a6a9-2396202e7ee0 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc0a928f-564e-419a-938c-4ca44d26ca70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:48.407815 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-45bf0372-bdd6-44ef-a6a9-2396202e7ee0 tempest-VolumesGetTest-758022543 None] Flow 'volume_create_manager' (1a3f15f4-0902-484e-ba88-cdbe39f69338) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:36:48.519242 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-45bf0372-bdd6-44ef-a6a9-2396202e7ee0 tempest-VolumesGetTest-758022543 None] Created volume successfully. Dec 25 21:36:49.275334 ncdv-master-1 cinder-volume[129926]: WARNING cinder.quota [None req-4ca11c96-06b8-4a9d-b160-50b795f59db2 tempest-VolumeRetypeWithoutMigrationTest-493519886 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Dec 25 21:36:49.276225 ncdv-master-1 cinder-volume[129926]: WARNING cinder.quota [None req-4ca11c96-06b8-4a9d-b160-50b795f59db2 tempest-VolumeRetypeWithoutMigrationTest-493519886 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Dec 25 21:36:49.432384 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-4ca11c96-06b8-4a9d-b160-50b795f59db2 tempest-VolumeRetypeWithoutMigrationTest-493519886 None] Created reservations ['83c3bce0-2a85-4274-ac1c-466a47b4fc1f', '065c11df-dc00-4c42-817c-f3b526034a63', 'a932f166-c6c7-4277-a9bf-ed083d095a2c', 'dcd96ba1-1070-4aab-97d9-98fbd96052a4'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:36:49.627831 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-4ca11c96-06b8-4a9d-b160-50b795f59db2 tempest-VolumeRetypeWithoutMigrationTest-493519886 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:36:49.667149 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-4ca11c96-06b8-4a9d-b160-50b795f59db2 tempest-VolumeRetypeWithoutMigrationTest-493519886 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:36:49.715352 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-4ca11c96-06b8-4a9d-b160-50b795f59db2 tempest-VolumeRetypeWithoutMigrationTest-493519886 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:36:49.723104 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-4ca11c96-06b8-4a9d-b160-50b795f59db2 tempest-VolumeRetypeWithoutMigrationTest-493519886 None] Deleted volume successfully. Dec 25 21:36:49.793504 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-4ca11c96-06b8-4a9d-b160-50b795f59db2 tempest-VolumeRetypeWithoutMigrationTest-493519886 None] Lock "b'cinder-f0908fb9-5619-4fc9-be6f-42db105747b8-delete_volume'" released by "delete_volume" :: held 9.430s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:36:50.554351 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-270d8b7b-9ea1-4a80-989c-674d02c525e4 tempest-VolumesGetTest-758022543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:36:50.561555 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-270d8b7b-9ea1-4a80-989c-674d02c525e4 tempest-VolumesGetTest-758022543 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:36:50.561555 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-270d8b7b-9ea1-4a80-989c-674d02c525e4 tempest-VolumesGetTest-758022543 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:36:50.571463 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-270d8b7b-9ea1-4a80-989c-674d02c525e4 tempest-VolumesGetTest-758022543 None] Flow 'volume_create_manager' (fefa2e31-36e8-4719-a665-658bbf9e4fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:36:50.574681 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-270d8b7b-9ea1-4a80-989c-674d02c525e4 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (930ecf6d-056f-4943-9dec-d3acf99c2c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:50.581299 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-270d8b7b-9ea1-4a80-989c-674d02c525e4 tempest-VolumesGetTest-758022543 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:36:50.594342 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-270d8b7b-9ea1-4a80-989c-674d02c525e4 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (930ecf6d-056f-4943-9dec-d3acf99c2c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:36:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1256750095',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b3f8fdbd-a610-43a7-8666-8f1e761c0e55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609b19a4efc34c8fa016adb3a5fdb23b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:36:50Z,use_quota=True,user_id='322d719e1dbd4014b58f2f7ed9641f2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:50.596934 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-270d8b7b-9ea1-4a80-989c-674d02c525e4 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (823e0825-e844-4bbc-aa4a-0c482712880f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:50.599071 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-270d8b7b-9ea1-4a80-989c-674d02c525e4 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (823e0825-e844-4bbc-aa4a-0c482712880f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:50.601540 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-270d8b7b-9ea1-4a80-989c-674d02c525e4 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3383a13f-97ae-44b8-9924-bed45e617141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:50.603700 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-270d8b7b-9ea1-4a80-989c-674d02c525e4 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3383a13f-97ae-44b8-9924-bed45e617141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3f8fdbd-a610-43a7-8666-8f1e761c0e55', 'volume_name': 'volume-b3f8fdbd-a610-43a7-8666-8f1e761c0e55', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:50.606226 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-270d8b7b-9ea1-4a80-989c-674d02c525e4 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c8ba343-efa8-48b2-a4cb-4d5d731d5cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:50.609056 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-270d8b7b-9ea1-4a80-989c-674d02c525e4 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c8ba343-efa8-48b2-a4cb-4d5d731d5cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:50.614635 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-270d8b7b-9ea1-4a80-989c-674d02c525e4 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab9fb013-9d40-4b0b-a770-1ec81b933ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:50.614635 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-270d8b7b-9ea1-4a80-989c-674d02c525e4 tempest-VolumesGetTest-758022543 None] Volume b3f8fdbd-a610-43a7-8666-8f1e761c0e55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3f8fdbd-a610-43a7-8666-8f1e761c0e55', 'volume_size': 1} Dec 25 21:36:50.614635 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-270d8b7b-9ea1-4a80-989c-674d02c525e4 tempest-VolumesGetTest-758022543 None] creating volume 'volume-b3f8fdbd-a610-43a7-8666-8f1e761c0e55' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:36:50.614635 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-270d8b7b-9ea1-4a80-989c-674d02c525e4 tempest-VolumesGetTest-758022543 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:36:51.557123 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-270d8b7b-9ea1-4a80-989c-674d02c525e4 tempest-VolumesGetTest-758022543 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:36:51.557775 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-270d8b7b-9ea1-4a80-989c-674d02c525e4 tempest-VolumesGetTest-758022543 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:36:51.559552 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-270d8b7b-9ea1-4a80-989c-674d02c525e4 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab9fb013-9d40-4b0b-a770-1ec81b933ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3f8fdbd-a610-43a7-8666-8f1e761c0e55', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:51.561815 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-270d8b7b-9ea1-4a80-989c-674d02c525e4 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32759063-865a-4873-818e-fe67976439d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:51.621847 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-270d8b7b-9ea1-4a80-989c-674d02c525e4 tempest-VolumesGetTest-758022543 None] Volume volume-b3f8fdbd-a610-43a7-8666-8f1e761c0e55 (b3f8fdbd-a610-43a7-8666-8f1e761c0e55): created successfully Dec 25 21:36:51.624484 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-270d8b7b-9ea1-4a80-989c-674d02c525e4 tempest-VolumesGetTest-758022543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32759063-865a-4873-818e-fe67976439d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:51.627598 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-270d8b7b-9ea1-4a80-989c-674d02c525e4 tempest-VolumesGetTest-758022543 None] Flow 'volume_create_manager' (fefa2e31-36e8-4719-a665-658bbf9e4fd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:36:51.718376 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-270d8b7b-9ea1-4a80-989c-674d02c525e4 tempest-VolumesGetTest-758022543 None] Created volume successfully. Dec 25 21:36:52.319171 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-182ee1f8-ee68-456c-978e-dba5cb268e21 tempest-VolumesTransfersTest-181954938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:36:52.319171 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-182ee1f8-ee68-456c-978e-dba5cb268e21 tempest-VolumesTransfersTest-181954938 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:36:52.319171 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-182ee1f8-ee68-456c-978e-dba5cb268e21 tempest-VolumesTransfersTest-181954938 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:36:52.331870 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-182ee1f8-ee68-456c-978e-dba5cb268e21 tempest-VolumesTransfersTest-181954938 None] Flow 'volume_create_manager' (4e3b017d-f3f4-4737-820b-84a5ec9ab35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:36:52.348088 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-182ee1f8-ee68-456c-978e-dba5cb268e21 tempest-VolumesTransfersTest-181954938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (356019fa-0df5-4bd1-934b-4bb8a9136a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:52.357848 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-182ee1f8-ee68-456c-978e-dba5cb268e21 tempest-VolumesTransfersTest-181954938 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:36:52.377285 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-182ee1f8-ee68-456c-978e-dba5cb268e21 tempest-VolumesTransfersTest-181954938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (356019fa-0df5-4bd1-934b-4bb8a9136a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-574262191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=da03fcc1-04b5-449e-880a-fa85e58fdcac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='803653fa8681491b916c0b57c57c3f29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:36:52Z,use_quota=True,user_id='d908fbffef7047db86b4d40f70973397',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:52.378691 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-182ee1f8-ee68-456c-978e-dba5cb268e21 tempest-VolumesTransfersTest-181954938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83b524a1-e77d-45b0-8c62-91c64267aee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:52.380985 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-182ee1f8-ee68-456c-978e-dba5cb268e21 tempest-VolumesTransfersTest-181954938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83b524a1-e77d-45b0-8c62-91c64267aee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:52.383425 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-182ee1f8-ee68-456c-978e-dba5cb268e21 tempest-VolumesTransfersTest-181954938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7276b96a-6e00-46d1-bcd3-764f50979349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:52.385796 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-182ee1f8-ee68-456c-978e-dba5cb268e21 tempest-VolumesTransfersTest-181954938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7276b96a-6e00-46d1-bcd3-764f50979349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da03fcc1-04b5-449e-880a-fa85e58fdcac', 'volume_name': 'volume-da03fcc1-04b5-449e-880a-fa85e58fdcac', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:52.388910 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-182ee1f8-ee68-456c-978e-dba5cb268e21 tempest-VolumesTransfersTest-181954938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (506e1c39-9211-436e-a266-465a0716c100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:52.391077 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-182ee1f8-ee68-456c-978e-dba5cb268e21 tempest-VolumesTransfersTest-181954938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (506e1c39-9211-436e-a266-465a0716c100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:52.393418 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-182ee1f8-ee68-456c-978e-dba5cb268e21 tempest-VolumesTransfersTest-181954938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa5e302c-729b-4810-b2ab-2886dff24695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:52.394246 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-182ee1f8-ee68-456c-978e-dba5cb268e21 tempest-VolumesTransfersTest-181954938 None] Volume da03fcc1-04b5-449e-880a-fa85e58fdcac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da03fcc1-04b5-449e-880a-fa85e58fdcac', 'volume_size': 1} Dec 25 21:36:52.394643 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-182ee1f8-ee68-456c-978e-dba5cb268e21 tempest-VolumesTransfersTest-181954938 None] creating volume 'volume-da03fcc1-04b5-449e-880a-fa85e58fdcac' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:36:52.395626 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-182ee1f8-ee68-456c-978e-dba5cb268e21 tempest-VolumesTransfersTest-181954938 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:36:52.808957 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-f27074f0-42c6-4234-8e76-969920103d4b tempest-VolumesGetTest-758022543 None] Lock "b'cinder-b3f8fdbd-a610-43a7-8666-8f1e761c0e55-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:36:52.944186 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f27074f0-42c6-4234-8e76-969920103d4b tempest-VolumesGetTest-758022543 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:36:53.278774 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f27074f0-42c6-4234-8e76-969920103d4b tempest-VolumesGetTest-758022543 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:36:53.280027 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f27074f0-42c6-4234-8e76-969920103d4b tempest-VolumesGetTest-758022543 None] Volume volume-b3f8fdbd-a610-43a7-8666-8f1e761c0e55 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:36:53.549552 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f27074f0-42c6-4234-8e76-969920103d4b tempest-VolumesGetTest-758022543 None] deleting rbd volume volume-b3f8fdbd-a610-43a7-8666-8f1e761c0e55 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:36:53.555730 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-182ee1f8-ee68-456c-978e-dba5cb268e21 tempest-VolumesTransfersTest-181954938 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:36:53.556351 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-182ee1f8-ee68-456c-978e-dba5cb268e21 tempest-VolumesTransfersTest-181954938 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:36:53.561387 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-182ee1f8-ee68-456c-978e-dba5cb268e21 tempest-VolumesTransfersTest-181954938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa5e302c-729b-4810-b2ab-2886dff24695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da03fcc1-04b5-449e-880a-fa85e58fdcac', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:53.562207 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-182ee1f8-ee68-456c-978e-dba5cb268e21 tempest-VolumesTransfersTest-181954938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d12ede8a-1d7b-427f-ba44-4baf1846092c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:53.655876 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-182ee1f8-ee68-456c-978e-dba5cb268e21 tempest-VolumesTransfersTest-181954938 None] Volume volume-da03fcc1-04b5-449e-880a-fa85e58fdcac (da03fcc1-04b5-449e-880a-fa85e58fdcac): created successfully Dec 25 21:36:53.659860 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-182ee1f8-ee68-456c-978e-dba5cb268e21 tempest-VolumesTransfersTest-181954938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d12ede8a-1d7b-427f-ba44-4baf1846092c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:53.661162 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-182ee1f8-ee68-456c-978e-dba5cb268e21 tempest-VolumesTransfersTest-181954938 None] Flow 'volume_create_manager' (4e3b017d-f3f4-4737-820b-84a5ec9ab35e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:36:53.844535 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-182ee1f8-ee68-456c-978e-dba5cb268e21 tempest-VolumesTransfersTest-181954938 None] Created volume successfully. Dec 25 21:36:55.524955 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-c11338b4-7da4-494b-aaa9-7234a8315656 tempest-VolumesTransfersTest-919387044 None] Transfer volume completed successfully. Dec 25 21:36:56.131973 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-164f6569-935a-42ac-8e15-bf667ec2ae3c tempest-VolumesListAdminTestJSON-2068505491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:36:56.135476 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-164f6569-935a-42ac-8e15-bf667ec2ae3c tempest-VolumesListAdminTestJSON-2068505491 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:36:56.135927 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-164f6569-935a-42ac-8e15-bf667ec2ae3c tempest-VolumesListAdminTestJSON-2068505491 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:36:56.161692 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-164f6569-935a-42ac-8e15-bf667ec2ae3c tempest-VolumesListAdminTestJSON-2068505491 None] Flow 'volume_create_manager' (b3ad82bd-dd6c-4edb-bbc5-1b2be4bdbe18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:36:56.164954 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-164f6569-935a-42ac-8e15-bf667ec2ae3c tempest-VolumesListAdminTestJSON-2068505491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1eac7a1-8f2c-4069-9e62-1a79b16cc169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:56.171598 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-164f6569-935a-42ac-8e15-bf667ec2ae3c tempest-VolumesListAdminTestJSON-2068505491 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:36:56.188907 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-164f6569-935a-42ac-8e15-bf667ec2ae3c tempest-VolumesListAdminTestJSON-2068505491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1eac7a1-8f2c-4069-9e62-1a79b16cc169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-66055995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c78aaaf9-b653-4d4a-b055-be8c1cc961eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ef7c196a2a435992fa90e41bf876ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:36:56Z,use_quota=True,user_id='8fc6f76b2d574cdba191d9767b724db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:56.189099 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-164f6569-935a-42ac-8e15-bf667ec2ae3c tempest-VolumesListAdminTestJSON-2068505491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38695718-0ffc-40f6-b5d7-f52d74ce48e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:56.190903 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-164f6569-935a-42ac-8e15-bf667ec2ae3c tempest-VolumesListAdminTestJSON-2068505491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38695718-0ffc-40f6-b5d7-f52d74ce48e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:56.193561 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-164f6569-935a-42ac-8e15-bf667ec2ae3c tempest-VolumesListAdminTestJSON-2068505491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae0c5f74-a263-45ac-9505-a023202df36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:56.196287 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-164f6569-935a-42ac-8e15-bf667ec2ae3c tempest-VolumesListAdminTestJSON-2068505491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae0c5f74-a263-45ac-9505-a023202df36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c78aaaf9-b653-4d4a-b055-be8c1cc961eb', 'volume_name': 'volume-c78aaaf9-b653-4d4a-b055-be8c1cc961eb', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:56.199079 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-164f6569-935a-42ac-8e15-bf667ec2ae3c tempest-VolumesListAdminTestJSON-2068505491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44b80c24-4c3c-4aa0-8811-d55be5c47291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:56.205929 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-164f6569-935a-42ac-8e15-bf667ec2ae3c tempest-VolumesListAdminTestJSON-2068505491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44b80c24-4c3c-4aa0-8811-d55be5c47291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:56.208814 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-164f6569-935a-42ac-8e15-bf667ec2ae3c tempest-VolumesListAdminTestJSON-2068505491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77cdf3fd-4fea-4dc4-83c2-f090741e3bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:56.210432 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-164f6569-935a-42ac-8e15-bf667ec2ae3c tempest-VolumesListAdminTestJSON-2068505491 None] Volume c78aaaf9-b653-4d4a-b055-be8c1cc961eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c78aaaf9-b653-4d4a-b055-be8c1cc961eb', 'volume_size': 1} Dec 25 21:36:56.211033 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-164f6569-935a-42ac-8e15-bf667ec2ae3c tempest-VolumesListAdminTestJSON-2068505491 None] creating volume 'volume-c78aaaf9-b653-4d4a-b055-be8c1cc961eb' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:36:56.212546 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-164f6569-935a-42ac-8e15-bf667ec2ae3c tempest-VolumesListAdminTestJSON-2068505491 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:36:56.688442 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-b958e41d-f6be-4ace-bdad-aaa42f3b2aca tempest-VolumesTransfersTest-1157305279 None] Lock "b'cinder-da03fcc1-04b5-449e-880a-fa85e58fdcac-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:36:56.776943 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b958e41d-f6be-4ace-bdad-aaa42f3b2aca tempest-VolumesTransfersTest-1157305279 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:36:57.196290 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b958e41d-f6be-4ace-bdad-aaa42f3b2aca tempest-VolumesTransfersTest-1157305279 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:36:57.197030 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b958e41d-f6be-4ace-bdad-aaa42f3b2aca tempest-VolumesTransfersTest-1157305279 None] Volume volume-da03fcc1-04b5-449e-880a-fa85e58fdcac is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:36:57.485814 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b958e41d-f6be-4ace-bdad-aaa42f3b2aca tempest-VolumesTransfersTest-1157305279 None] deleting rbd volume volume-da03fcc1-04b5-449e-880a-fa85e58fdcac {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:36:57.490647 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-164f6569-935a-42ac-8e15-bf667ec2ae3c tempest-VolumesListAdminTestJSON-2068505491 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:36:57.491024 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-164f6569-935a-42ac-8e15-bf667ec2ae3c tempest-VolumesListAdminTestJSON-2068505491 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:36:57.495043 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-164f6569-935a-42ac-8e15-bf667ec2ae3c tempest-VolumesListAdminTestJSON-2068505491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77cdf3fd-4fea-4dc4-83c2-f090741e3bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c78aaaf9-b653-4d4a-b055-be8c1cc961eb', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:57.495422 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-164f6569-935a-42ac-8e15-bf667ec2ae3c tempest-VolumesListAdminTestJSON-2068505491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49868aca-6f1d-457a-a73f-ca12bbee1329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:57.601535 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-164f6569-935a-42ac-8e15-bf667ec2ae3c tempest-VolumesListAdminTestJSON-2068505491 None] Volume volume-c78aaaf9-b653-4d4a-b055-be8c1cc961eb (c78aaaf9-b653-4d4a-b055-be8c1cc961eb): created successfully Dec 25 21:36:57.603587 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-164f6569-935a-42ac-8e15-bf667ec2ae3c tempest-VolumesListAdminTestJSON-2068505491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49868aca-6f1d-457a-a73f-ca12bbee1329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:57.608790 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-164f6569-935a-42ac-8e15-bf667ec2ae3c tempest-VolumesListAdminTestJSON-2068505491 None] Flow 'volume_create_manager' (b3ad82bd-dd6c-4edb-bbc5-1b2be4bdbe18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:36:57.678887 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-164f6569-935a-42ac-8e15-bf667ec2ae3c tempest-VolumesListAdminTestJSON-2068505491 None] Created volume successfully. Dec 25 21:36:58.850621 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-98d9dc2d-9b8e-4551-983f-b87e888d9f2a tempest-VolumesListAdminTestJSON-2068505491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:36:58.852386 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-98d9dc2d-9b8e-4551-983f-b87e888d9f2a tempest-VolumesListAdminTestJSON-2068505491 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:36:58.854172 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-98d9dc2d-9b8e-4551-983f-b87e888d9f2a tempest-VolumesListAdminTestJSON-2068505491 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:36:58.871111 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-98d9dc2d-9b8e-4551-983f-b87e888d9f2a tempest-VolumesListAdminTestJSON-2068505491 None] Flow 'volume_create_manager' (ed911061-6ed8-4b2e-84d9-7b7c50492488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:36:58.874325 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-98d9dc2d-9b8e-4551-983f-b87e888d9f2a tempest-VolumesListAdminTestJSON-2068505491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c258f7f9-c1c6-468d-9499-8dd6b629e49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:58.881657 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-98d9dc2d-9b8e-4551-983f-b87e888d9f2a tempest-VolumesListAdminTestJSON-2068505491 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:36:58.894852 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-98d9dc2d-9b8e-4551-983f-b87e888d9f2a tempest-VolumesListAdminTestJSON-2068505491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c258f7f9-c1c6-468d-9499-8dd6b629e49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1585684000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=206a3c76-425f-4eea-a887-b250b0871cd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ef7c196a2a435992fa90e41bf876ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:36:59Z,use_quota=True,user_id='8fc6f76b2d574cdba191d9767b724db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:58.897629 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-98d9dc2d-9b8e-4551-983f-b87e888d9f2a tempest-VolumesListAdminTestJSON-2068505491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3173d9a9-cbf5-477a-b159-d9db535c9355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:58.899780 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-98d9dc2d-9b8e-4551-983f-b87e888d9f2a tempest-VolumesListAdminTestJSON-2068505491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3173d9a9-cbf5-477a-b159-d9db535c9355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:58.902209 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-98d9dc2d-9b8e-4551-983f-b87e888d9f2a tempest-VolumesListAdminTestJSON-2068505491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b034d6b6-199a-4a3e-9c31-77eca5df09d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:58.904998 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-98d9dc2d-9b8e-4551-983f-b87e888d9f2a tempest-VolumesListAdminTestJSON-2068505491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b034d6b6-199a-4a3e-9c31-77eca5df09d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '206a3c76-425f-4eea-a887-b250b0871cd9', 'volume_name': 'volume-206a3c76-425f-4eea-a887-b250b0871cd9', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:58.907498 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-98d9dc2d-9b8e-4551-983f-b87e888d9f2a tempest-VolumesListAdminTestJSON-2068505491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f46b1df6-4dcf-4674-a7f3-cb505c22ea72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:58.909827 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-98d9dc2d-9b8e-4551-983f-b87e888d9f2a tempest-VolumesListAdminTestJSON-2068505491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f46b1df6-4dcf-4674-a7f3-cb505c22ea72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:58.912359 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-98d9dc2d-9b8e-4551-983f-b87e888d9f2a tempest-VolumesListAdminTestJSON-2068505491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9732d81-f8fb-43dd-8b9f-18fb20a3260d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:58.913362 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-98d9dc2d-9b8e-4551-983f-b87e888d9f2a tempest-VolumesListAdminTestJSON-2068505491 None] Volume 206a3c76-425f-4eea-a887-b250b0871cd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-206a3c76-425f-4eea-a887-b250b0871cd9', 'volume_size': 1} Dec 25 21:36:58.913916 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-98d9dc2d-9b8e-4551-983f-b87e888d9f2a tempest-VolumesListAdminTestJSON-2068505491 None] creating volume 'volume-206a3c76-425f-4eea-a887-b250b0871cd9' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:36:58.915206 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-98d9dc2d-9b8e-4551-983f-b87e888d9f2a tempest-VolumesListAdminTestJSON-2068505491 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:36:59.704504 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-7890e4f0-003a-42c6-a976-29a486d18b35 tempest-VolumesSnapshotTestJSON-639273304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:36:59.707848 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-7890e4f0-003a-42c6-a976-29a486d18b35 tempest-VolumesSnapshotTestJSON-639273304 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:36:59.708291 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-7890e4f0-003a-42c6-a976-29a486d18b35 tempest-VolumesSnapshotTestJSON-639273304 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:36:59.721445 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-7890e4f0-003a-42c6-a976-29a486d18b35 tempest-VolumesSnapshotTestJSON-639273304 None] Flow 'volume_create_manager' (3ccb387a-6a78-405a-9182-5c8c69fe0b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:36:59.724845 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-7890e4f0-003a-42c6-a976-29a486d18b35 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b709bd-64d0-4eaf-8745-1eb3d94ee79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:59.734475 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-7890e4f0-003a-42c6-a976-29a486d18b35 tempest-VolumesSnapshotTestJSON-639273304 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:36:59.743539 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-7890e4f0-003a-42c6-a976-29a486d18b35 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b709bd-64d0-4eaf-8745-1eb3d94ee79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-289710729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=84b7c2f5-06e2-4582-b712-ba8e2cf1d2a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a416565d81324f55b88111b36c4a777c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:37:00Z,use_quota=True,user_id='c3a55c151bef4387a4fef00ab6687a20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:59.746113 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-7890e4f0-003a-42c6-a976-29a486d18b35 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6ce1cb2-3f9b-4b01-9d77-1c9720473897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:59.749152 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-7890e4f0-003a-42c6-a976-29a486d18b35 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6ce1cb2-3f9b-4b01-9d77-1c9720473897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:59.751785 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-7890e4f0-003a-42c6-a976-29a486d18b35 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fccb566-d673-4a54-9f70-791a3a81008d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:59.863618 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-7890e4f0-003a-42c6-a976-29a486d18b35 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fccb566-d673-4a54-9f70-791a3a81008d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '84b7c2f5-06e2-4582-b712-ba8e2cf1d2a7', 'volume_name': 'volume-84b7c2f5-06e2-4582-b712-ba8e2cf1d2a7', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:59.866073 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-7890e4f0-003a-42c6-a976-29a486d18b35 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a2d3702-cf1b-48e1-a781-a569c8bc15ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:59.868230 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-7890e4f0-003a-42c6-a976-29a486d18b35 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a2d3702-cf1b-48e1-a781-a569c8bc15ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:59.870426 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-7890e4f0-003a-42c6-a976-29a486d18b35 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8bdeb53-8ab8-446d-9c7d-b446cd45917c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:59.871267 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-7890e4f0-003a-42c6-a976-29a486d18b35 tempest-VolumesSnapshotTestJSON-639273304 None] Volume 84b7c2f5-06e2-4582-b712-ba8e2cf1d2a7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-84b7c2f5-06e2-4582-b712-ba8e2cf1d2a7', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 25 21:36:59.871819 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-7890e4f0-003a-42c6-a976-29a486d18b35 tempest-VolumesSnapshotTestJSON-639273304 None] Cloning 84b7c2f5-06e2-4582-b712-ba8e2cf1d2a7 from image aca914d0-5f7b-465f-a024-75efa27d7291 at location (None, None). {{(pid=129926) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Dec 25 21:36:59.880646 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-7890e4f0-003a-42c6-a976-29a486d18b35 tempest-VolumesSnapshotTestJSON-639273304 None] Lock "b'cinder-aca914d0-5f7b-465f-a024-75efa27d7291'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:36:59.902771 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-98d9dc2d-9b8e-4551-983f-b87e888d9f2a tempest-VolumesListAdminTestJSON-2068505491 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:36:59.903154 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-98d9dc2d-9b8e-4551-983f-b87e888d9f2a tempest-VolumesListAdminTestJSON-2068505491 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:36:59.905895 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-98d9dc2d-9b8e-4551-983f-b87e888d9f2a tempest-VolumesListAdminTestJSON-2068505491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9732d81-f8fb-43dd-8b9f-18fb20a3260d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-206a3c76-425f-4eea-a887-b250b0871cd9', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:36:59.908090 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-98d9dc2d-9b8e-4551-983f-b87e888d9f2a tempest-VolumesListAdminTestJSON-2068505491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1e5957e-a847-4bde-99e6-4d8b628b994b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:36:59.976543 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-7890e4f0-003a-42c6-a976-29a486d18b35 tempest-VolumesSnapshotTestJSON-639273304 None] Found image-volume cache entry: {'id': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'volume_id': '058f5fb3-51e4-40e3-9c98-542207f1fc1f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31), 'last_used': datetime.datetime(2021, 12, 25, 21, 36, 59, 888687)}. {{(pid=129926) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 25 21:36:59.976990 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-7890e4f0-003a-42c6-a976-29a486d18b35 tempest-VolumesSnapshotTestJSON-639273304 None] Image-volume cache entry image_update_at = 2021-12-25 20:58:31+00:00, requested image updated_at = 2021-12-25 20:58:31+00:00. {{(pid=129926) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 25 21:36:59.981977 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-7890e4f0-003a-42c6-a976-29a486d18b35 tempest-VolumesSnapshotTestJSON-639273304 None] Found cache entry for image = aca914d0-5f7b-465f-a024-75efa27d7291 on host ncdv-master-1@ceph#ceph. {{(pid=129926) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Dec 25 21:36:59.984617 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-7890e4f0-003a-42c6-a976-29a486d18b35 tempest-VolumesSnapshotTestJSON-639273304 None] Lock "b'cinder-aca914d0-5f7b-465f-a024-75efa27d7291'" released by "_prepare_image_cache_entry" :: held 0.104s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:36:59.985608 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-7890e4f0-003a-42c6-a976-29a486d18b35 tempest-VolumesSnapshotTestJSON-639273304 None] Attempting to retrieve cache entry for image = aca914d0-5f7b-465f-a024-75efa27d7291 on host ncdv-master-1@ceph#ceph. {{(pid=129926) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Dec 25 21:36:59.992281 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-7890e4f0-003a-42c6-a976-29a486d18b35 tempest-VolumesSnapshotTestJSON-639273304 None] Found image-volume cache entry: {'id': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'volume_id': '058f5fb3-51e4-40e3-9c98-542207f1fc1f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31), 'last_used': datetime.datetime(2021, 12, 25, 21, 36, 59, 989849)}. {{(pid=129926) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 25 21:36:59.992715 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-7890e4f0-003a-42c6-a976-29a486d18b35 tempest-VolumesSnapshotTestJSON-639273304 None] Image-volume cache entry image_update_at = 2021-12-25 20:58:31+00:00, requested image updated_at = 2021-12-25 20:58:31+00:00. {{(pid=129926) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 25 21:36:59.993322 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-7890e4f0-003a-42c6-a976-29a486d18b35 tempest-VolumesSnapshotTestJSON-639273304 None] Creating from source image-volume 058f5fb3-51e4-40e3-9c98-542207f1fc1f {{(pid=129926) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Dec 25 21:37:00.011818 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7890e4f0-003a-42c6-a976-29a486d18b35 tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:00.211279 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7890e4f0-003a-42c6-a976-29a486d18b35 tempest-VolumesSnapshotTestJSON-639273304 None] creating snapshot='volume-84b7c2f5-06e2-4582-b712-ba8e2cf1d2a7.clone_snap' {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 25 21:37:03.023159 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7890e4f0-003a-42c6-a976-29a486d18b35 tempest-VolumesSnapshotTestJSON-639273304 None] cloning 'volume-058f5fb3-51e4-40e3-9c98-542207f1fc1f@volume-84b7c2f5-06e2-4582-b712-ba8e2cf1d2a7.clone_snap' to 'volume-84b7c2f5-06e2-4582-b712-ba8e2cf1d2a7' {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 25 21:37:03.053019 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-98d9dc2d-9b8e-4551-983f-b87e888d9f2a tempest-VolumesListAdminTestJSON-2068505491 None] Volume volume-206a3c76-425f-4eea-a887-b250b0871cd9 (206a3c76-425f-4eea-a887-b250b0871cd9): created successfully Dec 25 21:37:03.055641 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-98d9dc2d-9b8e-4551-983f-b87e888d9f2a tempest-VolumesListAdminTestJSON-2068505491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1e5957e-a847-4bde-99e6-4d8b628b994b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:03.059222 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-98d9dc2d-9b8e-4551-983f-b87e888d9f2a tempest-VolumesListAdminTestJSON-2068505491 None] Flow 'volume_create_manager' (ed911061-6ed8-4b2e-84d9-7b7c50492488) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:37:03.181160 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-98d9dc2d-9b8e-4551-983f-b87e888d9f2a tempest-VolumesListAdminTestJSON-2068505491 None] Created volume successfully. Dec 25 21:37:03.211445 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec23785a-7bcc-4965-86ac-5487c4aa4cd4 tempest-VolumesListAdminTestJSON-2068505491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:37:03.214874 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-ec23785a-7bcc-4965-86ac-5487c4aa4cd4 tempest-VolumesListAdminTestJSON-2068505491 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:37:03.215324 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-ec23785a-7bcc-4965-86ac-5487c4aa4cd4 tempest-VolumesListAdminTestJSON-2068505491 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:37:03.229697 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ec23785a-7bcc-4965-86ac-5487c4aa4cd4 tempest-VolumesListAdminTestJSON-2068505491 None] Flow 'volume_create_manager' (84bfa6b4-95bf-4ddf-ab9c-69b3ebe45362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:37:03.233471 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ec23785a-7bcc-4965-86ac-5487c4aa4cd4 tempest-VolumesListAdminTestJSON-2068505491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08f2262-2800-4ea9-a695-c903a3a919b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:03.236174 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-f27074f0-42c6-4234-8e76-969920103d4b tempest-VolumesGetTest-758022543 None] Created reservations ['38901eb5-72e7-4496-8de5-6893c9dd9ef6', '5493538d-31b4-42cb-a2cf-9fb4676fe4ba', '973e5d86-3355-46f6-ba33-504567b6025b', 'f1f5dda9-ddb2-4103-bb17-b3e560e043c2'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:37:03.242524 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-f27074f0-42c6-4234-8e76-969920103d4b tempest-VolumesGetTest-758022543 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:37:03.261066 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ec23785a-7bcc-4965-86ac-5487c4aa4cd4 tempest-VolumesListAdminTestJSON-2068505491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08f2262-2800-4ea9-a695-c903a3a919b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1246594352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6aa39713-fa4b-4236-925a-1d895c138dd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ef7c196a2a435992fa90e41bf876ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:37:02Z,use_quota=True,user_id='8fc6f76b2d574cdba191d9767b724db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:03.263944 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ec23785a-7bcc-4965-86ac-5487c4aa4cd4 tempest-VolumesListAdminTestJSON-2068505491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a73516c-42d1-4ca6-bc21-38306c1f86ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:03.266276 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ec23785a-7bcc-4965-86ac-5487c4aa4cd4 tempest-VolumesListAdminTestJSON-2068505491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a73516c-42d1-4ca6-bc21-38306c1f86ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:03.268694 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ec23785a-7bcc-4965-86ac-5487c4aa4cd4 tempest-VolumesListAdminTestJSON-2068505491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fed0f768-ec25-4d3f-afbc-2bd560bf4377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:03.270970 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ec23785a-7bcc-4965-86ac-5487c4aa4cd4 tempest-VolumesListAdminTestJSON-2068505491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fed0f768-ec25-4d3f-afbc-2bd560bf4377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6aa39713-fa4b-4236-925a-1d895c138dd3', 'volume_name': 'volume-6aa39713-fa4b-4236-925a-1d895c138dd3', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:03.278275 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ec23785a-7bcc-4965-86ac-5487c4aa4cd4 tempest-VolumesListAdminTestJSON-2068505491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae46fc7b-1d19-4912-bc32-e4052157fa44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:03.278275 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ec23785a-7bcc-4965-86ac-5487c4aa4cd4 tempest-VolumesListAdminTestJSON-2068505491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae46fc7b-1d19-4912-bc32-e4052157fa44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:03.278275 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ec23785a-7bcc-4965-86ac-5487c4aa4cd4 tempest-VolumesListAdminTestJSON-2068505491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b10b949-4fce-4c54-82a0-ae5f905c3d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:03.278596 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-ec23785a-7bcc-4965-86ac-5487c4aa4cd4 tempest-VolumesListAdminTestJSON-2068505491 None] Volume 6aa39713-fa4b-4236-925a-1d895c138dd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6aa39713-fa4b-4236-925a-1d895c138dd3', 'volume_size': 1} Dec 25 21:37:03.279415 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ec23785a-7bcc-4965-86ac-5487c4aa4cd4 tempest-VolumesListAdminTestJSON-2068505491 None] creating volume 'volume-6aa39713-fa4b-4236-925a-1d895c138dd3' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:37:03.280369 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ec23785a-7bcc-4965-86ac-5487c4aa4cd4 tempest-VolumesListAdminTestJSON-2068505491 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:03.446328 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f27074f0-42c6-4234-8e76-969920103d4b tempest-VolumesGetTest-758022543 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:03.493061 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f27074f0-42c6-4234-8e76-969920103d4b tempest-VolumesGetTest-758022543 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:03.529689 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-f27074f0-42c6-4234-8e76-969920103d4b tempest-VolumesGetTest-758022543 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:37:03.533557 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-f27074f0-42c6-4234-8e76-969920103d4b tempest-VolumesGetTest-758022543 None] Deleted volume successfully. Dec 25 21:37:03.616120 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-f27074f0-42c6-4234-8e76-969920103d4b tempest-VolumesGetTest-758022543 None] Lock "b'cinder-b3f8fdbd-a610-43a7-8666-8f1e761c0e55-delete_volume'" released by "delete_volume" :: held 10.807s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:37:03.639974 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-7a5d077c-e79b-49dc-ac27-68f90e76f2a9 tempest-VolumesGetTest-758022543 None] Lock "b'cinder-72a6908b-74f0-4a70-b157-f08788a4d9ee-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:37:03.735310 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7a5d077c-e79b-49dc-ac27-68f90e76f2a9 tempest-VolumesGetTest-758022543 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:04.004716 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7a5d077c-e79b-49dc-ac27-68f90e76f2a9 tempest-VolumesGetTest-758022543 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:37:04.229656 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7a5d077c-e79b-49dc-ac27-68f90e76f2a9 tempest-VolumesGetTest-758022543 None] deleting rbd volume volume-72a6908b-74f0-4a70-b157-f08788a4d9ee {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:37:04.432131 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ec23785a-7bcc-4965-86ac-5487c4aa4cd4 tempest-VolumesListAdminTestJSON-2068505491 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:37:04.438707 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ec23785a-7bcc-4965-86ac-5487c4aa4cd4 tempest-VolumesListAdminTestJSON-2068505491 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:37:04.438707 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ec23785a-7bcc-4965-86ac-5487c4aa4cd4 tempest-VolumesListAdminTestJSON-2068505491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b10b949-4fce-4c54-82a0-ae5f905c3d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6aa39713-fa4b-4236-925a-1d895c138dd3', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:04.438707 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ec23785a-7bcc-4965-86ac-5487c4aa4cd4 tempest-VolumesListAdminTestJSON-2068505491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (983bb95b-99c4-4142-b701-6d236bb073cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:04.519269 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-ec23785a-7bcc-4965-86ac-5487c4aa4cd4 tempest-VolumesListAdminTestJSON-2068505491 None] Volume volume-6aa39713-fa4b-4236-925a-1d895c138dd3 (6aa39713-fa4b-4236-925a-1d895c138dd3): created successfully Dec 25 21:37:04.521548 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ec23785a-7bcc-4965-86ac-5487c4aa4cd4 tempest-VolumesListAdminTestJSON-2068505491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (983bb95b-99c4-4142-b701-6d236bb073cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:04.525080 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ec23785a-7bcc-4965-86ac-5487c4aa4cd4 tempest-VolumesListAdminTestJSON-2068505491 None] Flow 'volume_create_manager' (84bfa6b4-95bf-4ddf-ab9c-69b3ebe45362) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:37:04.611344 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-ec23785a-7bcc-4965-86ac-5487c4aa4cd4 tempest-VolumesListAdminTestJSON-2068505491 None] Created volume successfully. Dec 25 21:37:05.413104 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7890e4f0-003a-42c6-a976-29a486d18b35 tempest-VolumesSnapshotTestJSON-639273304 None] Volume volume-98b6d31e-e760-499e-8962-7b22479c1e9a.deleted is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:37:05.415202 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7890e4f0-003a-42c6-a976-29a486d18b35 tempest-VolumesSnapshotTestJSON-639273304 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:37:05.415580 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7890e4f0-003a-42c6-a976-29a486d18b35 tempest-VolumesSnapshotTestJSON-639273304 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:37:06.168937 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7890e4f0-003a-42c6-a976-29a486d18b35 tempest-VolumesSnapshotTestJSON-639273304 None] clone created successfully {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 25 21:37:06.169486 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.volume_utils [None req-7890e4f0-003a-42c6-a976-29a486d18b35 tempest-VolumesSnapshotTestJSON-639273304 None] Marking volume 84b7c2f5-06e2-4582-b712-ba8e2cf1d2a7 as bootable. {{(pid=129926) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 25 21:37:06.250610 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-7890e4f0-003a-42c6-a976-29a486d18b35 tempest-VolumesSnapshotTestJSON-639273304 None] Copying metadata from image aca914d0-5f7b-465f-a024-75efa27d7291 to 84b7c2f5-06e2-4582-b712-ba8e2cf1d2a7. {{(pid=129926) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Dec 25 21:37:06.251109 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-7890e4f0-003a-42c6-a976-29a486d18b35 tempest-VolumesSnapshotTestJSON-639273304 None] Creating volume glance metadata for volume 84b7c2f5-06e2-4582-b712-ba8e2cf1d2a7 backed by image aca914d0-5f7b-465f-a024-75efa27d7291 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129926) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Dec 25 21:37:06.282553 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-b958e41d-f6be-4ace-bdad-aaa42f3b2aca tempest-VolumesTransfersTest-1157305279 None] Created reservations ['38b30bf4-83db-4a11-8117-33b868e431ba', '0b39d06c-29eb-42b9-b47d-ca5fbb6971d2', '6bd7b8f9-05a7-489c-ac03-2704b7df804e', '8824d9c1-6712-4bb3-9a02-045828d9594d'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:37:06.399271 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-7890e4f0-003a-42c6-a976-29a486d18b35 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8bdeb53-8ab8-446d-9c7d-b446cd45917c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84b7c2f5-06e2-4582-b712-ba8e2cf1d2a7', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:06.399436 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-7890e4f0-003a-42c6-a976-29a486d18b35 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1c5f4f8-3a3b-4e7d-bab8-81223633aab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:06.515047 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b958e41d-f6be-4ace-bdad-aaa42f3b2aca tempest-VolumesTransfersTest-1157305279 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:06.562567 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b958e41d-f6be-4ace-bdad-aaa42f3b2aca tempest-VolumesTransfersTest-1157305279 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:06.591391 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-b958e41d-f6be-4ace-bdad-aaa42f3b2aca tempest-VolumesTransfersTest-1157305279 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:37:06.593278 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-7890e4f0-003a-42c6-a976-29a486d18b35 tempest-VolumesSnapshotTestJSON-639273304 None] Volume volume-84b7c2f5-06e2-4582-b712-ba8e2cf1d2a7 (84b7c2f5-06e2-4582-b712-ba8e2cf1d2a7): created successfully Dec 25 21:37:06.595249 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-7890e4f0-003a-42c6-a976-29a486d18b35 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1c5f4f8-3a3b-4e7d-bab8-81223633aab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:06.598336 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-7890e4f0-003a-42c6-a976-29a486d18b35 tempest-VolumesSnapshotTestJSON-639273304 None] Flow 'volume_create_manager' (3ccb387a-6a78-405a-9182-5c8c69fe0b73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:37:06.603890 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-b958e41d-f6be-4ace-bdad-aaa42f3b2aca tempest-VolumesTransfersTest-1157305279 None] Deleted volume successfully. Dec 25 21:37:06.687549 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-7890e4f0-003a-42c6-a976-29a486d18b35 tempest-VolumesSnapshotTestJSON-639273304 None] Created volume successfully. Dec 25 21:37:06.694732 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-b958e41d-f6be-4ace-bdad-aaa42f3b2aca tempest-VolumesTransfersTest-1157305279 None] Lock "b'cinder-da03fcc1-04b5-449e-880a-fa85e58fdcac-delete_volume'" released by "delete_volume" :: held 10.006s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:37:06.926693 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a7d932a-590b-4c3b-973a-20aa06c6df1e tempest-VolumesListAdminTestJSON-1224248736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:37:06.930526 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-8a7d932a-590b-4c3b-973a-20aa06c6df1e tempest-VolumesListAdminTestJSON-1224248736 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:37:06.930969 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-8a7d932a-590b-4c3b-973a-20aa06c6df1e tempest-VolumesListAdminTestJSON-1224248736 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:37:06.944016 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8a7d932a-590b-4c3b-973a-20aa06c6df1e tempest-VolumesListAdminTestJSON-1224248736 None] Flow 'volume_create_manager' (5b696155-ac09-49be-840e-09972891f5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:37:06.947162 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8a7d932a-590b-4c3b-973a-20aa06c6df1e tempest-VolumesListAdminTestJSON-1224248736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e680ffc-7e89-4f0d-a5da-9fe5e66d0044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:06.954584 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-8a7d932a-590b-4c3b-973a-20aa06c6df1e tempest-VolumesListAdminTestJSON-1224248736 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:37:06.970921 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8a7d932a-590b-4c3b-973a-20aa06c6df1e tempest-VolumesListAdminTestJSON-1224248736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e680ffc-7e89-4f0d-a5da-9fe5e66d0044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=bd4460ca-5bf5-4fa7-a786-f8a7c65c0f4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06dbe1300f454f17a89abb4c804755f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:37:07Z,use_quota=True,user_id='013c354a753342489256c030b35265f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:06.973557 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8a7d932a-590b-4c3b-973a-20aa06c6df1e tempest-VolumesListAdminTestJSON-1224248736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3a59c29-09c8-4ebc-bdad-ca48eac8179e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:06.975674 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8a7d932a-590b-4c3b-973a-20aa06c6df1e tempest-VolumesListAdminTestJSON-1224248736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3a59c29-09c8-4ebc-bdad-ca48eac8179e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:06.978078 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8a7d932a-590b-4c3b-973a-20aa06c6df1e tempest-VolumesListAdminTestJSON-1224248736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fba49fd0-2ab8-45e4-8ef3-0d0d1a9e35b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:06.980305 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8a7d932a-590b-4c3b-973a-20aa06c6df1e tempest-VolumesListAdminTestJSON-1224248736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fba49fd0-2ab8-45e4-8ef3-0d0d1a9e35b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd4460ca-5bf5-4fa7-a786-f8a7c65c0f4e', 'volume_name': 'volume-bd4460ca-5bf5-4fa7-a786-f8a7c65c0f4e', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:06.982669 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8a7d932a-590b-4c3b-973a-20aa06c6df1e tempest-VolumesListAdminTestJSON-1224248736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8229dea-aaee-4b58-936f-30dd35017420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:06.984785 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8a7d932a-590b-4c3b-973a-20aa06c6df1e tempest-VolumesListAdminTestJSON-1224248736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8229dea-aaee-4b58-936f-30dd35017420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:06.986989 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8a7d932a-590b-4c3b-973a-20aa06c6df1e tempest-VolumesListAdminTestJSON-1224248736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (054c462e-1866-407a-a39b-b3a231b25322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:06.987776 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-8a7d932a-590b-4c3b-973a-20aa06c6df1e tempest-VolumesListAdminTestJSON-1224248736 None] Volume bd4460ca-5bf5-4fa7-a786-f8a7c65c0f4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd4460ca-5bf5-4fa7-a786-f8a7c65c0f4e', 'volume_size': 1} Dec 25 21:37:06.988156 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-8a7d932a-590b-4c3b-973a-20aa06c6df1e tempest-VolumesListAdminTestJSON-1224248736 None] creating volume 'volume-bd4460ca-5bf5-4fa7-a786-f8a7c65c0f4e' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:37:06.989136 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-8a7d932a-590b-4c3b-973a-20aa06c6df1e tempest-VolumesListAdminTestJSON-1224248736 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:07.933291 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-d93f50d2-6c9e-4202-aae9-655299177a1c req-2849e81f-df0b-4901-9c18-340d10dc54ef tempest-VolumesSnapshotTestJSON-639273304 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:37:08.067651 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-8a7d932a-590b-4c3b-973a-20aa06c6df1e tempest-VolumesListAdminTestJSON-1224248736 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:37:08.068044 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-8a7d932a-590b-4c3b-973a-20aa06c6df1e tempest-VolumesListAdminTestJSON-1224248736 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:37:08.070919 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8a7d932a-590b-4c3b-973a-20aa06c6df1e tempest-VolumesListAdminTestJSON-1224248736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (054c462e-1866-407a-a39b-b3a231b25322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd4460ca-5bf5-4fa7-a786-f8a7c65c0f4e', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:08.073374 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8a7d932a-590b-4c3b-973a-20aa06c6df1e tempest-VolumesListAdminTestJSON-1224248736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b80efbbe-37a2-4020-beb9-3318c3a16d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:08.085782 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-e28d8d91-89f8-4530-99a2-2aaaa75e8059 tempest-VolumesTransfersTest-181954938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:37:08.090277 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-e28d8d91-89f8-4530-99a2-2aaaa75e8059 tempest-VolumesTransfersTest-181954938 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:37:08.091056 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-e28d8d91-89f8-4530-99a2-2aaaa75e8059 tempest-VolumesTransfersTest-181954938 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:37:08.108820 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e28d8d91-89f8-4530-99a2-2aaaa75e8059 tempest-VolumesTransfersTest-181954938 None] Flow 'volume_create_manager' (534e4c43-7d4b-44f4-a6db-fda1ddf0d56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:37:08.112039 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e28d8d91-89f8-4530-99a2-2aaaa75e8059 tempest-VolumesTransfersTest-181954938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2528124a-02ff-4ef1-91e4-51d6eb57cd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:08.118293 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-e28d8d91-89f8-4530-99a2-2aaaa75e8059 tempest-VolumesTransfersTest-181954938 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:37:08.132001 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e28d8d91-89f8-4530-99a2-2aaaa75e8059 tempest-VolumesTransfersTest-181954938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2528124a-02ff-4ef1-91e4-51d6eb57cd73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-533694563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0a11657b-435a-4704-8b03-c6ef48b0a9bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='803653fa8681491b916c0b57c57c3f29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:37:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:37:08Z,use_quota=True,user_id='d908fbffef7047db86b4d40f70973397',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:08.134612 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e28d8d91-89f8-4530-99a2-2aaaa75e8059 tempest-VolumesTransfersTest-181954938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94580022-ba39-44da-8dbc-42ef677fb23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:08.136825 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e28d8d91-89f8-4530-99a2-2aaaa75e8059 tempest-VolumesTransfersTest-181954938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94580022-ba39-44da-8dbc-42ef677fb23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:08.139637 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e28d8d91-89f8-4530-99a2-2aaaa75e8059 tempest-VolumesTransfersTest-181954938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80690fa9-c813-4e9d-b438-8d934a6adf0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:08.142032 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e28d8d91-89f8-4530-99a2-2aaaa75e8059 tempest-VolumesTransfersTest-181954938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80690fa9-c813-4e9d-b438-8d934a6adf0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a11657b-435a-4704-8b03-c6ef48b0a9bb', 'volume_name': 'volume-0a11657b-435a-4704-8b03-c6ef48b0a9bb', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:08.145603 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e28d8d91-89f8-4530-99a2-2aaaa75e8059 tempest-VolumesTransfersTest-181954938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f68a51e-4e15-4970-8c6a-432a47113c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:08.146548 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e28d8d91-89f8-4530-99a2-2aaaa75e8059 tempest-VolumesTransfersTest-181954938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f68a51e-4e15-4970-8c6a-432a47113c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:08.148728 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e28d8d91-89f8-4530-99a2-2aaaa75e8059 tempest-VolumesTransfersTest-181954938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e49684dc-96b5-4cb3-9be3-e379f309793c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:08.149569 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-e28d8d91-89f8-4530-99a2-2aaaa75e8059 tempest-VolumesTransfersTest-181954938 None] Volume 0a11657b-435a-4704-8b03-c6ef48b0a9bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a11657b-435a-4704-8b03-c6ef48b0a9bb', 'volume_size': 1} Dec 25 21:37:08.149967 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e28d8d91-89f8-4530-99a2-2aaaa75e8059 tempest-VolumesTransfersTest-181954938 None] creating volume 'volume-0a11657b-435a-4704-8b03-c6ef48b0a9bb' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:37:08.151091 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e28d8d91-89f8-4530-99a2-2aaaa75e8059 tempest-VolumesTransfersTest-181954938 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:08.174474 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-8a7d932a-590b-4c3b-973a-20aa06c6df1e tempest-VolumesListAdminTestJSON-1224248736 None] Volume volume-bd4460ca-5bf5-4fa7-a786-f8a7c65c0f4e (bd4460ca-5bf5-4fa7-a786-f8a7c65c0f4e): created successfully Dec 25 21:37:08.176533 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8a7d932a-590b-4c3b-973a-20aa06c6df1e tempest-VolumesListAdminTestJSON-1224248736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b80efbbe-37a2-4020-beb9-3318c3a16d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:08.179893 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-8a7d932a-590b-4c3b-973a-20aa06c6df1e tempest-VolumesListAdminTestJSON-1224248736 None] Flow 'volume_create_manager' (5b696155-ac09-49be-840e-09972891f5fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:37:08.285220 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-8a7d932a-590b-4c3b-973a-20aa06c6df1e tempest-VolumesListAdminTestJSON-1224248736 None] Created volume successfully. Dec 25 21:37:08.640829 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-d93f50d2-6c9e-4202-aae9-655299177a1c req-2849e81f-df0b-4901-9c18-340d10dc54ef tempest-VolumesSnapshotTestJSON-639273304 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.708s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:37:08.641514 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-d93f50d2-6c9e-4202-aae9-655299177a1c req-2849e81f-df0b-4901-9c18-340d10dc54ef tempest-VolumesSnapshotTestJSON-639273304 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-84b7c2f5-06e2-4582-b712-ba8e2cf1d2a7', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': '84b7c2f5-06e2-4582-b712-ba8e2cf1d2a7', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 21:37:08.765353 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-d93f50d2-6c9e-4202-aae9-655299177a1c req-2849e81f-df0b-4901-9c18-340d10dc54ef tempest-VolumesSnapshotTestJSON-639273304 None] Connection info returned from driver {'name': 'volumes/volume-84b7c2f5-06e2-4582-b712-ba8e2cf1d2a7', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '84b7c2f5-06e2-4582-b712-ba8e2cf1d2a7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b1f91e1c-74f1-45b0-b787-1ea198c7711b'} {{(pid=129926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 25 21:37:08.868479 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-d93f50d2-6c9e-4202-aae9-655299177a1c req-2849e81f-df0b-4901-9c18-340d10dc54ef tempest-VolumesSnapshotTestJSON-639273304 None] attachment_update completed successfully. Dec 25 21:37:09.089477 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-0e647b09-c586-4377-ad95-4a27b87642c3 tempest-VolumesListAdminTestJSON-1224248736 None] Lock "b'cinder-bd4460ca-5bf5-4fa7-a786-f8a7c65c0f4e-delete_volume'" acquired by "delete_volume" :: waited 0.028s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:37:09.194481 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0e647b09-c586-4377-ad95-4a27b87642c3 tempest-VolumesListAdminTestJSON-1224248736 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:09.486716 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0e647b09-c586-4377-ad95-4a27b87642c3 tempest-VolumesListAdminTestJSON-1224248736 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:37:09.487154 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0e647b09-c586-4377-ad95-4a27b87642c3 tempest-VolumesListAdminTestJSON-1224248736 None] Volume volume-bd4460ca-5bf5-4fa7-a786-f8a7c65c0f4e is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:37:09.732562 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0e647b09-c586-4377-ad95-4a27b87642c3 tempest-VolumesListAdminTestJSON-1224248736 None] deleting rbd volume volume-bd4460ca-5bf5-4fa7-a786-f8a7c65c0f4e {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:37:09.743523 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e28d8d91-89f8-4530-99a2-2aaaa75e8059 tempest-VolumesTransfersTest-181954938 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:37:09.744369 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e28d8d91-89f8-4530-99a2-2aaaa75e8059 tempest-VolumesTransfersTest-181954938 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:37:09.754620 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e28d8d91-89f8-4530-99a2-2aaaa75e8059 tempest-VolumesTransfersTest-181954938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e49684dc-96b5-4cb3-9be3-e379f309793c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a11657b-435a-4704-8b03-c6ef48b0a9bb', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:09.769227 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e28d8d91-89f8-4530-99a2-2aaaa75e8059 tempest-VolumesTransfersTest-181954938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b2a9a05-d3e7-498a-bbc9-38489e6a979f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:09.787904 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-2e08c987-92bb-4724-ae63-d5f223a24ca7 tempest-VolumesListAdminTestJSON-2068505491 None] Lock "b'cinder-6aa39713-fa4b-4236-925a-1d895c138dd3-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:37:09.856699 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-e28d8d91-89f8-4530-99a2-2aaaa75e8059 tempest-VolumesTransfersTest-181954938 None] Volume volume-0a11657b-435a-4704-8b03-c6ef48b0a9bb (0a11657b-435a-4704-8b03-c6ef48b0a9bb): created successfully Dec 25 21:37:09.859306 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e28d8d91-89f8-4530-99a2-2aaaa75e8059 tempest-VolumesTransfersTest-181954938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b2a9a05-d3e7-498a-bbc9-38489e6a979f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:09.863792 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e28d8d91-89f8-4530-99a2-2aaaa75e8059 tempest-VolumesTransfersTest-181954938 None] Flow 'volume_create_manager' (534e4c43-7d4b-44f4-a6db-fda1ddf0d56c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:37:09.902924 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-2e08c987-92bb-4724-ae63-d5f223a24ca7 tempest-VolumesListAdminTestJSON-2068505491 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:10.198583 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-2e08c987-92bb-4724-ae63-d5f223a24ca7 tempest-VolumesListAdminTestJSON-2068505491 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:37:10.199242 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-2e08c987-92bb-4724-ae63-d5f223a24ca7 tempest-VolumesListAdminTestJSON-2068505491 None] Volume volume-6aa39713-fa4b-4236-925a-1d895c138dd3 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:37:10.452029 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-2e08c987-92bb-4724-ae63-d5f223a24ca7 tempest-VolumesListAdminTestJSON-2068505491 None] deleting rbd volume volume-6aa39713-fa4b-4236-925a-1d895c138dd3 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:37:10.455510 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-e28d8d91-89f8-4530-99a2-2aaaa75e8059 tempest-VolumesTransfersTest-181954938 None] Created volume successfully. Dec 25 21:37:10.832944 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-6776d0f7-d291-4f02-97eb-7a4d686870d9 tempest-VolumesTransfersTest-1157305279 None] Lock "b'cinder-0a11657b-435a-4704-8b03-c6ef48b0a9bb-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:37:11.016646 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-6776d0f7-d291-4f02-97eb-7a4d686870d9 tempest-VolumesTransfersTest-1157305279 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:11.290802 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-6776d0f7-d291-4f02-97eb-7a4d686870d9 tempest-VolumesTransfersTest-1157305279 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:37:11.291456 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-6776d0f7-d291-4f02-97eb-7a4d686870d9 tempest-VolumesTransfersTest-1157305279 None] Volume volume-0a11657b-435a-4704-8b03-c6ef48b0a9bb is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:37:11.536911 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-6776d0f7-d291-4f02-97eb-7a4d686870d9 tempest-VolumesTransfersTest-1157305279 None] deleting rbd volume volume-0a11657b-435a-4704-8b03-c6ef48b0a9bb {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:37:11.929107 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7a5d077c-e79b-49dc-ac27-68f90e76f2a9 tempest-VolumesGetTest-758022543 None] volume is a clone so cleaning references {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 25 21:37:12.227953 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7a5d077c-e79b-49dc-ac27-68f90e76f2a9 tempest-VolumesGetTest-758022543 None] deleting parent snapshot volume-72a6908b-74f0-4a70-b157-f08788a4d9ee.clone_snap {{(pid=129926) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 25 21:37:16.054308 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e9d77862-a352-4690-8ea6-91cd1e95e65e tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:16.310680 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-7a5d077c-e79b-49dc-ac27-68f90e76f2a9 tempest-VolumesGetTest-758022543 None] Created reservations ['27253f02-a288-4882-971f-adcd9cb3e58b', 'e5f0f5de-3637-4473-b210-c16077ac5675', 'a97c4260-b056-404a-88e4-bc09d1f8dad4', '1a4a5c64-a5f2-4887-9625-61c13b2f1ba8'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:37:16.514771 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7a5d077c-e79b-49dc-ac27-68f90e76f2a9 tempest-VolumesGetTest-758022543 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:16.551256 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7a5d077c-e79b-49dc-ac27-68f90e76f2a9 tempest-VolumesGetTest-758022543 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:16.578542 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-7a5d077c-e79b-49dc-ac27-68f90e76f2a9 tempest-VolumesGetTest-758022543 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:37:16.582620 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-7a5d077c-e79b-49dc-ac27-68f90e76f2a9 tempest-VolumesGetTest-758022543 None] Deleted volume successfully. Dec 25 21:37:16.674296 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-7a5d077c-e79b-49dc-ac27-68f90e76f2a9 tempest-VolumesGetTest-758022543 None] Lock "b'cinder-72a6908b-74f0-4a70-b157-f08788a4d9ee-delete_volume'" released by "delete_volume" :: held 13.034s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:37:17.699256 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-129ecd20-a49d-4cb3-999d-4735f8d29b48 tempest-VolumesGetTest-758022543 None] Lock "b'cinder-80c90346-162a-4a22-98bc-367019c5448e-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:37:17.821245 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-129ecd20-a49d-4cb3-999d-4735f8d29b48 tempest-VolumesGetTest-758022543 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:18.057317 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-129ecd20-a49d-4cb3-999d-4735f8d29b48 tempest-VolumesGetTest-758022543 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:37:18.057788 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-129ecd20-a49d-4cb3-999d-4735f8d29b48 tempest-VolumesGetTest-758022543 None] Volume volume-80c90346-162a-4a22-98bc-367019c5448e is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:37:18.284598 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-129ecd20-a49d-4cb3-999d-4735f8d29b48 tempest-VolumesGetTest-758022543 None] deleting rbd volume volume-80c90346-162a-4a22-98bc-367019c5448e {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:37:18.440666 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-0e647b09-c586-4377-ad95-4a27b87642c3 tempest-VolumesListAdminTestJSON-1224248736 None] Created reservations ['a04eff20-3d4b-4012-9bfd-f4a04de3705c', '151cbf3f-c107-4671-91e7-16d5dedf4630', '32d41abd-1af4-4fe5-808d-c40f41e9d97d', 'a0ab8171-285b-4f16-a4bb-803a999b0615'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:37:18.651841 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0e647b09-c586-4377-ad95-4a27b87642c3 tempest-VolumesListAdminTestJSON-1224248736 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:18.697862 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0e647b09-c586-4377-ad95-4a27b87642c3 tempest-VolumesListAdminTestJSON-1224248736 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:18.822495 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-0e647b09-c586-4377-ad95-4a27b87642c3 tempest-VolumesListAdminTestJSON-1224248736 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:37:18.823752 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-0e647b09-c586-4377-ad95-4a27b87642c3 tempest-VolumesListAdminTestJSON-1224248736 None] Deleted volume successfully. Dec 25 21:37:18.954381 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-0e647b09-c586-4377-ad95-4a27b87642c3 tempest-VolumesListAdminTestJSON-1224248736 None] Lock "b'cinder-bd4460ca-5bf5-4fa7-a786-f8a7c65c0f4e-delete_volume'" released by "delete_volume" :: held 9.865s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:37:18.970436 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-2e08c987-92bb-4724-ae63-d5f223a24ca7 tempest-VolumesListAdminTestJSON-2068505491 None] Created reservations ['508eec7d-79f9-4c7a-a59d-32d7bce92f0d', 'e8950793-8443-4916-9127-f243609aacae', '9fbd549c-ca8f-4007-80c8-964aacbad672', '9e8ce0a3-4bda-4b78-8db6-2b15034043e5'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:37:19.241542 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-2e08c987-92bb-4724-ae63-d5f223a24ca7 tempest-VolumesListAdminTestJSON-2068505491 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:19.286692 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-2e08c987-92bb-4724-ae63-d5f223a24ca7 tempest-VolumesListAdminTestJSON-2068505491 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:19.320455 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-2e08c987-92bb-4724-ae63-d5f223a24ca7 tempest-VolumesListAdminTestJSON-2068505491 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:37:19.326544 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-2e08c987-92bb-4724-ae63-d5f223a24ca7 tempest-VolumesListAdminTestJSON-2068505491 None] Deleted volume successfully. Dec 25 21:37:19.426470 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-2e08c987-92bb-4724-ae63-d5f223a24ca7 tempest-VolumesListAdminTestJSON-2068505491 None] Lock "b'cinder-6aa39713-fa4b-4236-925a-1d895c138dd3-delete_volume'" released by "delete_volume" :: held 9.638s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:37:19.468605 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-6776d0f7-d291-4f02-97eb-7a4d686870d9 tempest-VolumesTransfersTest-1157305279 None] Created reservations ['947d9157-8ce8-4e73-83cd-0c189bc0d650', 'a5e62117-f0a8-4782-8ca9-3b19526542eb', '3d8912be-3072-4f11-b1ab-cf49b517e262', 'efefff58-38ed-4a0a-b3ed-527d7c47768d'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:37:19.472068 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-e9d77862-a352-4690-8ea6-91cd1e95e65e tempest-VolumesSnapshotTestJSON-639273304 None] Create snapshot completed successfully Dec 25 21:37:19.657238 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-6776d0f7-d291-4f02-97eb-7a4d686870d9 tempest-VolumesTransfersTest-1157305279 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:19.683398 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-6776d0f7-d291-4f02-97eb-7a4d686870d9 tempest-VolumesTransfersTest-1157305279 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:19.712479 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-6776d0f7-d291-4f02-97eb-7a4d686870d9 tempest-VolumesTransfersTest-1157305279 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:37:19.718358 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-6776d0f7-d291-4f02-97eb-7a4d686870d9 tempest-VolumesTransfersTest-1157305279 None] Deleted volume successfully. Dec 25 21:37:19.771816 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-6776d0f7-d291-4f02-97eb-7a4d686870d9 tempest-VolumesTransfersTest-1157305279 None] Lock "b'cinder-0a11657b-435a-4704-8b03-c6ef48b0a9bb-delete_volume'" released by "delete_volume" :: held 8.939s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:37:20.442983 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-7c97e5be-bb3b-4d42-9fb3-62f5e014a75f tempest-VolumesListAdminTestJSON-2068505491 None] Lock "b'cinder-206a3c76-425f-4eea-a887-b250b0871cd9-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:37:20.636187 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7c97e5be-bb3b-4d42-9fb3-62f5e014a75f tempest-VolumesListAdminTestJSON-2068505491 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:20.874197 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7c97e5be-bb3b-4d42-9fb3-62f5e014a75f tempest-VolumesListAdminTestJSON-2068505491 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:37:20.874548 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7c97e5be-bb3b-4d42-9fb3-62f5e014a75f tempest-VolumesListAdminTestJSON-2068505491 None] Volume volume-206a3c76-425f-4eea-a887-b250b0871cd9 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:37:21.137356 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7c97e5be-bb3b-4d42-9fb3-62f5e014a75f tempest-VolumesListAdminTestJSON-2068505491 None] deleting rbd volume volume-206a3c76-425f-4eea-a887-b250b0871cd9 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:37:21.249709 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-4ddb8eda-a452-4d80-9b1a-7e211196c771 tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:24.507979 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-4ddb8eda-a452-4d80-9b1a-7e211196c771 tempest-VolumesSnapshotTestJSON-639273304 None] Create snapshot completed successfully Dec 25 21:37:25.454173 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-cc770fcf-c4c6-41dd-99b0-cbf7ecbe4ad7 tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:26.304431 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-44ecf63c-bbba-488f-80d5-ea4091a11c06 tempest-VolumesListTestJSON-1107590893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:37:26.308094 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-44ecf63c-bbba-488f-80d5-ea4091a11c06 tempest-VolumesListTestJSON-1107590893 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:37:26.308564 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-44ecf63c-bbba-488f-80d5-ea4091a11c06 tempest-VolumesListTestJSON-1107590893 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:37:26.321582 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-44ecf63c-bbba-488f-80d5-ea4091a11c06 tempest-VolumesListTestJSON-1107590893 None] Flow 'volume_create_manager' (8a9ad9cc-ba7e-484f-88cc-308c83d2cf0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:37:26.326050 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-44ecf63c-bbba-488f-80d5-ea4091a11c06 tempest-VolumesListTestJSON-1107590893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51981f03-018c-4b56-b465-ca93709889d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:26.333279 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-01cc84c9-a418-425f-93b7-b49bf3224286 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:37:26.353002 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-44ecf63c-bbba-488f-80d5-ea4091a11c06 tempest-VolumesListTestJSON-1107590893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51981f03-018c-4b56-b465-ca93709889d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-458037244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9407be47-d0c2-466d-b76d-8975a0b9f587,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b04ad82620434ef5aea1d04bbca6bfab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:37:26Z,use_quota=True,user_id='4848cbb7b58c4f339ab5352e3f1919cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:26.356272 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-44ecf63c-bbba-488f-80d5-ea4091a11c06 tempest-VolumesListTestJSON-1107590893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6c3c7c8-04d7-4c5b-a6e1-710bbda49eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:26.358136 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-44ecf63c-bbba-488f-80d5-ea4091a11c06 tempest-VolumesListTestJSON-1107590893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6c3c7c8-04d7-4c5b-a6e1-710bbda49eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:26.361019 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-44ecf63c-bbba-488f-80d5-ea4091a11c06 tempest-VolumesListTestJSON-1107590893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf38add9-dd98-4f65-bc07-e58bf630061a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:26.363551 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-44ecf63c-bbba-488f-80d5-ea4091a11c06 tempest-VolumesListTestJSON-1107590893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf38add9-dd98-4f65-bc07-e58bf630061a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9407be47-d0c2-466d-b76d-8975a0b9f587', 'volume_name': 'volume-9407be47-d0c2-466d-b76d-8975a0b9f587', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:26.366383 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-44ecf63c-bbba-488f-80d5-ea4091a11c06 tempest-VolumesListTestJSON-1107590893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74dfc8e1-1631-48a1-be5a-62f643cede66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:26.368659 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-44ecf63c-bbba-488f-80d5-ea4091a11c06 tempest-VolumesListTestJSON-1107590893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74dfc8e1-1631-48a1-be5a-62f643cede66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:26.371449 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-44ecf63c-bbba-488f-80d5-ea4091a11c06 tempest-VolumesListTestJSON-1107590893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62604280-aa20-4a25-9dd0-400f8241d601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:26.372426 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-44ecf63c-bbba-488f-80d5-ea4091a11c06 tempest-VolumesListTestJSON-1107590893 None] Volume 9407be47-d0c2-466d-b76d-8975a0b9f587: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9407be47-d0c2-466d-b76d-8975a0b9f587', 'volume_size': 1} Dec 25 21:37:26.373009 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-44ecf63c-bbba-488f-80d5-ea4091a11c06 tempest-VolumesListTestJSON-1107590893 None] creating volume 'volume-9407be47-d0c2-466d-b76d-8975a0b9f587' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:37:26.374203 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-44ecf63c-bbba-488f-80d5-ea4091a11c06 tempest-VolumesListTestJSON-1107590893 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:26.537110 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-129ecd20-a49d-4cb3-999d-4735f8d29b48 tempest-VolumesGetTest-758022543 None] Created reservations ['6a7cb340-ce5a-4084-9f9a-52eff3382390', '6c720de4-b31f-49c5-a6ff-6c45aaf97b72', '96c76124-0aa0-4346-860e-bd99f3a9343e', 'f8371b52-c870-4da5-b5a6-64102563f70e'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:37:26.731607 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-129ecd20-a49d-4cb3-999d-4735f8d29b48 tempest-VolumesGetTest-758022543 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:26.755765 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-129ecd20-a49d-4cb3-999d-4735f8d29b48 tempest-VolumesGetTest-758022543 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:27.016683 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-129ecd20-a49d-4cb3-999d-4735f8d29b48 tempest-VolumesGetTest-758022543 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:37:27.020784 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-129ecd20-a49d-4cb3-999d-4735f8d29b48 tempest-VolumesGetTest-758022543 None] Deleted volume successfully. Dec 25 21:37:27.091992 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-129ecd20-a49d-4cb3-999d-4735f8d29b48 tempest-VolumesGetTest-758022543 None] Lock "b'cinder-80c90346-162a-4a22-98bc-367019c5448e-delete_volume'" released by "delete_volume" :: held 9.393s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:37:27.623582 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-44ecf63c-bbba-488f-80d5-ea4091a11c06 tempest-VolumesListTestJSON-1107590893 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:37:27.624204 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-44ecf63c-bbba-488f-80d5-ea4091a11c06 tempest-VolumesListTestJSON-1107590893 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:37:27.627083 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-44ecf63c-bbba-488f-80d5-ea4091a11c06 tempest-VolumesListTestJSON-1107590893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62604280-aa20-4a25-9dd0-400f8241d601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9407be47-d0c2-466d-b76d-8975a0b9f587', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:27.630263 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-44ecf63c-bbba-488f-80d5-ea4091a11c06 tempest-VolumesListTestJSON-1107590893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b23e95a5-77a2-4eff-9d4a-b3e0c68b71da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:27.691292 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-44ecf63c-bbba-488f-80d5-ea4091a11c06 tempest-VolumesListTestJSON-1107590893 None] Volume volume-9407be47-d0c2-466d-b76d-8975a0b9f587 (9407be47-d0c2-466d-b76d-8975a0b9f587): created successfully Dec 25 21:37:27.693693 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-44ecf63c-bbba-488f-80d5-ea4091a11c06 tempest-VolumesListTestJSON-1107590893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b23e95a5-77a2-4eff-9d4a-b3e0c68b71da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:27.697791 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-44ecf63c-bbba-488f-80d5-ea4091a11c06 tempest-VolumesListTestJSON-1107590893 None] Flow 'volume_create_manager' (8a9ad9cc-ba7e-484f-88cc-308c83d2cf0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:37:27.794076 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-44ecf63c-bbba-488f-80d5-ea4091a11c06 tempest-VolumesListTestJSON-1107590893 None] Created volume successfully. Dec 25 21:37:29.160081 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-cc770fcf-c4c6-41dd-99b0-cbf7ecbe4ad7 tempest-VolumesSnapshotTestJSON-639273304 None] Create snapshot completed successfully Dec 25 21:37:29.336813 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-deb2336e-6b30-4b89-b5ca-d2fd3f24e97f tempest-VolumesListTestJSON-1107590893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:37:29.340166 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-deb2336e-6b30-4b89-b5ca-d2fd3f24e97f tempest-VolumesListTestJSON-1107590893 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:37:29.340610 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-deb2336e-6b30-4b89-b5ca-d2fd3f24e97f tempest-VolumesListTestJSON-1107590893 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:37:29.355425 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-deb2336e-6b30-4b89-b5ca-d2fd3f24e97f tempest-VolumesListTestJSON-1107590893 None] Flow 'volume_create_manager' (0101516b-9d47-433b-8ac9-34a2d2568c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:37:29.358957 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-deb2336e-6b30-4b89-b5ca-d2fd3f24e97f tempest-VolumesListTestJSON-1107590893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8083c33a-8f5b-4817-8666-15a2f3bb0d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:29.370078 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-deb2336e-6b30-4b89-b5ca-d2fd3f24e97f tempest-VolumesListTestJSON-1107590893 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:37:29.414461 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-deb2336e-6b30-4b89-b5ca-d2fd3f24e97f tempest-VolumesListTestJSON-1107590893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8083c33a-8f5b-4817-8666-15a2f3bb0d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-692802920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1056c22d-b7f2-4751-94de-511636591b15,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b04ad82620434ef5aea1d04bbca6bfab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:37:29Z,use_quota=True,user_id='4848cbb7b58c4f339ab5352e3f1919cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:29.425505 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-deb2336e-6b30-4b89-b5ca-d2fd3f24e97f tempest-VolumesListTestJSON-1107590893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e95145f2-2217-46c6-b8d2-e696228a6d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:29.425904 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-deb2336e-6b30-4b89-b5ca-d2fd3f24e97f tempest-VolumesListTestJSON-1107590893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e95145f2-2217-46c6-b8d2-e696228a6d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:29.430888 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-deb2336e-6b30-4b89-b5ca-d2fd3f24e97f tempest-VolumesListTestJSON-1107590893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b31ad1d-8362-458b-a68e-d4086e40df46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:29.433400 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-deb2336e-6b30-4b89-b5ca-d2fd3f24e97f tempest-VolumesListTestJSON-1107590893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b31ad1d-8362-458b-a68e-d4086e40df46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1056c22d-b7f2-4751-94de-511636591b15', 'volume_name': 'volume-1056c22d-b7f2-4751-94de-511636591b15', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:29.435698 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-deb2336e-6b30-4b89-b5ca-d2fd3f24e97f tempest-VolumesListTestJSON-1107590893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (485d0862-babf-4c4c-b291-efa8c7a6e356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:29.438637 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-deb2336e-6b30-4b89-b5ca-d2fd3f24e97f tempest-VolumesListTestJSON-1107590893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (485d0862-babf-4c4c-b291-efa8c7a6e356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:29.441261 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-deb2336e-6b30-4b89-b5ca-d2fd3f24e97f tempest-VolumesListTestJSON-1107590893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4f72e81-12d8-43ad-bb5c-9b582e87f6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:29.441988 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-deb2336e-6b30-4b89-b5ca-d2fd3f24e97f tempest-VolumesListTestJSON-1107590893 None] Volume 1056c22d-b7f2-4751-94de-511636591b15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1056c22d-b7f2-4751-94de-511636591b15', 'volume_size': 1} Dec 25 21:37:29.442556 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-deb2336e-6b30-4b89-b5ca-d2fd3f24e97f tempest-VolumesListTestJSON-1107590893 None] creating volume 'volume-1056c22d-b7f2-4751-94de-511636591b15' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:37:29.443871 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-deb2336e-6b30-4b89-b5ca-d2fd3f24e97f tempest-VolumesListTestJSON-1107590893 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:29.476453 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-7c97e5be-bb3b-4d42-9fb3-62f5e014a75f tempest-VolumesListAdminTestJSON-2068505491 None] Created reservations ['04b77c90-8a17-48f1-afd4-32996bbe3c48', 'd651efd9-64a8-42a7-8c30-f02a58dd2040', 'bf94ae55-029a-49a3-b1e4-0aa5d39950aa', 'fe90ab4f-493d-41dc-ac7e-faa6331fa4ee'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:37:29.564507 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-932a9083-9850-4d57-82fb-aa21cbdbc619 tempest-VolumesSnapshotTestJSON-639273304 None] Lock "b'cinder-cebfef91-cdff-4698-aa3f-9e9d14f07aef-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.015s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:37:29.566274 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-932a9083-9850-4d57-82fb-aa21cbdbc619 tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:30.203876 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-476b7414-3a98-46e3-b276-e14c4657851d tempest-VolumesListAdminTestJSON-2068505491 None] Lock "b'cinder-c78aaaf9-b653-4d4a-b055-be8c1cc961eb-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:37:30.214725 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7c97e5be-bb3b-4d42-9fb3-62f5e014a75f tempest-VolumesListAdminTestJSON-2068505491 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:30.256986 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7c97e5be-bb3b-4d42-9fb3-62f5e014a75f tempest-VolumesListAdminTestJSON-2068505491 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:30.282154 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-7c97e5be-bb3b-4d42-9fb3-62f5e014a75f tempest-VolumesListAdminTestJSON-2068505491 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:37:30.286855 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-7c97e5be-bb3b-4d42-9fb3-62f5e014a75f tempest-VolumesListAdminTestJSON-2068505491 None] Deleted volume successfully. Dec 25 21:37:30.435693 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-7c97e5be-bb3b-4d42-9fb3-62f5e014a75f tempest-VolumesListAdminTestJSON-2068505491 None] Lock "b'cinder-206a3c76-425f-4eea-a887-b250b0871cd9-delete_volume'" released by "delete_volume" :: held 9.993s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:37:30.444652 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-476b7414-3a98-46e3-b276-e14c4657851d tempest-VolumesListAdminTestJSON-2068505491 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:30.895613 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-476b7414-3a98-46e3-b276-e14c4657851d tempest-VolumesListAdminTestJSON-2068505491 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:37:30.896046 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-476b7414-3a98-46e3-b276-e14c4657851d tempest-VolumesListAdminTestJSON-2068505491 None] Volume volume-c78aaaf9-b653-4d4a-b055-be8c1cc961eb is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:37:31.234552 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-476b7414-3a98-46e3-b276-e14c4657851d tempest-VolumesListAdminTestJSON-2068505491 None] deleting rbd volume volume-c78aaaf9-b653-4d4a-b055-be8c1cc961eb {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:37:31.242293 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-deb2336e-6b30-4b89-b5ca-d2fd3f24e97f tempest-VolumesListTestJSON-1107590893 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:37:31.242666 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-deb2336e-6b30-4b89-b5ca-d2fd3f24e97f tempest-VolumesListTestJSON-1107590893 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:37:31.244962 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-deb2336e-6b30-4b89-b5ca-d2fd3f24e97f tempest-VolumesListTestJSON-1107590893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4f72e81-12d8-43ad-bb5c-9b582e87f6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1056c22d-b7f2-4751-94de-511636591b15', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:31.247755 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-deb2336e-6b30-4b89-b5ca-d2fd3f24e97f tempest-VolumesListTestJSON-1107590893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68d86c2a-5191-44d4-91d5-17892c08046a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:31.335602 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-deb2336e-6b30-4b89-b5ca-d2fd3f24e97f tempest-VolumesListTestJSON-1107590893 None] Volume volume-1056c22d-b7f2-4751-94de-511636591b15 (1056c22d-b7f2-4751-94de-511636591b15): created successfully Dec 25 21:37:31.337618 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-deb2336e-6b30-4b89-b5ca-d2fd3f24e97f tempest-VolumesListTestJSON-1107590893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68d86c2a-5191-44d4-91d5-17892c08046a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:31.340654 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-deb2336e-6b30-4b89-b5ca-d2fd3f24e97f tempest-VolumesListTestJSON-1107590893 None] Flow 'volume_create_manager' (0101516b-9d47-433b-8ac9-34a2d2568c9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:37:31.349394 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-c88ca613-0982-43cf-9e15-d00536764a94 tempest-VolumesSnapshotListTestJSON-1162201679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:37:31.352572 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-c88ca613-0982-43cf-9e15-d00536764a94 tempest-VolumesSnapshotListTestJSON-1162201679 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:37:31.353078 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-c88ca613-0982-43cf-9e15-d00536764a94 tempest-VolumesSnapshotListTestJSON-1162201679 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:37:31.366127 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-c88ca613-0982-43cf-9e15-d00536764a94 tempest-VolumesSnapshotListTestJSON-1162201679 None] Flow 'volume_create_manager' (af69d63a-f7ff-49f4-b74a-9da701eda678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:37:31.369252 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-c88ca613-0982-43cf-9e15-d00536764a94 tempest-VolumesSnapshotListTestJSON-1162201679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93d209dc-5b2d-4213-857c-875a2f16b5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:31.375330 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-c88ca613-0982-43cf-9e15-d00536764a94 tempest-VolumesSnapshotListTestJSON-1162201679 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:37:31.388468 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-c88ca613-0982-43cf-9e15-d00536764a94 tempest-VolumesSnapshotListTestJSON-1162201679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93d209dc-5b2d-4213-857c-875a2f16b5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:37:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1150497941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1b0b4c86-c841-49a1-8ff8-0459094d7ac2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e19dddb9aa840e3a2b96637a3960524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:37:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:37:31Z,use_quota=True,user_id='41daab3c9ebb4f5295bf646ad489e4fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:31.391401 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-c88ca613-0982-43cf-9e15-d00536764a94 tempest-VolumesSnapshotListTestJSON-1162201679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9256157-de47-4b64-8647-e9673dda5098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:31.394205 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-c88ca613-0982-43cf-9e15-d00536764a94 tempest-VolumesSnapshotListTestJSON-1162201679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9256157-de47-4b64-8647-e9673dda5098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:31.396559 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-c88ca613-0982-43cf-9e15-d00536764a94 tempest-VolumesSnapshotListTestJSON-1162201679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58f9c13f-01b5-4084-9e43-fa5065d7b360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:31.398903 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-c88ca613-0982-43cf-9e15-d00536764a94 tempest-VolumesSnapshotListTestJSON-1162201679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58f9c13f-01b5-4084-9e43-fa5065d7b360) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b0b4c86-c841-49a1-8ff8-0459094d7ac2', 'volume_name': 'volume-1b0b4c86-c841-49a1-8ff8-0459094d7ac2', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:31.401514 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-c88ca613-0982-43cf-9e15-d00536764a94 tempest-VolumesSnapshotListTestJSON-1162201679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b975cd3-bb51-48de-a4bd-302958ff5f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:31.403637 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-c88ca613-0982-43cf-9e15-d00536764a94 tempest-VolumesSnapshotListTestJSON-1162201679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b975cd3-bb51-48de-a4bd-302958ff5f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:31.405830 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-c88ca613-0982-43cf-9e15-d00536764a94 tempest-VolumesSnapshotListTestJSON-1162201679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1176bc0f-1bfc-4458-8031-1451e7f4397a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:31.406619 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-c88ca613-0982-43cf-9e15-d00536764a94 tempest-VolumesSnapshotListTestJSON-1162201679 None] Volume 1b0b4c86-c841-49a1-8ff8-0459094d7ac2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b0b4c86-c841-49a1-8ff8-0459094d7ac2', 'volume_size': 1} Dec 25 21:37:31.407002 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-c88ca613-0982-43cf-9e15-d00536764a94 tempest-VolumesSnapshotListTestJSON-1162201679 None] creating volume 'volume-1b0b4c86-c841-49a1-8ff8-0459094d7ac2' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:37:31.408605 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-c88ca613-0982-43cf-9e15-d00536764a94 tempest-VolumesSnapshotListTestJSON-1162201679 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:31.430121 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-deb2336e-6b30-4b89-b5ca-d2fd3f24e97f tempest-VolumesListTestJSON-1107590893 None] Created volume successfully. Dec 25 21:37:32.057231 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:37:32.058037 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:32.088052 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:32.142565 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:37:32.488977 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-c88ca613-0982-43cf-9e15-d00536764a94 tempest-VolumesSnapshotListTestJSON-1162201679 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:37:32.489597 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-c88ca613-0982-43cf-9e15-d00536764a94 tempest-VolumesSnapshotListTestJSON-1162201679 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:37:32.491391 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-c88ca613-0982-43cf-9e15-d00536764a94 tempest-VolumesSnapshotListTestJSON-1162201679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1176bc0f-1bfc-4458-8031-1451e7f4397a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b0b4c86-c841-49a1-8ff8-0459094d7ac2', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:32.493588 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-c88ca613-0982-43cf-9e15-d00536764a94 tempest-VolumesSnapshotListTestJSON-1162201679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10173952-ee4e-494f-be05-6c949af3a01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:32.600566 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-c88ca613-0982-43cf-9e15-d00536764a94 tempest-VolumesSnapshotListTestJSON-1162201679 None] Volume volume-1b0b4c86-c841-49a1-8ff8-0459094d7ac2 (1b0b4c86-c841-49a1-8ff8-0459094d7ac2): created successfully Dec 25 21:37:32.602595 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-c88ca613-0982-43cf-9e15-d00536764a94 tempest-VolumesSnapshotListTestJSON-1162201679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10173952-ee4e-494f-be05-6c949af3a01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:32.605568 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-c88ca613-0982-43cf-9e15-d00536764a94 tempest-VolumesSnapshotListTestJSON-1162201679 None] Flow 'volume_create_manager' (af69d63a-f7ff-49f4-b74a-9da701eda678) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:37:32.679652 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-c88ca613-0982-43cf-9e15-d00536764a94 tempest-VolumesSnapshotListTestJSON-1162201679 None] Created volume successfully. Dec 25 21:37:33.338537 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-440c93b9-c2fc-4369-afc7-f9ad2d1e37ea tempest-VolumesListTestJSON-1107590893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:37:33.341811 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-440c93b9-c2fc-4369-afc7-f9ad2d1e37ea tempest-VolumesListTestJSON-1107590893 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:37:33.342254 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-440c93b9-c2fc-4369-afc7-f9ad2d1e37ea tempest-VolumesListTestJSON-1107590893 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:37:33.358933 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-440c93b9-c2fc-4369-afc7-f9ad2d1e37ea tempest-VolumesListTestJSON-1107590893 None] Flow 'volume_create_manager' (19026649-9933-4d12-80ea-f6bab07a3fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:37:33.362777 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-440c93b9-c2fc-4369-afc7-f9ad2d1e37ea tempest-VolumesListTestJSON-1107590893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9da45cfc-b074-4bd5-9360-897916be3b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:33.373579 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-440c93b9-c2fc-4369-afc7-f9ad2d1e37ea tempest-VolumesListTestJSON-1107590893 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:37:33.392356 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-440c93b9-c2fc-4369-afc7-f9ad2d1e37ea tempest-VolumesListTestJSON-1107590893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9da45cfc-b074-4bd5-9360-897916be3b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-530392451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=12a47424-297a-40a6-bb83-fe7e7d338c70,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b04ad82620434ef5aea1d04bbca6bfab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:37:33Z,use_quota=True,user_id='4848cbb7b58c4f339ab5352e3f1919cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:33.395184 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-440c93b9-c2fc-4369-afc7-f9ad2d1e37ea tempest-VolumesListTestJSON-1107590893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10b87ff2-9cf5-46e5-aa9e-3309cbc32239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:33.400577 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-440c93b9-c2fc-4369-afc7-f9ad2d1e37ea tempest-VolumesListTestJSON-1107590893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10b87ff2-9cf5-46e5-aa9e-3309cbc32239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:33.400577 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-440c93b9-c2fc-4369-afc7-f9ad2d1e37ea tempest-VolumesListTestJSON-1107590893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a77fcbfb-3ad3-46fa-b0b6-93c8a4410f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:33.402076 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-440c93b9-c2fc-4369-afc7-f9ad2d1e37ea tempest-VolumesListTestJSON-1107590893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a77fcbfb-3ad3-46fa-b0b6-93c8a4410f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12a47424-297a-40a6-bb83-fe7e7d338c70', 'volume_name': 'volume-12a47424-297a-40a6-bb83-fe7e7d338c70', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:33.404492 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-440c93b9-c2fc-4369-afc7-f9ad2d1e37ea tempest-VolumesListTestJSON-1107590893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07689a79-a290-4502-923a-0f47aa9f3fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:33.406832 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-440c93b9-c2fc-4369-afc7-f9ad2d1e37ea tempest-VolumesListTestJSON-1107590893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07689a79-a290-4502-923a-0f47aa9f3fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:33.409090 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-440c93b9-c2fc-4369-afc7-f9ad2d1e37ea tempest-VolumesListTestJSON-1107590893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b4d851-d499-4065-9b34-7c19302037af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:33.409892 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-440c93b9-c2fc-4369-afc7-f9ad2d1e37ea tempest-VolumesListTestJSON-1107590893 None] Volume 12a47424-297a-40a6-bb83-fe7e7d338c70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12a47424-297a-40a6-bb83-fe7e7d338c70', 'volume_size': 1} Dec 25 21:37:33.410450 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-440c93b9-c2fc-4369-afc7-f9ad2d1e37ea tempest-VolumesListTestJSON-1107590893 None] creating volume 'volume-12a47424-297a-40a6-bb83-fe7e7d338c70' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:37:33.411622 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-440c93b9-c2fc-4369-afc7-f9ad2d1e37ea tempest-VolumesListTestJSON-1107590893 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:33.556822 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-abf747d7-1f04-499b-b97b-69196818c767 tempest-VolumesSnapshotListTestJSON-1162201679 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:34.457362 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-440c93b9-c2fc-4369-afc7-f9ad2d1e37ea tempest-VolumesListTestJSON-1107590893 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:37:34.457773 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-440c93b9-c2fc-4369-afc7-f9ad2d1e37ea tempest-VolumesListTestJSON-1107590893 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:37:34.460059 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-440c93b9-c2fc-4369-afc7-f9ad2d1e37ea tempest-VolumesListTestJSON-1107590893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b4d851-d499-4065-9b34-7c19302037af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12a47424-297a-40a6-bb83-fe7e7d338c70', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:34.462446 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-440c93b9-c2fc-4369-afc7-f9ad2d1e37ea tempest-VolumesListTestJSON-1107590893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47893977-bb77-4dba-9983-cbbc9539ac14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:34.531213 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-440c93b9-c2fc-4369-afc7-f9ad2d1e37ea tempest-VolumesListTestJSON-1107590893 None] Volume volume-12a47424-297a-40a6-bb83-fe7e7d338c70 (12a47424-297a-40a6-bb83-fe7e7d338c70): created successfully Dec 25 21:37:34.533542 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-440c93b9-c2fc-4369-afc7-f9ad2d1e37ea tempest-VolumesListTestJSON-1107590893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47893977-bb77-4dba-9983-cbbc9539ac14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:34.538336 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-440c93b9-c2fc-4369-afc7-f9ad2d1e37ea tempest-VolumesListTestJSON-1107590893 None] Flow 'volume_create_manager' (19026649-9933-4d12-80ea-f6bab07a3fdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:37:34.628777 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-440c93b9-c2fc-4369-afc7-f9ad2d1e37ea tempest-VolumesListTestJSON-1107590893 None] Created volume successfully. Dec 25 21:37:37.983515 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-4f3c6eb0-1ca4-453c-9b1b-0cac42b58c2b tempest-VolumesListTestJSON-1107590893 None] Lock "b'cinder-12a47424-297a-40a6-bb83-fe7e7d338c70-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:37:38.111363 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-abf747d7-1f04-499b-b97b-69196818c767 tempest-VolumesSnapshotListTestJSON-1162201679 None] Create snapshot completed successfully Dec 25 21:37:38.121407 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-4f3c6eb0-1ca4-453c-9b1b-0cac42b58c2b tempest-VolumesListTestJSON-1107590893 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:38.386676 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-4f3c6eb0-1ca4-453c-9b1b-0cac42b58c2b tempest-VolumesListTestJSON-1107590893 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:37:38.387028 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-4f3c6eb0-1ca4-453c-9b1b-0cac42b58c2b tempest-VolumesListTestJSON-1107590893 None] Volume volume-12a47424-297a-40a6-bb83-fe7e7d338c70 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:37:38.669827 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-4f3c6eb0-1ca4-453c-9b1b-0cac42b58c2b tempest-VolumesListTestJSON-1107590893 None] deleting rbd volume volume-12a47424-297a-40a6-bb83-fe7e7d338c70 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:37:38.818214 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-476b7414-3a98-46e3-b276-e14c4657851d tempest-VolumesListAdminTestJSON-2068505491 None] Created reservations ['56100edf-27e2-4001-9778-69739dd38f98', '7316afe2-300a-4638-a647-b376edd7203e', 'a47d4ba3-425d-40e1-8e97-6567096fec0d', 'dc3a9b81-df27-4c45-bece-e5ceeb529506'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:37:39.176535 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-476b7414-3a98-46e3-b276-e14c4657851d tempest-VolumesListAdminTestJSON-2068505491 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:39.211330 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-476b7414-3a98-46e3-b276-e14c4657851d tempest-VolumesListAdminTestJSON-2068505491 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:39.256268 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-476b7414-3a98-46e3-b276-e14c4657851d tempest-VolumesListAdminTestJSON-2068505491 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:37:39.265968 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-476b7414-3a98-46e3-b276-e14c4657851d tempest-VolumesListAdminTestJSON-2068505491 None] Deleted volume successfully. Dec 25 21:37:39.358924 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-476b7414-3a98-46e3-b276-e14c4657851d tempest-VolumesListAdminTestJSON-2068505491 None] Lock "b'cinder-c78aaaf9-b653-4d4a-b055-be8c1cc961eb-delete_volume'" released by "delete_volume" :: held 9.155s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:37:39.376305 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-56038a94-15ae-466c-97ae-0dc9e185fe66 tempest-VolumesSnapshotListTestJSON-1162201679 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:43.015560 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-56038a94-15ae-466c-97ae-0dc9e185fe66 tempest-VolumesSnapshotListTestJSON-1162201679 None] Create snapshot completed successfully Dec 25 21:37:43.869466 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-bc5fe69c-6a35-498d-bb5c-b847ea01250b tempest-VolumesSnapshotListTestJSON-1162201679 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:47.009858 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-4f3c6eb0-1ca4-453c-9b1b-0cac42b58c2b tempest-VolumesListTestJSON-1107590893 None] Created reservations ['6ae49b16-5fd1-4347-aea7-fdfad47cd076', '2cb913cf-b497-4a2a-9d36-be0d385ff055', '76015a97-02b1-4f7d-a32c-b225ac7b3030', 'e7f55e92-f854-47e0-89be-bf52003d5c8c'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:37:47.092085 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee8c5ec1-e518-4fbf-be45-643633128fd2 tempest-VolumesCloneNegativeTest-286863886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:37:47.097318 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-ee8c5ec1-e518-4fbf-be45-643633128fd2 tempest-VolumesCloneNegativeTest-286863886 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:37:47.097770 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-ee8c5ec1-e518-4fbf-be45-643633128fd2 tempest-VolumesCloneNegativeTest-286863886 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:37:47.109570 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ee8c5ec1-e518-4fbf-be45-643633128fd2 tempest-VolumesCloneNegativeTest-286863886 None] Flow 'volume_create_manager' (cd1b2408-e29d-446a-960a-cd70678b7650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:37:47.113334 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ee8c5ec1-e518-4fbf-be45-643633128fd2 tempest-VolumesCloneNegativeTest-286863886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d7399ac-89bb-4ada-a563-480de9370767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:47.119079 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-ee8c5ec1-e518-4fbf-be45-643633128fd2 tempest-VolumesCloneNegativeTest-286863886 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:37:47.132231 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ee8c5ec1-e518-4fbf-be45-643633128fd2 tempest-VolumesCloneNegativeTest-286863886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d7399ac-89bb-4ada-a563-480de9370767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-603456402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9b730cb6-bcd9-4b53-92e5-fcdfb695cfce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c1f1726595e424a9ca22ae3be711356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:37:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:37:47Z,use_quota=True,user_id='928809cb9ee04bd89c08405f2ad609ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:47.134845 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ee8c5ec1-e518-4fbf-be45-643633128fd2 tempest-VolumesCloneNegativeTest-286863886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (065bb15c-d874-438f-abb6-7e38fa26f004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:47.137044 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ee8c5ec1-e518-4fbf-be45-643633128fd2 tempest-VolumesCloneNegativeTest-286863886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (065bb15c-d874-438f-abb6-7e38fa26f004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:47.139737 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ee8c5ec1-e518-4fbf-be45-643633128fd2 tempest-VolumesCloneNegativeTest-286863886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (274affb0-1340-4092-ac82-e7002100724b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:47.141998 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ee8c5ec1-e518-4fbf-be45-643633128fd2 tempest-VolumesCloneNegativeTest-286863886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (274affb0-1340-4092-ac82-e7002100724b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b730cb6-bcd9-4b53-92e5-fcdfb695cfce', 'volume_name': 'volume-9b730cb6-bcd9-4b53-92e5-fcdfb695cfce', 'volume_size': 2}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:47.144344 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ee8c5ec1-e518-4fbf-be45-643633128fd2 tempest-VolumesCloneNegativeTest-286863886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9beeaa8f-3752-4a51-bac7-551252eb7a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:47.146488 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ee8c5ec1-e518-4fbf-be45-643633128fd2 tempest-VolumesCloneNegativeTest-286863886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9beeaa8f-3752-4a51-bac7-551252eb7a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:47.148687 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ee8c5ec1-e518-4fbf-be45-643633128fd2 tempest-VolumesCloneNegativeTest-286863886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0de3f183-dd4f-4ec7-a7d5-868291bfe779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:47.149519 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-ee8c5ec1-e518-4fbf-be45-643633128fd2 tempest-VolumesCloneNegativeTest-286863886 None] Volume 9b730cb6-bcd9-4b53-92e5-fcdfb695cfce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b730cb6-bcd9-4b53-92e5-fcdfb695cfce', 'volume_size': 2} Dec 25 21:37:47.149911 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ee8c5ec1-e518-4fbf-be45-643633128fd2 tempest-VolumesCloneNegativeTest-286863886 None] creating volume 'volume-9b730cb6-bcd9-4b53-92e5-fcdfb695cfce' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:37:47.150922 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ee8c5ec1-e518-4fbf-be45-643633128fd2 tempest-VolumesCloneNegativeTest-286863886 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:47.284846 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-4f3c6eb0-1ca4-453c-9b1b-0cac42b58c2b tempest-VolumesListTestJSON-1107590893 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:47.308442 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-4f3c6eb0-1ca4-453c-9b1b-0cac42b58c2b tempest-VolumesListTestJSON-1107590893 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:47.343601 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-4f3c6eb0-1ca4-453c-9b1b-0cac42b58c2b tempest-VolumesListTestJSON-1107590893 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:37:47.348354 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-4f3c6eb0-1ca4-453c-9b1b-0cac42b58c2b tempest-VolumesListTestJSON-1107590893 None] Deleted volume successfully. Dec 25 21:37:47.410688 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-4f3c6eb0-1ca4-453c-9b1b-0cac42b58c2b tempest-VolumesListTestJSON-1107590893 None] Lock "b'cinder-12a47424-297a-40a6-bb83-fe7e7d338c70-delete_volume'" released by "delete_volume" :: held 9.427s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:37:47.718475 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-c4bf1e1c-1bb7-48b0-a0b2-e9125309f273 tempest-VolumesListTestJSON-1107590893 None] Lock "b'cinder-1056c22d-b7f2-4751-94de-511636591b15-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:37:47.863773 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-c4bf1e1c-1bb7-48b0-a0b2-e9125309f273 tempest-VolumesListTestJSON-1107590893 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:48.558810 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-c4bf1e1c-1bb7-48b0-a0b2-e9125309f273 tempest-VolumesListTestJSON-1107590893 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:37:48.559440 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-c4bf1e1c-1bb7-48b0-a0b2-e9125309f273 tempest-VolumesListTestJSON-1107590893 None] Volume volume-1056c22d-b7f2-4751-94de-511636591b15 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:37:48.919138 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-c4bf1e1c-1bb7-48b0-a0b2-e9125309f273 tempest-VolumesListTestJSON-1107590893 None] deleting rbd volume volume-1056c22d-b7f2-4751-94de-511636591b15 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:37:48.924103 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ee8c5ec1-e518-4fbf-be45-643633128fd2 tempest-VolumesCloneNegativeTest-286863886 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:37:48.924484 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ee8c5ec1-e518-4fbf-be45-643633128fd2 tempest-VolumesCloneNegativeTest-286863886 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:37:48.926833 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ee8c5ec1-e518-4fbf-be45-643633128fd2 tempest-VolumesCloneNegativeTest-286863886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0de3f183-dd4f-4ec7-a7d5-868291bfe779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b730cb6-bcd9-4b53-92e5-fcdfb695cfce', 'volume_size': 2}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:48.929193 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ee8c5ec1-e518-4fbf-be45-643633128fd2 tempest-VolumesCloneNegativeTest-286863886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (378db337-3790-46ef-bb16-99595bd34971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:37:49.032755 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-ee8c5ec1-e518-4fbf-be45-643633128fd2 tempest-VolumesCloneNegativeTest-286863886 None] Volume volume-9b730cb6-bcd9-4b53-92e5-fcdfb695cfce (9b730cb6-bcd9-4b53-92e5-fcdfb695cfce): created successfully Dec 25 21:37:49.035562 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ee8c5ec1-e518-4fbf-be45-643633128fd2 tempest-VolumesCloneNegativeTest-286863886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (378db337-3790-46ef-bb16-99595bd34971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:37:49.038891 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ee8c5ec1-e518-4fbf-be45-643633128fd2 tempest-VolumesCloneNegativeTest-286863886 None] Flow 'volume_create_manager' (cd1b2408-e29d-446a-960a-cd70678b7650) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:37:49.051841 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-bc5fe69c-6a35-498d-bb5c-b847ea01250b tempest-VolumesSnapshotListTestJSON-1162201679 None] Create snapshot completed successfully Dec 25 21:37:49.086261 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-ee8c5ec1-e518-4fbf-be45-643633128fd2 tempest-VolumesCloneNegativeTest-286863886 None] Created volume successfully. Dec 25 21:37:50.363968 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-e447ae5a-40b1-4880-832d-f042bf2e1c0b tempest-VolumesCloneNegativeTest-286863886 None] Lock "b'cinder-9b730cb6-bcd9-4b53-92e5-fcdfb695cfce-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:37:50.480626 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e447ae5a-40b1-4880-832d-f042bf2e1c0b tempest-VolumesCloneNegativeTest-286863886 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:51.089749 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e447ae5a-40b1-4880-832d-f042bf2e1c0b tempest-VolumesCloneNegativeTest-286863886 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:37:51.093511 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e447ae5a-40b1-4880-832d-f042bf2e1c0b tempest-VolumesCloneNegativeTest-286863886 None] Volume volume-9b730cb6-bcd9-4b53-92e5-fcdfb695cfce is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:37:51.366551 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e447ae5a-40b1-4880-832d-f042bf2e1c0b tempest-VolumesCloneNegativeTest-286863886 None] deleting rbd volume volume-9b730cb6-bcd9-4b53-92e5-fcdfb695cfce {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:37:51.383734 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-15e5227b-5718-4a13-b78f-59e6b8900b16 tempest-VolumesSnapshotListTestJSON-1162201679 None] Lock "b'cinder-92806517-f44c-4b0e-af91-e56752f2afce-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:37:51.385192 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-15e5227b-5718-4a13-b78f-59e6b8900b16 tempest-VolumesSnapshotListTestJSON-1162201679 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:56.261636 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-15e5227b-5718-4a13-b78f-59e6b8900b16 tempest-VolumesSnapshotListTestJSON-1162201679 None] Created reservations ['96307178-271d-4de2-8621-7ecfe409c516', '3ee626ba-6d6f-4444-b45e-4ff37f5e23f8', '05e5a160-88eb-49c6-a796-32f18caf4a55', '2b80c203-10d3-4e5b-a4f3-95833342a240'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:37:56.491390 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-15e5227b-5718-4a13-b78f-59e6b8900b16 tempest-VolumesSnapshotListTestJSON-1162201679 None] Delete snapshot completed successfully. Dec 25 21:37:56.496804 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-15e5227b-5718-4a13-b78f-59e6b8900b16 tempest-VolumesSnapshotListTestJSON-1162201679 None] Lock "b'cinder-92806517-f44c-4b0e-af91-e56752f2afce-delete_snapshot'" released by "delete_snapshot" :: held 5.113s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:37:57.090608 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-0a77b6f7-ab5c-4ca8-be91-14f1c6cda135 tempest-VolumesSnapshotListTestJSON-1162201679 None] Lock "b'cinder-191e5de1-f655-47aa-8a3a-9d6f9cc5e9ff-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.019s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:37:57.102076 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0a77b6f7-ab5c-4ca8-be91-14f1c6cda135 tempest-VolumesSnapshotListTestJSON-1162201679 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:58.107331 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-c4bf1e1c-1bb7-48b0-a0b2-e9125309f273 tempest-VolumesListTestJSON-1107590893 None] Created reservations ['4feb41b1-e0e0-4c99-99ec-1d308fd2be24', '619533e2-e8f9-4a78-a1af-71a918b3c861', '01fd8774-d1a6-44be-8101-704d86fe8781', 'e66077ca-545d-4e2d-905d-cc0096ea7ac9'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:37:58.368855 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-c4bf1e1c-1bb7-48b0-a0b2-e9125309f273 tempest-VolumesListTestJSON-1107590893 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:58.401032 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-c4bf1e1c-1bb7-48b0-a0b2-e9125309f273 tempest-VolumesListTestJSON-1107590893 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:58.431367 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-c4bf1e1c-1bb7-48b0-a0b2-e9125309f273 tempest-VolumesListTestJSON-1107590893 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:37:58.441003 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-c4bf1e1c-1bb7-48b0-a0b2-e9125309f273 tempest-VolumesListTestJSON-1107590893 None] Deleted volume successfully. Dec 25 21:37:58.480996 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-ff380bf4-5803-43e2-a1e7-8e2e0f6f4d1c tempest-VolumesListTestJSON-1107590893 None] Lock "b'cinder-9407be47-d0c2-466d-b76d-8975a0b9f587-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:37:58.551747 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-c4bf1e1c-1bb7-48b0-a0b2-e9125309f273 tempest-VolumesListTestJSON-1107590893 None] Lock "b'cinder-1056c22d-b7f2-4751-94de-511636591b15-delete_volume'" released by "delete_volume" :: held 10.833s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:37:58.615230 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ff380bf4-5803-43e2-a1e7-8e2e0f6f4d1c tempest-VolumesListTestJSON-1107590893 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:37:58.857525 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ff380bf4-5803-43e2-a1e7-8e2e0f6f4d1c tempest-VolumesListTestJSON-1107590893 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:37:58.858140 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ff380bf4-5803-43e2-a1e7-8e2e0f6f4d1c tempest-VolumesListTestJSON-1107590893 None] Volume volume-9407be47-d0c2-466d-b76d-8975a0b9f587 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:37:59.121758 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ff380bf4-5803-43e2-a1e7-8e2e0f6f4d1c tempest-VolumesListTestJSON-1107590893 None] deleting rbd volume volume-9407be47-d0c2-466d-b76d-8975a0b9f587 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:38:00.118856 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-e447ae5a-40b1-4880-832d-f042bf2e1c0b tempest-VolumesCloneNegativeTest-286863886 None] Created reservations ['5aca5066-0c91-408b-961b-dd1a3ed95e5c', 'd5ae174a-3f90-4166-9f60-131fd7426bef', '6d52df9a-6915-4899-8c1f-5cc4510fc4e7', 'b209f405-dd6e-4f26-895c-a268279cc409'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:38:00.410181 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e447ae5a-40b1-4880-832d-f042bf2e1c0b tempest-VolumesCloneNegativeTest-286863886 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:38:00.453745 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e447ae5a-40b1-4880-832d-f042bf2e1c0b tempest-VolumesCloneNegativeTest-286863886 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:38:00.492804 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-e447ae5a-40b1-4880-832d-f042bf2e1c0b tempest-VolumesCloneNegativeTest-286863886 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:38:00.497690 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-e447ae5a-40b1-4880-832d-f042bf2e1c0b tempest-VolumesCloneNegativeTest-286863886 None] Deleted volume successfully. Dec 25 21:38:00.571265 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-e447ae5a-40b1-4880-832d-f042bf2e1c0b tempest-VolumesCloneNegativeTest-286863886 None] Lock "b'cinder-9b730cb6-bcd9-4b53-92e5-fcdfb695cfce-delete_volume'" released by "delete_volume" :: held 10.206s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:38:01.431573 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-0a77b6f7-ab5c-4ca8-be91-14f1c6cda135 tempest-VolumesSnapshotListTestJSON-1162201679 None] Created reservations ['c0949180-5752-4f23-8777-a1b4da15f8d8', '0ed6229c-6190-4f78-a083-675bf7db5033', '268e02e8-e95b-4b57-91bf-4760cd788c6a', '5ba52598-4f18-40e8-87e4-0fd1de498ab5'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:38:01.688048 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-0a77b6f7-ab5c-4ca8-be91-14f1c6cda135 tempest-VolumesSnapshotListTestJSON-1162201679 None] Delete snapshot completed successfully. Dec 25 21:38:01.688048 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-0a77b6f7-ab5c-4ca8-be91-14f1c6cda135 tempest-VolumesSnapshotListTestJSON-1162201679 None] Lock "b'cinder-191e5de1-f655-47aa-8a3a-9d6f9cc5e9ff-delete_snapshot'" released by "delete_snapshot" :: held 4.595s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:38:02.072983 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-932a9083-9850-4d57-82fb-aa21cbdbc619 tempest-VolumesSnapshotTestJSON-639273304 None] Created reservations ['d338b954-b85b-4d0c-8b09-8bfdf4685c51', '4c970505-55ef-4d59-b060-ad38e9b11bda', '4cc7875a-bc86-4e72-a3fa-507fdd178706', '63bfb0b7-e282-45c2-8487-4b058144dee8'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:38:02.355089 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-932a9083-9850-4d57-82fb-aa21cbdbc619 tempest-VolumesSnapshotTestJSON-639273304 None] Delete snapshot completed successfully. Dec 25 21:38:02.375581 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-932a9083-9850-4d57-82fb-aa21cbdbc619 tempest-VolumesSnapshotTestJSON-639273304 None] Lock "b'cinder-cebfef91-cdff-4698-aa3f-9e9d14f07aef-delete_snapshot'" released by "delete_snapshot" :: held 32.811s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:38:02.409237 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-4dd65677-f148-4da3-b558-388c7b0bf4e2 tempest-VolumesSnapshotListTestJSON-1162201679 None] Lock "b'cinder-c7305718-31e7-4406-8581-b273cc3564d5-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:38:02.410984 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-4dd65677-f148-4da3-b558-388c7b0bf4e2 tempest-VolumesSnapshotListTestJSON-1162201679 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:38:02.714111 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-ef6a8257-c1c3-4975-8ef2-eb10c2227114 tempest-VolumesSnapshotTestJSON-639273304 None] Lock "b'cinder-6b121ec5-8eed-4064-9df9-72bd76214573-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.018s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:38:02.716246 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ef6a8257-c1c3-4975-8ef2-eb10c2227114 tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:38:07.389815 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-ff380bf4-5803-43e2-a1e7-8e2e0f6f4d1c tempest-VolumesListTestJSON-1107590893 None] Created reservations ['c62106f4-2aec-4b1d-835d-151b6e3e2f75', 'a083181a-5d69-45f6-939a-f6482ede47bc', '297b5266-b497-439a-868e-5e645755ceff', '17200b8b-77c3-425b-869b-4c88ace36b53'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:38:07.580495 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ff380bf4-5803-43e2-a1e7-8e2e0f6f4d1c tempest-VolumesListTestJSON-1107590893 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:38:07.627088 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ff380bf4-5803-43e2-a1e7-8e2e0f6f4d1c tempest-VolumesListTestJSON-1107590893 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:38:07.656246 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-ff380bf4-5803-43e2-a1e7-8e2e0f6f4d1c tempest-VolumesListTestJSON-1107590893 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:38:07.660726 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-ff380bf4-5803-43e2-a1e7-8e2e0f6f4d1c tempest-VolumesListTestJSON-1107590893 None] Deleted volume successfully. Dec 25 21:38:07.743180 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-ff380bf4-5803-43e2-a1e7-8e2e0f6f4d1c tempest-VolumesListTestJSON-1107590893 None] Lock "b'cinder-9407be47-d0c2-466d-b76d-8975a0b9f587-delete_volume'" released by "delete_volume" :: held 9.262s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:38:07.752424 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-4dd65677-f148-4da3-b558-388c7b0bf4e2 tempest-VolumesSnapshotListTestJSON-1162201679 None] Created reservations ['362ae11f-8494-4dc3-ba68-4734a2002679', 'bcee9755-ec10-4453-8d2c-ad05cbd3ba0b', 'eede5cec-4b19-4d4e-9f6d-49780a55237d', 'c441772a-332e-4ae6-8e10-25bd402be421'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:38:07.954695 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-4dd65677-f148-4da3-b558-388c7b0bf4e2 tempest-VolumesSnapshotListTestJSON-1162201679 None] Delete snapshot completed successfully. Dec 25 21:38:07.960810 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-4dd65677-f148-4da3-b558-388c7b0bf4e2 tempest-VolumesSnapshotListTestJSON-1162201679 None] Lock "b'cinder-c7305718-31e7-4406-8581-b273cc3564d5-delete_snapshot'" released by "delete_snapshot" :: held 5.551s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:38:08.850752 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-2d40c74f-57c4-472e-8128-1d339bf8abd4 tempest-VolumesSnapshotListTestJSON-1162201679 None] Lock "b'cinder-1b0b4c86-c841-49a1-8ff8-0459094d7ac2-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:38:08.969434 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-2d40c74f-57c4-472e-8128-1d339bf8abd4 tempest-VolumesSnapshotListTestJSON-1162201679 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:38:09.238580 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-2d40c74f-57c4-472e-8128-1d339bf8abd4 tempest-VolumesSnapshotListTestJSON-1162201679 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:38:09.239086 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-2d40c74f-57c4-472e-8128-1d339bf8abd4 tempest-VolumesSnapshotListTestJSON-1162201679 None] Volume volume-1b0b4c86-c841-49a1-8ff8-0459094d7ac2 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:38:09.545348 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-2d40c74f-57c4-472e-8128-1d339bf8abd4 tempest-VolumesSnapshotListTestJSON-1162201679 None] deleting rbd volume volume-1b0b4c86-c841-49a1-8ff8-0459094d7ac2 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:38:18.090022 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-2d40c74f-57c4-472e-8128-1d339bf8abd4 tempest-VolumesSnapshotListTestJSON-1162201679 None] Created reservations ['0f46277b-b6df-4952-8d82-8561a5f27325', '9e505d19-a063-412e-a3c4-2b94dfea598d', 'f728d66e-ff7c-4eef-a227-b71d16046a0b', 'd10eb27e-0fa2-436f-9b62-0f0e619b1a10'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:38:18.327285 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-2d40c74f-57c4-472e-8128-1d339bf8abd4 tempest-VolumesSnapshotListTestJSON-1162201679 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:38:18.373759 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-2d40c74f-57c4-472e-8128-1d339bf8abd4 tempest-VolumesSnapshotListTestJSON-1162201679 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:38:18.546242 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-2d40c74f-57c4-472e-8128-1d339bf8abd4 tempest-VolumesSnapshotListTestJSON-1162201679 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:38:18.551013 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-2d40c74f-57c4-472e-8128-1d339bf8abd4 tempest-VolumesSnapshotListTestJSON-1162201679 None] Deleted volume successfully. Dec 25 21:38:18.657359 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-2d40c74f-57c4-472e-8128-1d339bf8abd4 tempest-VolumesSnapshotListTestJSON-1162201679 None] Lock "b'cinder-1b0b4c86-c841-49a1-8ff8-0459094d7ac2-delete_volume'" released by "delete_volume" :: held 9.806s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:38:32.069245 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:38:32.069245 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:38:32.095903 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:38:32.133269 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:38:35.016018 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-ef6a8257-c1c3-4975-8ef2-eb10c2227114 tempest-VolumesSnapshotTestJSON-639273304 None] Created reservations ['7132d652-3bc5-4674-9d39-bd81954c4917', '622b7e01-f081-4f2f-8a8f-bb21ca920b8e', '39aa29cc-b096-4767-80c1-90f028553e93', '55b6ebd9-67bc-4b28-8904-c910e25816fe'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:38:35.445379 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-ef6a8257-c1c3-4975-8ef2-eb10c2227114 tempest-VolumesSnapshotTestJSON-639273304 None] Delete snapshot completed successfully. Dec 25 21:38:35.455962 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-ef6a8257-c1c3-4975-8ef2-eb10c2227114 tempest-VolumesSnapshotTestJSON-639273304 None] Lock "b'cinder-6b121ec5-8eed-4064-9df9-72bd76214573-delete_snapshot'" released by "delete_snapshot" :: held 32.742s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:38:36.213705 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-891f2db9-3f2c-48a0-8472-08b49c98fb6f tempest-VolumesSnapshotTestJSON-639273304 None] Lock "b'cinder-baff6809-1042-4ca9-acdc-1a872203bba2-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.015s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:38:36.219359 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-891f2db9-3f2c-48a0-8472-08b49c98fb6f tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:39:05.584573 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-c29feabf-7816-4a15-ab9f-9567440c0fa0 tempest-GroupSnapshotsV319Test-1092874505 None] Group tempest-GroupSnapshotsV319Test-Group-1201108545: creating Dec 25 21:39:05.654441 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-c29feabf-7816-4a15-ab9f-9567440c0fa0 tempest-GroupSnapshotsV319Test-1092874505 None] Group tempest-GroupSnapshotsV319Test-Group-1201108545: created successfully Dec 25 21:39:05.665128 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-c29feabf-7816-4a15-ab9f-9567440c0fa0 tempest-GroupSnapshotsV319Test-1092874505 None] Create group completed successfully. Dec 25 21:39:07.708960 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7e9c478-a887-4b8a-8cb7-b3d891976d4a tempest-GroupSnapshotsV319Test-1092874505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:39:07.714010 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-b7e9c478-a887-4b8a-8cb7-b3d891976d4a tempest-GroupSnapshotsV319Test-1092874505 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:39:07.714636 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-b7e9c478-a887-4b8a-8cb7-b3d891976d4a tempest-GroupSnapshotsV319Test-1092874505 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:39:07.742799 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b7e9c478-a887-4b8a-8cb7-b3d891976d4a tempest-GroupSnapshotsV319Test-1092874505 None] Flow 'volume_create_manager' (838b6af0-4219-4228-9050-b9cac2eff254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:39:07.751320 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b7e9c478-a887-4b8a-8cb7-b3d891976d4a tempest-GroupSnapshotsV319Test-1092874505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42b5316a-abea-4ec3-8de8-52e00a09a0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:39:07.760130 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-b7e9c478-a887-4b8a-8cb7-b3d891976d4a tempest-GroupSnapshotsV319Test-1092874505 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:39:07.814967 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b7e9c478-a887-4b8a-8cb7-b3d891976d4a tempest-GroupSnapshotsV319Test-1092874505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42b5316a-abea-4ec3-8de8-52e00a09a0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:39:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsV319Test-Volume-972964667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3b2eef93-b086-49ba-a772-bc94312c7c32,host='ncdv-master-1@ceph#ceph',id=f6e0a704-0657-4c70-90e1-1ff4429e4f27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99114e98ebab4f59a23191455e14fa85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:39:08Z,use_quota=True,user_id='b150c13092b94b289cdd0ecffcba15a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b82b3b57-5d48-4abc-893e-e76e14d261bd),volume_type_id=b82b3b57-5d48-4abc-893e-e76e14d261bd)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:39:07.819915 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b7e9c478-a887-4b8a-8cb7-b3d891976d4a tempest-GroupSnapshotsV319Test-1092874505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11176333-3dd4-4c56-b6aa-8c338d2a00b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:39:07.826610 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b7e9c478-a887-4b8a-8cb7-b3d891976d4a tempest-GroupSnapshotsV319Test-1092874505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11176333-3dd4-4c56-b6aa-8c338d2a00b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:39:07.835629 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b7e9c478-a887-4b8a-8cb7-b3d891976d4a tempest-GroupSnapshotsV319Test-1092874505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97cd3d26-50ec-426e-8e06-a5d04dc7edc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:39:07.838204 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b7e9c478-a887-4b8a-8cb7-b3d891976d4a tempest-GroupSnapshotsV319Test-1092874505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97cd3d26-50ec-426e-8e06-a5d04dc7edc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6e0a704-0657-4c70-90e1-1ff4429e4f27', 'volume_name': 'volume-f6e0a704-0657-4c70-90e1-1ff4429e4f27', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:39:07.841819 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b7e9c478-a887-4b8a-8cb7-b3d891976d4a tempest-GroupSnapshotsV319Test-1092874505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d3c2a8f-7845-4468-a70c-be6f0ee12b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:39:07.844048 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b7e9c478-a887-4b8a-8cb7-b3d891976d4a tempest-GroupSnapshotsV319Test-1092874505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d3c2a8f-7845-4468-a70c-be6f0ee12b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:39:07.847330 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b7e9c478-a887-4b8a-8cb7-b3d891976d4a tempest-GroupSnapshotsV319Test-1092874505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed9187b8-b3c8-4260-8636-66dfa8519f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:39:07.848448 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-b7e9c478-a887-4b8a-8cb7-b3d891976d4a tempest-GroupSnapshotsV319Test-1092874505 None] Volume f6e0a704-0657-4c70-90e1-1ff4429e4f27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6e0a704-0657-4c70-90e1-1ff4429e4f27', 'volume_size': 1} Dec 25 21:39:07.849093 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b7e9c478-a887-4b8a-8cb7-b3d891976d4a tempest-GroupSnapshotsV319Test-1092874505 None] creating volume 'volume-f6e0a704-0657-4c70-90e1-1ff4429e4f27' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:39:07.850268 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b7e9c478-a887-4b8a-8cb7-b3d891976d4a tempest-GroupSnapshotsV319Test-1092874505 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:39:08.247206 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-891f2db9-3f2c-48a0-8472-08b49c98fb6f tempest-VolumesSnapshotTestJSON-639273304 None] Created reservations ['cfb29e0c-8031-4b49-b4d3-d749597a7867', 'e5fa58bf-5588-40a3-a407-d15b2824274b', '20f24419-16c7-4cc0-8cc4-3b85d4dda16e', '9d9edf92-7d86-45b2-9283-f174f33348c6'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:39:08.524594 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-891f2db9-3f2c-48a0-8472-08b49c98fb6f tempest-VolumesSnapshotTestJSON-639273304 None] Delete snapshot completed successfully. Dec 25 21:39:08.530218 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-891f2db9-3f2c-48a0-8472-08b49c98fb6f tempest-VolumesSnapshotTestJSON-639273304 None] Lock "b'cinder-baff6809-1042-4ca9-acdc-1a872203bba2-delete_snapshot'" released by "delete_snapshot" :: held 32.316s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:39:08.945112 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b7e9c478-a887-4b8a-8cb7-b3d891976d4a tempest-GroupSnapshotsV319Test-1092874505 None] extra_specs: {} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:39:08.946157 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b7e9c478-a887-4b8a-8cb7-b3d891976d4a tempest-GroupSnapshotsV319Test-1092874505 None] extra_specs: {} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:39:08.949169 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b7e9c478-a887-4b8a-8cb7-b3d891976d4a tempest-GroupSnapshotsV319Test-1092874505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed9187b8-b3c8-4260-8636-66dfa8519f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6e0a704-0657-4c70-90e1-1ff4429e4f27', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:39:08.953266 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b7e9c478-a887-4b8a-8cb7-b3d891976d4a tempest-GroupSnapshotsV319Test-1092874505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a324cf15-a6e2-4c2c-994f-3df2e22b700c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:39:09.061287 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-b7e9c478-a887-4b8a-8cb7-b3d891976d4a tempest-GroupSnapshotsV319Test-1092874505 None] Volume volume-f6e0a704-0657-4c70-90e1-1ff4429e4f27 (f6e0a704-0657-4c70-90e1-1ff4429e4f27): created successfully Dec 25 21:39:09.063611 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b7e9c478-a887-4b8a-8cb7-b3d891976d4a tempest-GroupSnapshotsV319Test-1092874505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a324cf15-a6e2-4c2c-994f-3df2e22b700c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:39:09.067799 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-b7e9c478-a887-4b8a-8cb7-b3d891976d4a tempest-GroupSnapshotsV319Test-1092874505 None] Flow 'volume_create_manager' (838b6af0-4219-4228-9050-b9cac2eff254) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:39:09.150447 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-b7e9c478-a887-4b8a-8cb7-b3d891976d4a tempest-GroupSnapshotsV319Test-1092874505 None] Created volume successfully. Dec 25 21:39:10.391933 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4a1a19c-adf9-4b61-8991-659846e690b4 tempest-TestVolumeBackupRestore-1733305645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:39:10.396563 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-e4a1a19c-adf9-4b61-8991-659846e690b4 tempest-TestVolumeBackupRestore-1733305645 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:39:10.397154 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-e4a1a19c-adf9-4b61-8991-659846e690b4 tempest-TestVolumeBackupRestore-1733305645 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:39:10.410378 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e4a1a19c-adf9-4b61-8991-659846e690b4 tempest-TestVolumeBackupRestore-1733305645 None] Flow 'volume_create_manager' (c4ff91db-f9b6-4f27-a8cd-d1f9f1f2225a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:39:10.414508 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e4a1a19c-adf9-4b61-8991-659846e690b4 tempest-TestVolumeBackupRestore-1733305645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5220dbd5-68dc-4ed6-8d4f-735443d24e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:39:10.422434 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-e4a1a19c-adf9-4b61-8991-659846e690b4 tempest-TestVolumeBackupRestore-1733305645 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:39:10.435203 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e4a1a19c-adf9-4b61-8991-659846e690b4 tempest-TestVolumeBackupRestore-1733305645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5220dbd5-68dc-4ed6-8d4f-735443d24e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-1060719271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=26e57931-5e2e-498f-907c-ba032fee0597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca293d68b8cc44e6b641d477c9a3eb50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:39:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:39:10Z,use_quota=True,user_id='e8dd3c4dd2344bee986e909d5c45112a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:39:10.437913 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e4a1a19c-adf9-4b61-8991-659846e690b4 tempest-TestVolumeBackupRestore-1733305645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bca6fc6e-06ea-4c9d-9626-cb7c30debeb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:39:10.440181 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e4a1a19c-adf9-4b61-8991-659846e690b4 tempest-TestVolumeBackupRestore-1733305645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bca6fc6e-06ea-4c9d-9626-cb7c30debeb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:39:10.443229 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e4a1a19c-adf9-4b61-8991-659846e690b4 tempest-TestVolumeBackupRestore-1733305645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e051803-b9e9-4a95-bbc1-cfffed604649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:39:10.503002 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-00224666-0192-483a-bbde-fa33b3fece3d tempest-GroupSnapshotsV319Test-1092874505 None] GroupSnapshot 598faf57-147a-4c0f-906a-64cc9bdf7b72: creating. Dec 25 21:39:10.531814 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-00224666-0192-483a-bbde-fa33b3fece3d tempest-GroupSnapshotsV319Test-1092874505 None] Group snapshot 598faf57-147a-4c0f-906a-64cc9bdf7b72: creating. {{(pid=129926) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4078}} Dec 25 21:39:10.569462 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-00224666-0192-483a-bbde-fa33b3fece3d tempest-GroupSnapshotsV319Test-1092874505 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:39:11.036638 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e4a1a19c-adf9-4b61-8991-659846e690b4 tempest-TestVolumeBackupRestore-1733305645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e051803-b9e9-4a95-bbc1-cfffed604649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '26e57931-5e2e-498f-907c-ba032fee0597', 'volume_name': 'volume-26e57931-5e2e-498f-907c-ba032fee0597', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:39:11.039048 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e4a1a19c-adf9-4b61-8991-659846e690b4 tempest-TestVolumeBackupRestore-1733305645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17514550-89e7-476d-904f-aae1f961e069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:39:11.041337 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e4a1a19c-adf9-4b61-8991-659846e690b4 tempest-TestVolumeBackupRestore-1733305645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17514550-89e7-476d-904f-aae1f961e069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:39:11.043525 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e4a1a19c-adf9-4b61-8991-659846e690b4 tempest-TestVolumeBackupRestore-1733305645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9500f1a-2106-480d-a5f5-779a2dc7b629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:39:11.044367 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-e4a1a19c-adf9-4b61-8991-659846e690b4 tempest-TestVolumeBackupRestore-1733305645 None] Volume 26e57931-5e2e-498f-907c-ba032fee0597: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-26e57931-5e2e-498f-907c-ba032fee0597', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 25 21:39:11.044940 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4a1a19c-adf9-4b61-8991-659846e690b4 tempest-TestVolumeBackupRestore-1733305645 None] Cloning 26e57931-5e2e-498f-907c-ba032fee0597 from image aca914d0-5f7b-465f-a024-75efa27d7291 at location (None, None). {{(pid=129926) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Dec 25 21:39:11.063109 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-1f46ce7c-9c9e-4950-a7f9-6b5a238f2fe0 req-ff6c74ce-8bc0-4eb3-b8c3-ddb45eaee28f tempest-VolumesSnapshotTestJSON-639273304 None] Terminate volume connection completed successfully. Dec 25 21:39:11.063221 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-1f46ce7c-9c9e-4950-a7f9-6b5a238f2fe0 req-ff6c74ce-8bc0-4eb3-b8c3-ddb45eaee28f tempest-VolumesSnapshotTestJSON-639273304 None] Deleting attachment b1f91e1c-74f1-45b0-b787-1ea198c7711b. {{(pid=129926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 25 21:39:11.075710 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-e4a1a19c-adf9-4b61-8991-659846e690b4 tempest-TestVolumeBackupRestore-1733305645 None] Lock "b'cinder-aca914d0-5f7b-465f-a024-75efa27d7291'" acquired by "_prepare_image_cache_entry" :: waited 0.027s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:39:11.174058 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-e4a1a19c-adf9-4b61-8991-659846e690b4 tempest-TestVolumeBackupRestore-1733305645 None] Found image-volume cache entry: {'id': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'volume_id': '058f5fb3-51e4-40e3-9c98-542207f1fc1f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31), 'last_used': datetime.datetime(2021, 12, 25, 21, 39, 11, 77376)}. {{(pid=129926) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 25 21:39:11.174058 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-e4a1a19c-adf9-4b61-8991-659846e690b4 tempest-TestVolumeBackupRestore-1733305645 None] Image-volume cache entry image_update_at = 2021-12-25 20:58:31+00:00, requested image updated_at = 2021-12-25 20:58:31+00:00. {{(pid=129926) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 25 21:39:11.174058 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4a1a19c-adf9-4b61-8991-659846e690b4 tempest-TestVolumeBackupRestore-1733305645 None] Found cache entry for image = aca914d0-5f7b-465f-a024-75efa27d7291 on host ncdv-master-1@ceph#ceph. {{(pid=129926) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Dec 25 21:39:11.176348 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-e4a1a19c-adf9-4b61-8991-659846e690b4 tempest-TestVolumeBackupRestore-1733305645 None] Lock "b'cinder-aca914d0-5f7b-465f-a024-75efa27d7291'" released by "_prepare_image_cache_entry" :: held 0.104s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:39:11.178252 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4a1a19c-adf9-4b61-8991-659846e690b4 tempest-TestVolumeBackupRestore-1733305645 None] Attempting to retrieve cache entry for image = aca914d0-5f7b-465f-a024-75efa27d7291 on host ncdv-master-1@ceph#ceph. {{(pid=129926) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Dec 25 21:39:11.185340 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-e4a1a19c-adf9-4b61-8991-659846e690b4 tempest-TestVolumeBackupRestore-1733305645 None] Found image-volume cache entry: {'id': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'volume_id': '058f5fb3-51e4-40e3-9c98-542207f1fc1f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31), 'last_used': datetime.datetime(2021, 12, 25, 21, 39, 11, 182096)}. {{(pid=129926) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 25 21:39:11.185945 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-e4a1a19c-adf9-4b61-8991-659846e690b4 tempest-TestVolumeBackupRestore-1733305645 None] Image-volume cache entry image_update_at = 2021-12-25 20:58:31+00:00, requested image updated_at = 2021-12-25 20:58:31+00:00. {{(pid=129926) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 25 21:39:11.186674 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4a1a19c-adf9-4b61-8991-659846e690b4 tempest-TestVolumeBackupRestore-1733305645 None] Creating from source image-volume 058f5fb3-51e4-40e3-9c98-542207f1fc1f {{(pid=129926) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Dec 25 21:39:11.199845 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e4a1a19c-adf9-4b61-8991-659846e690b4 tempest-TestVolumeBackupRestore-1733305645 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:39:11.622273 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e4a1a19c-adf9-4b61-8991-659846e690b4 tempest-TestVolumeBackupRestore-1733305645 None] creating snapshot='volume-26e57931-5e2e-498f-907c-ba032fee0597.clone_snap' {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 25 21:39:14.869631 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e4a1a19c-adf9-4b61-8991-659846e690b4 tempest-TestVolumeBackupRestore-1733305645 None] cloning 'volume-058f5fb3-51e4-40e3-9c98-542207f1fc1f@volume-26e57931-5e2e-498f-907c-ba032fee0597.clone_snap' to 'volume-26e57931-5e2e-498f-907c-ba032fee0597' {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 25 21:39:16.283524 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-00224666-0192-483a-bbde-fa33b3fece3d tempest-GroupSnapshotsV319Test-1092874505 None] group_snapshot 598faf57-147a-4c0f-906a-64cc9bdf7b72: created successfully Dec 25 21:39:16.603771 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-5b22a5b5-f8d3-458e-8857-586b53aac709 tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:39:17.126611 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e4a1a19c-adf9-4b61-8991-659846e690b4 tempest-TestVolumeBackupRestore-1733305645 None] Volume volume-98b6d31e-e760-499e-8962-7b22479c1e9a.deleted is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:39:17.127702 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e4a1a19c-adf9-4b61-8991-659846e690b4 tempest-TestVolumeBackupRestore-1733305645 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:39:17.128131 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e4a1a19c-adf9-4b61-8991-659846e690b4 tempest-TestVolumeBackupRestore-1733305645 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:39:17.961136 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e4a1a19c-adf9-4b61-8991-659846e690b4 tempest-TestVolumeBackupRestore-1733305645 None] clone created successfully {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 25 21:39:17.962723 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.volume_utils [None req-e4a1a19c-adf9-4b61-8991-659846e690b4 tempest-TestVolumeBackupRestore-1733305645 None] Marking volume 26e57931-5e2e-498f-907c-ba032fee0597 as bootable. {{(pid=129926) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 25 21:39:17.975102 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-a34d2226-07e8-4188-bb4a-46d7d817c3ed tempest-GroupSnapshotsV319Test-1092874505 None] group_snapshot 598faf57-147a-4c0f-906a-64cc9bdf7b72: deleting Dec 25 21:39:17.997459 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a34d2226-07e8-4188-bb4a-46d7d817c3ed tempest-GroupSnapshotsV319Test-1092874505 None] group_snapshot 598faf57-147a-4c0f-906a-64cc9bdf7b72: deleting {{(pid=129926) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4253}} Dec 25 21:39:18.020570 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a34d2226-07e8-4188-bb4a-46d7d817c3ed tempest-GroupSnapshotsV319Test-1092874505 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:39:18.640489 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4a1a19c-adf9-4b61-8991-659846e690b4 tempest-TestVolumeBackupRestore-1733305645 None] Copying metadata from image aca914d0-5f7b-465f-a024-75efa27d7291 to 26e57931-5e2e-498f-907c-ba032fee0597. {{(pid=129926) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Dec 25 21:39:18.640944 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4a1a19c-adf9-4b61-8991-659846e690b4 tempest-TestVolumeBackupRestore-1733305645 None] Creating volume glance metadata for volume 26e57931-5e2e-498f-907c-ba032fee0597 backed by image aca914d0-5f7b-465f-a024-75efa27d7291 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129926) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Dec 25 21:39:18.790756 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e4a1a19c-adf9-4b61-8991-659846e690b4 tempest-TestVolumeBackupRestore-1733305645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9500f1a-2106-480d-a5f5-779a2dc7b629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26e57931-5e2e-498f-907c-ba032fee0597', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:39:18.793142 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e4a1a19c-adf9-4b61-8991-659846e690b4 tempest-TestVolumeBackupRestore-1733305645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b58212dd-ce7b-40f9-ae63-881667400393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:39:18.893538 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-e4a1a19c-adf9-4b61-8991-659846e690b4 tempest-TestVolumeBackupRestore-1733305645 None] Volume volume-26e57931-5e2e-498f-907c-ba032fee0597 (26e57931-5e2e-498f-907c-ba032fee0597): created successfully Dec 25 21:39:18.896051 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e4a1a19c-adf9-4b61-8991-659846e690b4 tempest-TestVolumeBackupRestore-1733305645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b58212dd-ce7b-40f9-ae63-881667400393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:39:18.899471 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e4a1a19c-adf9-4b61-8991-659846e690b4 tempest-TestVolumeBackupRestore-1733305645 None] Flow 'volume_create_manager' (c4ff91db-f9b6-4f27-a8cd-d1f9f1f2225a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:39:18.996118 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-e4a1a19c-adf9-4b61-8991-659846e690b4 tempest-TestVolumeBackupRestore-1733305645 None] Created volume successfully. Dec 25 21:39:20.302686 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-5b22a5b5-f8d3-458e-8857-586b53aac709 tempest-VolumesSnapshotTestJSON-639273304 None] Create snapshot completed successfully Dec 25 21:39:20.814984 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [None req-d0931f01-3f80-4d85-9ceb-e41f7a1f22d7 tempest-TestVolumeBackupRestore-1733305645 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:39:20.875117 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-90f4eef7-c7c1-4cb6-92bc-6a8dfc8e2e1d req-4a5120f6-6e4f-4ddd-a9be-6b2666e4b78a tempest-TestVolumeBootPattern-1499667379 None] Terminate volume connection completed successfully. Dec 25 21:39:20.875728 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-90f4eef7-c7c1-4cb6-92bc-6a8dfc8e2e1d req-4a5120f6-6e4f-4ddd-a9be-6b2666e4b78a tempest-TestVolumeBootPattern-1499667379 None] Deleting attachment f8168f91-894e-47f0-9cb7-ed54a9fe5a12. {{(pid=129926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 25 21:39:21.166946 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-d7fba179-d21c-4ff3-adbd-a3557686f0fc tempest-VolumesSnapshotTestJSON-639273304 None] Lock "b'cinder-640ec178-1d20-46d8-9ea4-33ad96023449-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:39:21.168942 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-d7fba179-d21c-4ff3-adbd-a3557686f0fc tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:39:21.637303 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [None req-d0931f01-3f80-4d85-9ceb-e41f7a1f22d7 tempest-TestVolumeBackupRestore-1733305645 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.822s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:39:21.639297 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-d0931f01-3f80-4d85-9ceb-e41f7a1f22d7 tempest-TestVolumeBackupRestore-1733305645 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-26e57931-5e2e-498f-907c-ba032fee0597', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': '26e57931-5e2e-498f-907c-ba032fee0597', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 21:39:21.661645 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-d0931f01-3f80-4d85-9ceb-e41f7a1f22d7 tempest-TestVolumeBackupRestore-1733305645 None] Initialize volume connection completed successfully. Dec 25 21:39:22.157588 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-a4bea617-2de0-45df-982b-da4c3c3bef7c req-018fa653-cc7e-42e4-b8bd-fd866ddd998b tempest-TaggedBootDevicesTest-292780470 None] Terminate volume connection completed successfully. Dec 25 21:39:22.157588 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-a4bea617-2de0-45df-982b-da4c3c3bef7c req-018fa653-cc7e-42e4-b8bd-fd866ddd998b tempest-TaggedBootDevicesTest-292780470 None] Deleting attachment 49a7aaa3-7313-427a-8a09-f50e0d213090. {{(pid=129926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 25 21:39:22.338535 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-a4bea617-2de0-45df-982b-da4c3c3bef7c req-9fc9bc59-1075-4e73-a4e4-3c663be21534 tempest-TaggedBootDevicesTest-292780470 None] Terminate volume connection completed successfully. Dec 25 21:39:22.338941 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-a4bea617-2de0-45df-982b-da4c3c3bef7c req-9fc9bc59-1075-4e73-a4e4-3c663be21534 tempest-TaggedBootDevicesTest-292780470 None] Deleting attachment 5633c375-2d75-41fa-801c-c34a1daebe0c. {{(pid=129926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 25 21:39:22.445746 ncdv-master-1 cinder-volume[129926]: WARNING cinder.quota [None req-a34d2226-07e8-4188-bb4a-46d7d817c3ed tempest-GroupSnapshotsV319Test-1092874505 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1872623579 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1872623579, it is now deprecated. Please use the default quota class for default quota. Dec 25 21:39:22.446450 ncdv-master-1 cinder-volume[129926]: WARNING cinder.quota [None req-a34d2226-07e8-4188-bb4a-46d7d817c3ed tempest-GroupSnapshotsV319Test-1092874505 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1872623579 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1872623579, it is now deprecated. Please use the default quota class for default quota. Dec 25 21:39:22.560597 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-a4bea617-2de0-45df-982b-da4c3c3bef7c req-516c4e83-be15-4b9b-b749-f1f7339965fc tempest-TaggedBootDevicesTest-292780470 None] Terminate volume connection completed successfully. Dec 25 21:39:22.561157 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-a4bea617-2de0-45df-982b-da4c3c3bef7c req-516c4e83-be15-4b9b-b749-f1f7339965fc tempest-TaggedBootDevicesTest-292780470 None] Deleting attachment a2267fda-c974-4109-9037-b92a9c3e6de4. {{(pid=129926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 25 21:39:22.598366 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-a34d2226-07e8-4188-bb4a-46d7d817c3ed tempest-GroupSnapshotsV319Test-1092874505 None] Created reservations ['4e749c3c-6a16-4324-9520-0b4322bb3e0d', 'ce12943d-fb04-4d1b-b3ee-88c67c40548e', '807f468e-4901-4fe5-879e-3a65b4728e86', 'a821b015-7efd-495e-817d-624b531072d3'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:39:22.870310 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-a34d2226-07e8-4188-bb4a-46d7d817c3ed tempest-GroupSnapshotsV319Test-1092874505 None] group_snapshot 598faf57-147a-4c0f-906a-64cc9bdf7b72: deleted successfully Dec 25 21:39:23.094075 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-e43667c0-d95e-4816-a8d6-ccf665b71ef5 tempest-TestVolumeBootPattern-1499667379 None] Lock "b'cinder-1f66629a-ecb8-47cb-8a87-8abb304c2f96-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:39:23.207884 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e43667c0-d95e-4816-a8d6-ccf665b71ef5 tempest-TestVolumeBootPattern-1499667379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:39:23.445579 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e43667c0-d95e-4816-a8d6-ccf665b71ef5 tempest-TestVolumeBootPattern-1499667379 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:39:23.891414 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e43667c0-d95e-4816-a8d6-ccf665b71ef5 tempest-TestVolumeBootPattern-1499667379 None] deleting rbd volume volume-1f66629a-ecb8-47cb-8a87-8abb304c2f96 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:39:23.922764 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e3b9851d-9645-4247-aba9-e58ebd5c31ca tempest-GroupSnapshotsV319Test-1092874505 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:39:24.299078 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e3b9851d-9645-4247-aba9-e58ebd5c31ca tempest-GroupSnapshotsV319Test-1092874505 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:39:24.299542 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e3b9851d-9645-4247-aba9-e58ebd5c31ca tempest-GroupSnapshotsV319Test-1092874505 None] Volume volume-f6e0a704-0657-4c70-90e1-1ff4429e4f27 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:39:24.453888 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e3b9851d-9645-4247-aba9-e58ebd5c31ca tempest-GroupSnapshotsV319Test-1092874505 None] deleting rbd volume volume-f6e0a704-0657-4c70-90e1-1ff4429e4f27 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:39:25.625275 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-d7fba179-d21c-4ff3-adbd-a3557686f0fc tempest-VolumesSnapshotTestJSON-639273304 None] Created reservations ['c90ffac0-490b-44fb-9876-60131dc13052', '5f0bb9a0-9d9f-4cbc-9da5-b3c81060c1c7', 'b3cafa9d-a7f5-4086-acea-d3cd1f6d37b4', 'bfca155f-55a6-4172-a2e3-3dec01965c52'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:39:25.860034 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-d7fba179-d21c-4ff3-adbd-a3557686f0fc tempest-VolumesSnapshotTestJSON-639273304 None] Delete snapshot completed successfully. Dec 25 21:39:25.871254 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-d7fba179-d21c-4ff3-adbd-a3557686f0fc tempest-VolumesSnapshotTestJSON-639273304 None] Lock "b'cinder-640ec178-1d20-46d8-9ea4-33ad96023449-delete_snapshot'" released by "delete_snapshot" :: held 4.704s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:39:26.975350 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-d90935a0-3afa-4cbe-ae51-44f2ff91cc08 tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:39:28.178572 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-4a2e6773-16dd-4500-8fe5-ab20da713f9e tempest-TaggedBootDevicesTest-292780470 None] Lock "b'cinder-84d8c368-fc65-4b1d-bfa0-8dcd9af9fee2-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:39:28.270466 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-4a2e6773-16dd-4500-8fe5-ab20da713f9e tempest-TaggedBootDevicesTest-292780470 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:39:28.630217 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-4a2e6773-16dd-4500-8fe5-ab20da713f9e tempest-TaggedBootDevicesTest-292780470 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:39:28.630634 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-4a2e6773-16dd-4500-8fe5-ab20da713f9e tempest-TaggedBootDevicesTest-292780470 None] Volume volume-84d8c368-fc65-4b1d-bfa0-8dcd9af9fee2 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:39:28.836611 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-4a2e6773-16dd-4500-8fe5-ab20da713f9e tempest-TaggedBootDevicesTest-292780470 None] deleting rbd volume volume-84d8c368-fc65-4b1d-bfa0-8dcd9af9fee2 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:39:31.444493 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-d90935a0-3afa-4cbe-ae51-44f2ff91cc08 tempest-VolumesSnapshotTestJSON-639273304 None] Create snapshot completed successfully Dec 25 21:39:32.061640 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:39:32.062433 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:39:32.093093 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:39:32.127091 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:39:36.209932 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-e3b9851d-9645-4247-aba9-e58ebd5c31ca tempest-GroupSnapshotsV319Test-1092874505 None] Created reservations ['2e5c3de6-0ca4-4946-9912-2e35dbaace8d'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:39:36.226812 ncdv-master-1 cinder-volume[129926]: WARNING cinder.quota [None req-e3b9851d-9645-4247-aba9-e58ebd5c31ca tempest-GroupSnapshotsV319Test-1092874505 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1872623579 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1872623579, it is now deprecated. Please use the default quota class for default quota. Dec 25 21:39:36.316759 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-e3b9851d-9645-4247-aba9-e58ebd5c31ca tempest-GroupSnapshotsV319Test-1092874505 None] Created reservations ['8df18661-fef6-468b-b151-80b8e26954b3', 'd8b060e8-db72-444a-aefb-87a033d5b442', '337edcab-9d95-4141-beac-e8645100d152', 'f74d155c-0987-45c6-9568-0791de2aa00e'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:39:36.752945 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e3b9851d-9645-4247-aba9-e58ebd5c31ca tempest-GroupSnapshotsV319Test-1092874505 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:39:36.941685 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e3b9851d-9645-4247-aba9-e58ebd5c31ca tempest-GroupSnapshotsV319Test-1092874505 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:39:36.973273 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-e3b9851d-9645-4247-aba9-e58ebd5c31ca tempest-GroupSnapshotsV319Test-1092874505 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:39:36.978082 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-e3b9851d-9645-4247-aba9-e58ebd5c31ca tempest-GroupSnapshotsV319Test-1092874505 None] Delete group completed successfully. Dec 25 21:39:37.106857 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e43667c0-d95e-4816-a8d6-ccf665b71ef5 tempest-TestVolumeBootPattern-1499667379 None] volume is a clone so cleaning references {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 25 21:39:37.317875 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e43667c0-d95e-4816-a8d6-ccf665b71ef5 tempest-TestVolumeBootPattern-1499667379 None] deleting parent snapshot volume-1f66629a-ecb8-47cb-8a87-8abb304c2f96.clone_snap {{(pid=129926) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 25 21:39:43.044135 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-e43667c0-d95e-4816-a8d6-ccf665b71ef5 tempest-TestVolumeBootPattern-1499667379 None] Created reservations ['95cf47d7-08f5-43d9-aef6-55537590be1f', '2be16ede-09a7-4848-860c-7506a4a4c6f9', '5cc09d76-5b80-4547-a28d-08dfe8111262', 'b9bb6861-b76f-4f99-99bd-3812211e334c'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:39:43.061438 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-4a2e6773-16dd-4500-8fe5-ab20da713f9e tempest-TaggedBootDevicesTest-292780470 None] Created reservations ['863debfb-0918-4a32-93a9-6ebfb5f5cb8f', '20c97c41-1ae4-4a57-b1c9-802ddcaa7a51', '803c727d-a361-4012-95fc-b82f076f5c79', 'b7c48ffb-713c-493c-ad17-44cf7b9d37b9'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:39:43.271109 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e43667c0-d95e-4816-a8d6-ccf665b71ef5 tempest-TestVolumeBootPattern-1499667379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:39:43.332118 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e43667c0-d95e-4816-a8d6-ccf665b71ef5 tempest-TestVolumeBootPattern-1499667379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:39:43.526294 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-e43667c0-d95e-4816-a8d6-ccf665b71ef5 tempest-TestVolumeBootPattern-1499667379 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:39:43.530895 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-e43667c0-d95e-4816-a8d6-ccf665b71ef5 tempest-TestVolumeBootPattern-1499667379 None] Deleted volume successfully. Dec 25 21:39:43.644821 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-e43667c0-d95e-4816-a8d6-ccf665b71ef5 tempest-TestVolumeBootPattern-1499667379 None] Lock "b'cinder-1f66629a-ecb8-47cb-8a87-8abb304c2f96-delete_volume'" released by "delete_volume" :: held 20.550s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:39:43.659655 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-4a2e6773-16dd-4500-8fe5-ab20da713f9e tempest-TaggedBootDevicesTest-292780470 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:39:43.681918 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-4a2e6773-16dd-4500-8fe5-ab20da713f9e tempest-TaggedBootDevicesTest-292780470 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:39:43.711630 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-4a2e6773-16dd-4500-8fe5-ab20da713f9e tempest-TaggedBootDevicesTest-292780470 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:39:43.715499 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-4a2e6773-16dd-4500-8fe5-ab20da713f9e tempest-TaggedBootDevicesTest-292780470 None] Deleted volume successfully. Dec 25 21:39:43.837446 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-4a2e6773-16dd-4500-8fe5-ab20da713f9e tempest-TaggedBootDevicesTest-292780470 None] Lock "b'cinder-84d8c368-fc65-4b1d-bfa0-8dcd9af9fee2-delete_volume'" released by "delete_volume" :: held 15.659s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:39:44.165528 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-ee906305-8927-419f-a90c-adc4541c5eaa tempest-TaggedBootDevicesTest-292780470 None] Lock "b'cinder-e7976291-a452-4d2e-b90b-b00735370896-delete_volume'" acquired by "delete_volume" :: waited 0.027s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:39:44.292328 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ee906305-8927-419f-a90c-adc4541c5eaa tempest-TaggedBootDevicesTest-292780470 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:39:44.488441 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ee906305-8927-419f-a90c-adc4541c5eaa tempest-TaggedBootDevicesTest-292780470 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:39:44.488898 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ee906305-8927-419f-a90c-adc4541c5eaa tempest-TaggedBootDevicesTest-292780470 None] Volume volume-e7976291-a452-4d2e-b90b-b00735370896 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:39:45.370547 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ee906305-8927-419f-a90c-adc4541c5eaa tempest-TaggedBootDevicesTest-292780470 None] deleting rbd volume volume-e7976291-a452-4d2e-b90b-b00735370896 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:39:47.208104 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-d9084de4-c529-4b36-aa67-d3c469819fef req-640b8d21-e6c2-44d0-b38c-821360b8a2da tempest-VolumesSnapshotTestJSON-639273304 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:39:48.166894 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-d9084de4-c529-4b36-aa67-d3c469819fef req-640b8d21-e6c2-44d0-b38c-821360b8a2da tempest-VolumesSnapshotTestJSON-639273304 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.957s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:39:48.167844 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-d9084de4-c529-4b36-aa67-d3c469819fef req-640b8d21-e6c2-44d0-b38c-821360b8a2da tempest-VolumesSnapshotTestJSON-639273304 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f03e9745-84e8-42ce-aae1-83a861dbd629', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': 'f03e9745-84e8-42ce-aae1-83a861dbd629', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 21:39:48.269310 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-d9084de4-c529-4b36-aa67-d3c469819fef req-640b8d21-e6c2-44d0-b38c-821360b8a2da tempest-VolumesSnapshotTestJSON-639273304 None] Connection info returned from driver {'name': 'volumes/volume-f03e9745-84e8-42ce-aae1-83a861dbd629', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f03e9745-84e8-42ce-aae1-83a861dbd629', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '91a34053-a1f6-4401-9bee-ba0360f400b8'} {{(pid=129926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 25 21:39:48.397605 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-d9084de4-c529-4b36-aa67-d3c469819fef req-640b8d21-e6c2-44d0-b38c-821360b8a2da tempest-VolumesSnapshotTestJSON-639273304 None] attachment_update completed successfully. Dec 25 21:39:51.833681 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-8cfc998e-43c6-4baa-8df4-17b29802abfe tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:39:55.587336 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b7ec0c7-30e3-453a-80bc-6f97c3483afc tempest-VolumesBackupsTest-596628470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:39:55.591263 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-5b7ec0c7-30e3-453a-80bc-6f97c3483afc tempest-VolumesBackupsTest-596628470 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:39:55.591758 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-5b7ec0c7-30e3-453a-80bc-6f97c3483afc tempest-VolumesBackupsTest-596628470 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:39:55.604909 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5b7ec0c7-30e3-453a-80bc-6f97c3483afc tempest-VolumesBackupsTest-596628470 None] Flow 'volume_create_manager' (b3c57235-1f4b-4cd5-91f4-98c8656d4ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:39:55.608319 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5b7ec0c7-30e3-453a-80bc-6f97c3483afc tempest-VolumesBackupsTest-596628470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (623a42d6-1b89-466e-8c17-914becfbaea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:39:55.614722 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-5b7ec0c7-30e3-453a-80bc-6f97c3483afc tempest-VolumesBackupsTest-596628470 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:39:55.628456 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5b7ec0c7-30e3-453a-80bc-6f97c3483afc tempest-VolumesBackupsTest-596628470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (623a42d6-1b89-466e-8c17-914becfbaea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1143150465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2e560f62-0022-4854-a99f-ce9ce208b3c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a6f7f2d4b1243369e6e2a101f68557c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:39:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:39:55Z,use_quota=True,user_id='0b6c0fe828da4c18ae9764400f30740d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:39:55.631220 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5b7ec0c7-30e3-453a-80bc-6f97c3483afc tempest-VolumesBackupsTest-596628470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e38dd10a-4ea3-4069-b49a-665fe0736206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:39:55.633464 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5b7ec0c7-30e3-453a-80bc-6f97c3483afc tempest-VolumesBackupsTest-596628470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e38dd10a-4ea3-4069-b49a-665fe0736206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:39:55.635889 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5b7ec0c7-30e3-453a-80bc-6f97c3483afc tempest-VolumesBackupsTest-596628470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (270f737b-693e-4f60-90af-56aeed3c8398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:39:55.638254 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5b7ec0c7-30e3-453a-80bc-6f97c3483afc tempest-VolumesBackupsTest-596628470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (270f737b-693e-4f60-90af-56aeed3c8398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e560f62-0022-4854-a99f-ce9ce208b3c1', 'volume_name': 'volume-2e560f62-0022-4854-a99f-ce9ce208b3c1', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:39:55.640909 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5b7ec0c7-30e3-453a-80bc-6f97c3483afc tempest-VolumesBackupsTest-596628470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17440724-deb2-4325-85fa-b28474d182cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:39:55.643036 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5b7ec0c7-30e3-453a-80bc-6f97c3483afc tempest-VolumesBackupsTest-596628470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17440724-deb2-4325-85fa-b28474d182cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:39:55.645285 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5b7ec0c7-30e3-453a-80bc-6f97c3483afc tempest-VolumesBackupsTest-596628470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9709519c-4cc9-499d-911e-2fae68b9ed6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:39:55.646089 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-5b7ec0c7-30e3-453a-80bc-6f97c3483afc tempest-VolumesBackupsTest-596628470 None] Volume 2e560f62-0022-4854-a99f-ce9ce208b3c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e560f62-0022-4854-a99f-ce9ce208b3c1', 'volume_size': 1} Dec 25 21:39:55.646492 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-5b7ec0c7-30e3-453a-80bc-6f97c3483afc tempest-VolumesBackupsTest-596628470 None] creating volume 'volume-2e560f62-0022-4854-a99f-ce9ce208b3c1' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:39:55.647487 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-5b7ec0c7-30e3-453a-80bc-6f97c3483afc tempest-VolumesBackupsTest-596628470 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:39:56.404120 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-8cfc998e-43c6-4baa-8df4-17b29802abfe tempest-VolumesSnapshotTestJSON-639273304 None] Create snapshot completed successfully Dec 25 21:39:57.210057 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-5b7ec0c7-30e3-453a-80bc-6f97c3483afc tempest-VolumesBackupsTest-596628470 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:39:57.210677 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-5b7ec0c7-30e3-453a-80bc-6f97c3483afc tempest-VolumesBackupsTest-596628470 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:39:57.212651 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5b7ec0c7-30e3-453a-80bc-6f97c3483afc tempest-VolumesBackupsTest-596628470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9709519c-4cc9-499d-911e-2fae68b9ed6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e560f62-0022-4854-a99f-ce9ce208b3c1', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:39:57.214898 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5b7ec0c7-30e3-453a-80bc-6f97c3483afc tempest-VolumesBackupsTest-596628470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (453f5624-8b7d-4bc7-aa73-8f0cc907c842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:39:57.367997 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-5b7ec0c7-30e3-453a-80bc-6f97c3483afc tempest-VolumesBackupsTest-596628470 None] Volume volume-2e560f62-0022-4854-a99f-ce9ce208b3c1 (2e560f62-0022-4854-a99f-ce9ce208b3c1): created successfully Dec 25 21:39:57.370029 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5b7ec0c7-30e3-453a-80bc-6f97c3483afc tempest-VolumesBackupsTest-596628470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (453f5624-8b7d-4bc7-aa73-8f0cc907c842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:39:57.373031 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5b7ec0c7-30e3-453a-80bc-6f97c3483afc tempest-VolumesBackupsTest-596628470 None] Flow 'volume_create_manager' (b3c57235-1f4b-4cd5-91f4-98c8656d4ce1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:39:57.480661 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-1172edc8-ae77-4ee4-9ae2-74022aabe1d8 tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:39:57.656056 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-5b7ec0c7-30e3-453a-80bc-6f97c3483afc tempest-VolumesBackupsTest-596628470 None] Created volume successfully. Dec 25 21:39:57.759814 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-ee906305-8927-419f-a90c-adc4541c5eaa tempest-TaggedBootDevicesTest-292780470 None] Created reservations ['907a5e9a-c39f-4f15-85b0-de42f84a2805', '8af0706d-6a24-46ab-9037-efeb797b22eb', 'f7bff810-2095-4dbf-a141-f6d65d69bd1d', 'c8d58d5c-f808-414e-8663-6a4956fe613b'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:39:57.907165 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ee906305-8927-419f-a90c-adc4541c5eaa tempest-TaggedBootDevicesTest-292780470 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:39:58.062208 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ee906305-8927-419f-a90c-adc4541c5eaa tempest-TaggedBootDevicesTest-292780470 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:39:58.086477 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-ee906305-8927-419f-a90c-adc4541c5eaa tempest-TaggedBootDevicesTest-292780470 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:39:58.091149 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-ee906305-8927-419f-a90c-adc4541c5eaa tempest-TaggedBootDevicesTest-292780470 None] Deleted volume successfully. Dec 25 21:39:58.189518 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-ee906305-8927-419f-a90c-adc4541c5eaa tempest-TaggedBootDevicesTest-292780470 None] Lock "b'cinder-e7976291-a452-4d2e-b90b-b00735370896-delete_volume'" released by "delete_volume" :: held 14.024s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:39:58.222510 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-611da303-639c-4de7-86ec-fafa9614ee93 tempest-TaggedBootDevicesTest-292780470 None] Lock "b'cinder-6c571104-d681-49c0-b0ed-045a03bd3bba-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:39:58.335836 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-611da303-639c-4de7-86ec-fafa9614ee93 tempest-TaggedBootDevicesTest-292780470 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:39:59.084627 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-611da303-639c-4de7-86ec-fafa9614ee93 tempest-TaggedBootDevicesTest-292780470 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:39:59.455010 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-611da303-639c-4de7-86ec-fafa9614ee93 tempest-TaggedBootDevicesTest-292780470 None] deleting rbd volume volume-6c571104-d681-49c0-b0ed-045a03bd3bba {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:40:01.386725 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-1172edc8-ae77-4ee4-9ae2-74022aabe1d8 tempest-VolumesSnapshotTestJSON-639273304 None] Create snapshot completed successfully Dec 25 21:40:02.456514 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-fd9c0b6f-45be-43a6-973c-a4cf2d97c24a tempest-VolumesSnapshotTestJSON-639273304 None] Lock "b'cinder-7ae96968-2fec-440b-9c7b-108087cfbe56-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.015s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:40:02.478816 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-fd9c0b6f-45be-43a6-973c-a4cf2d97c24a tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:40:12.111081 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-efe5669a-a1cb-4bf0-9e15-c602897211d6 req-eb35eb5b-aea8-4652-ab44-95aa47e03e1b tempest-VolumesBackupsTest-596628470 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:40:12.756307 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-efe5669a-a1cb-4bf0-9e15-c602897211d6 req-eb35eb5b-aea8-4652-ab44-95aa47e03e1b tempest-VolumesBackupsTest-596628470 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.645s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:40:12.757169 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-efe5669a-a1cb-4bf0-9e15-c602897211d6 req-eb35eb5b-aea8-4652-ab44-95aa47e03e1b tempest-VolumesBackupsTest-596628470 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2e560f62-0022-4854-a99f-ce9ce208b3c1', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': '2e560f62-0022-4854-a99f-ce9ce208b3c1', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 21:40:12.883991 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-efe5669a-a1cb-4bf0-9e15-c602897211d6 req-eb35eb5b-aea8-4652-ab44-95aa47e03e1b tempest-VolumesBackupsTest-596628470 None] Connection info returned from driver {'name': 'volumes/volume-2e560f62-0022-4854-a99f-ce9ce208b3c1', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2e560f62-0022-4854-a99f-ce9ce208b3c1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '3bc88a67-e89c-492c-aae3-d978cbc1ed22'} {{(pid=129926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 25 21:40:13.028084 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-efe5669a-a1cb-4bf0-9e15-c602897211d6 req-eb35eb5b-aea8-4652-ab44-95aa47e03e1b tempest-VolumesBackupsTest-596628470 None] attachment_update completed successfully. Dec 25 21:40:14.540939 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-611da303-639c-4de7-86ec-fafa9614ee93 tempest-TaggedBootDevicesTest-292780470 None] volume is a clone so cleaning references {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 25 21:40:14.884641 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-611da303-639c-4de7-86ec-fafa9614ee93 tempest-TaggedBootDevicesTest-292780470 None] deleting parent snapshot volume-6c571104-d681-49c0-b0ed-045a03bd3bba.clone_snap {{(pid=129926) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 25 21:40:19.233765 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [None req-986f1f11-2cc3-4f93-b996-95854c87a1e9 tempest-VolumesBackupsTest-596628470 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:40:19.335218 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-611da303-639c-4de7-86ec-fafa9614ee93 tempest-TaggedBootDevicesTest-292780470 None] Created reservations ['97215b6e-c68b-4625-88f2-bd9838cd65c3', '48673492-85b8-4df8-8883-811d90a46354', 'f9681baa-3984-4fac-b22c-123079dca996', 'f80a9386-5c0d-438a-a14c-6cc0df71f5c9'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:40:19.513986 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-611da303-639c-4de7-86ec-fafa9614ee93 tempest-TaggedBootDevicesTest-292780470 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:40:19.549517 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-611da303-639c-4de7-86ec-fafa9614ee93 tempest-TaggedBootDevicesTest-292780470 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:40:19.588392 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-611da303-639c-4de7-86ec-fafa9614ee93 tempest-TaggedBootDevicesTest-292780470 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:40:19.593271 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-611da303-639c-4de7-86ec-fafa9614ee93 tempest-TaggedBootDevicesTest-292780470 None] Deleted volume successfully. Dec 25 21:40:19.677495 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-611da303-639c-4de7-86ec-fafa9614ee93 tempest-TaggedBootDevicesTest-292780470 None] Lock "b'cinder-6c571104-d681-49c0-b0ed-045a03bd3bba-delete_volume'" released by "delete_volume" :: held 21.455s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:40:19.895746 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [None req-986f1f11-2cc3-4f93-b996-95854c87a1e9 tempest-VolumesBackupsTest-596628470 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.662s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:40:19.896383 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-986f1f11-2cc3-4f93-b996-95854c87a1e9 tempest-VolumesBackupsTest-596628470 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2e560f62-0022-4854-a99f-ce9ce208b3c1', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': '2e560f62-0022-4854-a99f-ce9ce208b3c1', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 21:40:19.909180 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-986f1f11-2cc3-4f93-b996-95854c87a1e9 tempest-VolumesBackupsTest-596628470 None] Initialize volume connection completed successfully. Dec 25 21:40:22.442252 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-d0931f01-3f80-4d85-9ceb-e41f7a1f22d7 tempest-TestVolumeBackupRestore-1733305645 None] Terminate volume connection completed successfully. Dec 25 21:40:22.461225 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-d0931f01-3f80-4d85-9ceb-e41f7a1f22d7 tempest-TestVolumeBackupRestore-1733305645 None] Remove volume export completed successfully. Dec 25 21:40:24.155342 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dab36ad-1b77-4ca1-91c2-35e149ac0796 tempest-TestVolumeBackupRestore-1733305645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:40:24.164327 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-0dab36ad-1b77-4ca1-91c2-35e149ac0796 tempest-TestVolumeBackupRestore-1733305645 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:40:24.165375 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-0dab36ad-1b77-4ca1-91c2-35e149ac0796 tempest-TestVolumeBackupRestore-1733305645 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:40:24.180351 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0dab36ad-1b77-4ca1-91c2-35e149ac0796 tempest-TestVolumeBackupRestore-1733305645 None] Flow 'volume_create_manager' (54dae609-1113-4d7b-90be-5137b605ea59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:40:24.183963 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0dab36ad-1b77-4ca1-91c2-35e149ac0796 tempest-TestVolumeBackupRestore-1733305645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccb22dfb-48cc-4ac5-9110-d8c727a787c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:40:24.192022 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-0dab36ad-1b77-4ca1-91c2-35e149ac0796 tempest-TestVolumeBackupRestore-1733305645 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:40:24.207405 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0dab36ad-1b77-4ca1-91c2-35e149ac0796 tempest-TestVolumeBackupRestore-1733305645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccb22dfb-48cc-4ac5-9110-d8c727a787c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:40:23Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_7c3cc723-7f3f-422b-b14b-8ba52dfd371f',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=beb1f33b-8577-4e27-b087-711ea8d893c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca293d68b8cc44e6b641d477c9a3eb50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:40:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:40:24Z,use_quota=True,user_id='e8dd3c4dd2344bee986e909d5c45112a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:40:24.210587 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0dab36ad-1b77-4ca1-91c2-35e149ac0796 tempest-TestVolumeBackupRestore-1733305645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4421bbb6-fef6-4fc3-b05c-ea06d522adbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:40:24.215025 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0dab36ad-1b77-4ca1-91c2-35e149ac0796 tempest-TestVolumeBackupRestore-1733305645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4421bbb6-fef6-4fc3-b05c-ea06d522adbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:40:24.217883 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0dab36ad-1b77-4ca1-91c2-35e149ac0796 tempest-TestVolumeBackupRestore-1733305645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c871b5c-2657-4226-af99-f5578dbae206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:40:24.227867 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0dab36ad-1b77-4ca1-91c2-35e149ac0796 tempest-TestVolumeBackupRestore-1733305645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c871b5c-2657-4226-af99-f5578dbae206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beb1f33b-8577-4e27-b087-711ea8d893c7', 'volume_name': 'volume-beb1f33b-8577-4e27-b087-711ea8d893c7', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:40:24.227867 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0dab36ad-1b77-4ca1-91c2-35e149ac0796 tempest-TestVolumeBackupRestore-1733305645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dc87950-4fc4-415b-948d-7c1f918c4877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:40:24.227867 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0dab36ad-1b77-4ca1-91c2-35e149ac0796 tempest-TestVolumeBackupRestore-1733305645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dc87950-4fc4-415b-948d-7c1f918c4877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:40:24.228632 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0dab36ad-1b77-4ca1-91c2-35e149ac0796 tempest-TestVolumeBackupRestore-1733305645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b4deaa5-24f9-461b-8cd9-5b35a352d337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:40:24.229728 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-0dab36ad-1b77-4ca1-91c2-35e149ac0796 tempest-TestVolumeBackupRestore-1733305645 None] Volume beb1f33b-8577-4e27-b087-711ea8d893c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beb1f33b-8577-4e27-b087-711ea8d893c7', 'volume_size': 1} Dec 25 21:40:24.230292 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0dab36ad-1b77-4ca1-91c2-35e149ac0796 tempest-TestVolumeBackupRestore-1733305645 None] creating volume 'volume-beb1f33b-8577-4e27-b087-711ea8d893c7' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:40:24.231298 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0dab36ad-1b77-4ca1-91c2-35e149ac0796 tempest-TestVolumeBackupRestore-1733305645 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:40:25.343752 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0dab36ad-1b77-4ca1-91c2-35e149ac0796 tempest-TestVolumeBackupRestore-1733305645 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:40:25.344439 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0dab36ad-1b77-4ca1-91c2-35e149ac0796 tempest-TestVolumeBackupRestore-1733305645 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:40:25.346242 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0dab36ad-1b77-4ca1-91c2-35e149ac0796 tempest-TestVolumeBackupRestore-1733305645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b4deaa5-24f9-461b-8cd9-5b35a352d337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beb1f33b-8577-4e27-b087-711ea8d893c7', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:40:25.349796 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0dab36ad-1b77-4ca1-91c2-35e149ac0796 tempest-TestVolumeBackupRestore-1733305645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50713d32-3443-46e3-9271-f8dabb5d753e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:40:25.438107 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-0dab36ad-1b77-4ca1-91c2-35e149ac0796 tempest-TestVolumeBackupRestore-1733305645 None] Volume volume-beb1f33b-8577-4e27-b087-711ea8d893c7 (beb1f33b-8577-4e27-b087-711ea8d893c7): created successfully Dec 25 21:40:25.440122 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0dab36ad-1b77-4ca1-91c2-35e149ac0796 tempest-TestVolumeBackupRestore-1733305645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50713d32-3443-46e3-9271-f8dabb5d753e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:40:25.443664 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0dab36ad-1b77-4ca1-91c2-35e149ac0796 tempest-TestVolumeBackupRestore-1733305645 None] Flow 'volume_create_manager' (54dae609-1113-4d7b-90be-5137b605ea59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:40:25.518095 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-0dab36ad-1b77-4ca1-91c2-35e149ac0796 tempest-TestVolumeBackupRestore-1733305645 None] Created volume successfully. Dec 25 21:40:25.960104 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-986f1f11-2cc3-4f93-b996-95854c87a1e9 tempest-VolumesBackupsTest-596628470 None] Terminate volume connection completed successfully. Dec 25 21:40:25.982543 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-986f1f11-2cc3-4f93-b996-95854c87a1e9 tempest-VolumesBackupsTest-596628470 None] Remove volume export completed successfully. Dec 25 21:40:26.243242 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [None req-0dab36ad-1b77-4ca1-91c2-35e149ac0796 tempest-TestVolumeBackupRestore-1733305645 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:40:26.918409 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [None req-0dab36ad-1b77-4ca1-91c2-35e149ac0796 tempest-TestVolumeBackupRestore-1733305645 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.675s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:40:26.919974 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0dab36ad-1b77-4ca1-91c2-35e149ac0796 tempest-TestVolumeBackupRestore-1733305645 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-beb1f33b-8577-4e27-b087-711ea8d893c7', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': 'beb1f33b-8577-4e27-b087-711ea8d893c7', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 21:40:26.938559 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-0dab36ad-1b77-4ca1-91c2-35e149ac0796 tempest-TestVolumeBackupRestore-1733305645 None] Initialize volume connection completed successfully. Dec 25 21:40:35.712040 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-fd9c0b6f-45be-43a6-973c-a4cf2d97c24a tempest-VolumesSnapshotTestJSON-639273304 None] Created reservations ['913e7e65-e165-4d3c-a674-ebc201f241b6', '04748975-8cbc-4a76-b726-0027e1827900', '6bdb6125-afcf-4c41-8980-d658aef345b6', '984f195b-f7a3-412e-8196-7412ca31b8ec'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:40:35.883400 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-fd9c0b6f-45be-43a6-973c-a4cf2d97c24a tempest-VolumesSnapshotTestJSON-639273304 None] Delete snapshot completed successfully. Dec 25 21:40:35.893774 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-fd9c0b6f-45be-43a6-973c-a4cf2d97c24a tempest-VolumesSnapshotTestJSON-639273304 None] Lock "b'cinder-7ae96968-2fec-440b-9c7b-108087cfbe56-delete_snapshot'" released by "delete_snapshot" :: held 33.437s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:40:36.619389 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-af4e6319-8721-4ad2-b680-e1f0278169ee tempest-VolumesSnapshotTestJSON-639273304 None] Lock "b'cinder-5d586bf7-33a6-48b1-9dcd-69a3d7d27fea-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:40:36.625261 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-af4e6319-8721-4ad2-b680-e1f0278169ee tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:40:44.047310 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-3f92348a-6b96-40d9-ba51-ef9eadd2e8bd req-c7281571-0b97-4d36-87a0-ad51b2a47e22 tempest-VolumesBackupsTest-596628470 None] Terminate volume connection completed successfully. Dec 25 21:40:44.048033 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-3f92348a-6b96-40d9-ba51-ef9eadd2e8bd req-c7281571-0b97-4d36-87a0-ad51b2a47e22 tempest-VolumesBackupsTest-596628470 None] Deleting attachment 3bc88a67-e89c-492c-aae3-d978cbc1ed22. {{(pid=129926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 25 21:40:50.083751 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-822649d1-5b91-4671-b367-75e2f54fee80 tempest-VolumesBackupsTest-596628470 None] Lock "b'cinder-2e560f62-0022-4854-a99f-ce9ce208b3c1-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:40:50.192062 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-822649d1-5b91-4671-b367-75e2f54fee80 tempest-VolumesBackupsTest-596628470 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:40:55.042282 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-822649d1-5b91-4671-b367-75e2f54fee80 tempest-VolumesBackupsTest-596628470 None] Volume volume-2e560f62-0022-4854-a99f-ce9ce208b3c1 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:40:56.216946 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-822649d1-5b91-4671-b367-75e2f54fee80 tempest-VolumesBackupsTest-596628470 None] deleting rbd volume volume-2e560f62-0022-4854-a99f-ce9ce208b3c1 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:41:07.168708 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-822649d1-5b91-4671-b367-75e2f54fee80 tempest-VolumesBackupsTest-596628470 None] Created reservations ['6a7794f1-1520-4f45-a5ea-739cf2835343', 'edfb036d-b209-44cd-8cde-69cd299f53ab', '923edcba-cfa1-4f67-9758-7644a7d24c34', '8c4b7207-ad20-4c2c-b23a-fdd7f89243d3'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:41:07.420646 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-822649d1-5b91-4671-b367-75e2f54fee80 tempest-VolumesBackupsTest-596628470 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:41:07.443957 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-822649d1-5b91-4671-b367-75e2f54fee80 tempest-VolumesBackupsTest-596628470 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:41:07.466908 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-822649d1-5b91-4671-b367-75e2f54fee80 tempest-VolumesBackupsTest-596628470 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:41:07.471265 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-822649d1-5b91-4671-b367-75e2f54fee80 tempest-VolumesBackupsTest-596628470 None] Deleted volume successfully. Dec 25 21:41:07.544944 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-822649d1-5b91-4671-b367-75e2f54fee80 tempest-VolumesBackupsTest-596628470 None] Lock "b'cinder-2e560f62-0022-4854-a99f-ce9ce208b3c1-delete_volume'" released by "delete_volume" :: held 17.461s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:41:08.719184 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-af4e6319-8721-4ad2-b680-e1f0278169ee tempest-VolumesSnapshotTestJSON-639273304 None] Created reservations ['b2352112-2819-443e-98d3-af67af854733', '13ac4bf3-dfb5-4d93-b4cd-3eca1e2e1c1c', 'fabefab5-c2a1-41a0-9a95-e83944d998cb', '5a5dccd4-1c4a-4f71-8c34-b826dcf60794'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:41:08.890136 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-af4e6319-8721-4ad2-b680-e1f0278169ee tempest-VolumesSnapshotTestJSON-639273304 None] Delete snapshot completed successfully. Dec 25 21:41:08.894682 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-af4e6319-8721-4ad2-b680-e1f0278169ee tempest-VolumesSnapshotTestJSON-639273304 None] Lock "b'cinder-5d586bf7-33a6-48b1-9dcd-69a3d7d27fea-delete_snapshot'" released by "delete_snapshot" :: held 32.276s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:41:08.954190 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-e27e2c4a-49dc-4a03-93f2-80f118b3bd93 tempest-VolumesBackupsTest-596628470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:41:08.957879 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-e27e2c4a-49dc-4a03-93f2-80f118b3bd93 tempest-VolumesBackupsTest-596628470 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:41:08.958370 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-e27e2c4a-49dc-4a03-93f2-80f118b3bd93 tempest-VolumesBackupsTest-596628470 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:41:08.970811 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e27e2c4a-49dc-4a03-93f2-80f118b3bd93 tempest-VolumesBackupsTest-596628470 None] Flow 'volume_create_manager' (1d2d561d-2302-4abf-9d03-aa2d15a772c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:41:08.976202 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e27e2c4a-49dc-4a03-93f2-80f118b3bd93 tempest-VolumesBackupsTest-596628470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa832b6f-3429-4949-acb4-228f84f5179d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:41:08.982131 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-e27e2c4a-49dc-4a03-93f2-80f118b3bd93 tempest-VolumesBackupsTest-596628470 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:41:08.994679 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e27e2c4a-49dc-4a03-93f2-80f118b3bd93 tempest-VolumesBackupsTest-596628470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa832b6f-3429-4949-acb4-228f84f5179d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1466707841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e2767895-8ea1-400c-9c10-00e5832d20fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a6f7f2d4b1243369e6e2a101f68557c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:41:09Z,use_quota=True,user_id='0b6c0fe828da4c18ae9764400f30740d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:41:08.997415 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e27e2c4a-49dc-4a03-93f2-80f118b3bd93 tempest-VolumesBackupsTest-596628470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72c71b6b-bbce-4f49-b18e-3c4e8f20a80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:41:09.000159 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e27e2c4a-49dc-4a03-93f2-80f118b3bd93 tempest-VolumesBackupsTest-596628470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72c71b6b-bbce-4f49-b18e-3c4e8f20a80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:41:09.002602 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e27e2c4a-49dc-4a03-93f2-80f118b3bd93 tempest-VolumesBackupsTest-596628470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f0cd770-a5b7-41f9-9293-f944cf965a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:41:09.080849 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e27e2c4a-49dc-4a03-93f2-80f118b3bd93 tempest-VolumesBackupsTest-596628470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f0cd770-a5b7-41f9-9293-f944cf965a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e2767895-8ea1-400c-9c10-00e5832d20fb', 'volume_name': 'volume-e2767895-8ea1-400c-9c10-00e5832d20fb', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:41:09.083290 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e27e2c4a-49dc-4a03-93f2-80f118b3bd93 tempest-VolumesBackupsTest-596628470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d784a22-aa3d-4243-b221-a5e9a32659b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:41:09.085614 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e27e2c4a-49dc-4a03-93f2-80f118b3bd93 tempest-VolumesBackupsTest-596628470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d784a22-aa3d-4243-b221-a5e9a32659b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:41:09.088755 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e27e2c4a-49dc-4a03-93f2-80f118b3bd93 tempest-VolumesBackupsTest-596628470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69712eb8-c9a8-4f41-8307-8cfee32cc0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:41:09.088755 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-e27e2c4a-49dc-4a03-93f2-80f118b3bd93 tempest-VolumesBackupsTest-596628470 None] Volume e2767895-8ea1-400c-9c10-00e5832d20fb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e2767895-8ea1-400c-9c10-00e5832d20fb', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 25 21:41:09.089509 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-e27e2c4a-49dc-4a03-93f2-80f118b3bd93 tempest-VolumesBackupsTest-596628470 None] Cloning e2767895-8ea1-400c-9c10-00e5832d20fb from image aca914d0-5f7b-465f-a024-75efa27d7291 at location (None, None). {{(pid=129926) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Dec 25 21:41:09.097888 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-e27e2c4a-49dc-4a03-93f2-80f118b3bd93 tempest-VolumesBackupsTest-596628470 None] Lock "b'cinder-aca914d0-5f7b-465f-a024-75efa27d7291'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:41:09.168547 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-e27e2c4a-49dc-4a03-93f2-80f118b3bd93 tempest-VolumesBackupsTest-596628470 None] Found image-volume cache entry: {'id': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'volume_id': '058f5fb3-51e4-40e3-9c98-542207f1fc1f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31), 'last_used': datetime.datetime(2021, 12, 25, 21, 41, 9, 101889)}. {{(pid=129926) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 25 21:41:09.168922 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-e27e2c4a-49dc-4a03-93f2-80f118b3bd93 tempest-VolumesBackupsTest-596628470 None] Image-volume cache entry image_update_at = 2021-12-25 20:58:31+00:00, requested image updated_at = 2021-12-25 20:58:31+00:00. {{(pid=129926) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 25 21:41:09.169332 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-e27e2c4a-49dc-4a03-93f2-80f118b3bd93 tempest-VolumesBackupsTest-596628470 None] Found cache entry for image = aca914d0-5f7b-465f-a024-75efa27d7291 on host ncdv-master-1@ceph#ceph. {{(pid=129926) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Dec 25 21:41:09.174499 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-e27e2c4a-49dc-4a03-93f2-80f118b3bd93 tempest-VolumesBackupsTest-596628470 None] Lock "b'cinder-aca914d0-5f7b-465f-a024-75efa27d7291'" released by "_prepare_image_cache_entry" :: held 0.077s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:41:09.175410 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-e27e2c4a-49dc-4a03-93f2-80f118b3bd93 tempest-VolumesBackupsTest-596628470 None] Attempting to retrieve cache entry for image = aca914d0-5f7b-465f-a024-75efa27d7291 on host ncdv-master-1@ceph#ceph. {{(pid=129926) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Dec 25 21:41:09.181058 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-e27e2c4a-49dc-4a03-93f2-80f118b3bd93 tempest-VolumesBackupsTest-596628470 None] Found image-volume cache entry: {'id': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'volume_id': '058f5fb3-51e4-40e3-9c98-542207f1fc1f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31), 'last_used': datetime.datetime(2021, 12, 25, 21, 41, 9, 178846)}. {{(pid=129926) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 25 21:41:09.181506 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-e27e2c4a-49dc-4a03-93f2-80f118b3bd93 tempest-VolumesBackupsTest-596628470 None] Image-volume cache entry image_update_at = 2021-12-25 20:58:31+00:00, requested image updated_at = 2021-12-25 20:58:31+00:00. {{(pid=129926) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 25 21:41:09.181899 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-e27e2c4a-49dc-4a03-93f2-80f118b3bd93 tempest-VolumesBackupsTest-596628470 None] Creating from source image-volume 058f5fb3-51e4-40e3-9c98-542207f1fc1f {{(pid=129926) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Dec 25 21:41:09.195385 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e27e2c4a-49dc-4a03-93f2-80f118b3bd93 tempest-VolumesBackupsTest-596628470 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:41:09.425697 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e27e2c4a-49dc-4a03-93f2-80f118b3bd93 tempest-VolumesBackupsTest-596628470 None] creating snapshot='volume-e2767895-8ea1-400c-9c10-00e5832d20fb.clone_snap' {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 25 21:41:12.169236 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e27e2c4a-49dc-4a03-93f2-80f118b3bd93 tempest-VolumesBackupsTest-596628470 None] cloning 'volume-058f5fb3-51e4-40e3-9c98-542207f1fc1f@volume-e2767895-8ea1-400c-9c10-00e5832d20fb.clone_snap' to 'volume-e2767895-8ea1-400c-9c10-00e5832d20fb' {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 25 21:41:12.187177 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-b74aace9-73d8-483e-804a-841145003efb tempest-VolumesSnapshotTestJSON-639273304 None] Lock "b'cinder-063f78b5-d77b-4f22-a888-4ff02e76a6bb-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:41:12.188783 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b74aace9-73d8-483e-804a-841145003efb tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:41:13.942139 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e27e2c4a-49dc-4a03-93f2-80f118b3bd93 tempest-VolumesBackupsTest-596628470 None] Volume volume-98b6d31e-e760-499e-8962-7b22479c1e9a.deleted is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:41:13.943271 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e27e2c4a-49dc-4a03-93f2-80f118b3bd93 tempest-VolumesBackupsTest-596628470 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:41:13.943649 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e27e2c4a-49dc-4a03-93f2-80f118b3bd93 tempest-VolumesBackupsTest-596628470 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:41:14.613310 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e27e2c4a-49dc-4a03-93f2-80f118b3bd93 tempest-VolumesBackupsTest-596628470 None] clone created successfully {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 25 21:41:14.613927 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.volume_utils [None req-e27e2c4a-49dc-4a03-93f2-80f118b3bd93 tempest-VolumesBackupsTest-596628470 None] Marking volume e2767895-8ea1-400c-9c10-00e5832d20fb as bootable. {{(pid=129926) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 25 21:41:14.665253 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-e27e2c4a-49dc-4a03-93f2-80f118b3bd93 tempest-VolumesBackupsTest-596628470 None] Copying metadata from image aca914d0-5f7b-465f-a024-75efa27d7291 to e2767895-8ea1-400c-9c10-00e5832d20fb. {{(pid=129926) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Dec 25 21:41:14.665677 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-e27e2c4a-49dc-4a03-93f2-80f118b3bd93 tempest-VolumesBackupsTest-596628470 None] Creating volume glance metadata for volume e2767895-8ea1-400c-9c10-00e5832d20fb backed by image aca914d0-5f7b-465f-a024-75efa27d7291 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129926) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Dec 25 21:41:14.770890 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e27e2c4a-49dc-4a03-93f2-80f118b3bd93 tempest-VolumesBackupsTest-596628470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69712eb8-c9a8-4f41-8307-8cfee32cc0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2767895-8ea1-400c-9c10-00e5832d20fb', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:41:14.774545 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e27e2c4a-49dc-4a03-93f2-80f118b3bd93 tempest-VolumesBackupsTest-596628470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33156628-e23d-45f3-b81b-426e5074aae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:41:14.877181 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-e27e2c4a-49dc-4a03-93f2-80f118b3bd93 tempest-VolumesBackupsTest-596628470 None] Volume volume-e2767895-8ea1-400c-9c10-00e5832d20fb (e2767895-8ea1-400c-9c10-00e5832d20fb): created successfully Dec 25 21:41:14.879138 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e27e2c4a-49dc-4a03-93f2-80f118b3bd93 tempest-VolumesBackupsTest-596628470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33156628-e23d-45f3-b81b-426e5074aae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:41:14.882134 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-e27e2c4a-49dc-4a03-93f2-80f118b3bd93 tempest-VolumesBackupsTest-596628470 None] Flow 'volume_create_manager' (1d2d561d-2302-4abf-9d03-aa2d15a772c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:41:15.003110 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-e27e2c4a-49dc-4a03-93f2-80f118b3bd93 tempest-VolumesBackupsTest-596628470 None] Created volume successfully. Dec 25 21:41:15.884144 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [None req-4e5e29d2-86fa-49b7-82f4-be229232b47d tempest-VolumesBackupsTest-596628470 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:41:16.186407 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-0dab36ad-1b77-4ca1-91c2-35e149ac0796 tempest-TestVolumeBackupRestore-1733305645 None] Terminate volume connection completed successfully. Dec 25 21:41:16.203889 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-0dab36ad-1b77-4ca1-91c2-35e149ac0796 tempest-TestVolumeBackupRestore-1733305645 None] Remove volume export completed successfully. Dec 25 21:41:16.587772 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [None req-4e5e29d2-86fa-49b7-82f4-be229232b47d tempest-VolumesBackupsTest-596628470 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.703s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:41:16.588590 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-4e5e29d2-86fa-49b7-82f4-be229232b47d tempest-VolumesBackupsTest-596628470 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e2767895-8ea1-400c-9c10-00e5832d20fb', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': 'e2767895-8ea1-400c-9c10-00e5832d20fb', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 21:41:16.607127 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-4e5e29d2-86fa-49b7-82f4-be229232b47d tempest-VolumesBackupsTest-596628470 None] Initialize volume connection completed successfully. Dec 25 21:41:22.995021 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-f6c09fc4-ab64-43f4-ab0f-85527f958887 req-4576a004-4785-4b2a-9c76-3421001c0132 tempest-TestVolumeBackupRestore-1733305645 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:41:23.827095 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-f6c09fc4-ab64-43f4-ab0f-85527f958887 req-4576a004-4785-4b2a-9c76-3421001c0132 tempest-TestVolumeBackupRestore-1733305645 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.832s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:41:23.828007 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-f6c09fc4-ab64-43f4-ab0f-85527f958887 req-4576a004-4785-4b2a-9c76-3421001c0132 tempest-TestVolumeBackupRestore-1733305645 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-beb1f33b-8577-4e27-b087-711ea8d893c7', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': 'beb1f33b-8577-4e27-b087-711ea8d893c7', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 21:41:23.889727 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-f6c09fc4-ab64-43f4-ab0f-85527f958887 req-4576a004-4785-4b2a-9c76-3421001c0132 tempest-TestVolumeBackupRestore-1733305645 None] Connection info returned from driver {'name': 'volumes/volume-beb1f33b-8577-4e27-b087-711ea8d893c7', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'beb1f33b-8577-4e27-b087-711ea8d893c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f8e0ae83-d7a6-4f34-88bd-82923b623217'} {{(pid=129926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 25 21:41:24.007656 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-f6c09fc4-ab64-43f4-ab0f-85527f958887 req-4576a004-4785-4b2a-9c76-3421001c0132 tempest-TestVolumeBackupRestore-1733305645 None] attachment_update completed successfully. Dec 25 21:41:32.063938 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:41:32.064902 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:41:32.096489 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:41:32.158318 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:41:44.432395 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-b74aace9-73d8-483e-804a-841145003efb tempest-VolumesSnapshotTestJSON-639273304 None] Created reservations ['08d30edd-3d47-4a2e-88b3-a37848575e21', '848c3a3c-1873-4e68-8bfb-211b9bed70d5', '8c4aba3f-3570-490f-ac31-572a5ec4d140', 'd5da7e27-638d-4f5c-bbd4-6d39a5c1c28b'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:41:44.612048 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-b74aace9-73d8-483e-804a-841145003efb tempest-VolumesSnapshotTestJSON-639273304 None] Delete snapshot completed successfully. Dec 25 21:41:44.617337 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-b74aace9-73d8-483e-804a-841145003efb tempest-VolumesSnapshotTestJSON-639273304 None] Lock "b'cinder-063f78b5-d77b-4f22-a888-4ff02e76a6bb-delete_snapshot'" released by "delete_snapshot" :: held 32.430s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:41:45.663630 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-b8a8e7dc-7f4b-4e19-bf9a-13dc92baf31e req-0e28faab-6b70-4f07-a195-6b87816e3530 tempest-VolumesSnapshotTestJSON-639273304 None] Terminate volume connection completed successfully. Dec 25 21:41:45.664265 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-b8a8e7dc-7f4b-4e19-bf9a-13dc92baf31e req-0e28faab-6b70-4f07-a195-6b87816e3530 tempest-VolumesSnapshotTestJSON-639273304 None] Deleting attachment 91a34053-a1f6-4401-9bee-ba0360f400b8. {{(pid=129926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 25 21:41:51.128949 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebda1aab-b373-4dd9-9bad-cd8f8826cf73 tempest-VolumesSnapshotTestJSON-639273304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:41:51.132807 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-ebda1aab-b373-4dd9-9bad-cd8f8826cf73 tempest-VolumesSnapshotTestJSON-639273304 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:41:51.133303 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-ebda1aab-b373-4dd9-9bad-cd8f8826cf73 tempest-VolumesSnapshotTestJSON-639273304 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:41:51.150710 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ebda1aab-b373-4dd9-9bad-cd8f8826cf73 tempest-VolumesSnapshotTestJSON-639273304 None] Flow 'volume_create_manager' (63d62db4-4ecb-4439-811e-7136f0137804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:41:51.154485 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ebda1aab-b373-4dd9-9bad-cd8f8826cf73 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6817098e-cbfe-4012-ad84-0b60a2a2e5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:41:51.161755 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-ebda1aab-b373-4dd9-9bad-cd8f8826cf73 tempest-VolumesSnapshotTestJSON-639273304 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:41:51.175374 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ebda1aab-b373-4dd9-9bad-cd8f8826cf73 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6817098e-cbfe-4012-ad84-0b60a2a2e5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-952161174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8ef25d71-29cc-4203-a518-c92289384c4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a416565d81324f55b88111b36c4a777c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:41:51Z,use_quota=True,user_id='c3a55c151bef4387a4fef00ab6687a20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:41:51.177899 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ebda1aab-b373-4dd9-9bad-cd8f8826cf73 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e7d59b0-a710-47fd-9744-50f331652c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:41:51.180046 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ebda1aab-b373-4dd9-9bad-cd8f8826cf73 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e7d59b0-a710-47fd-9744-50f331652c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:41:51.182901 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ebda1aab-b373-4dd9-9bad-cd8f8826cf73 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e869a75c-1d73-4886-b7ea-4666578400cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:41:51.185187 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ebda1aab-b373-4dd9-9bad-cd8f8826cf73 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e869a75c-1d73-4886-b7ea-4666578400cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ef25d71-29cc-4203-a518-c92289384c4b', 'volume_name': 'volume-8ef25d71-29cc-4203-a518-c92289384c4b', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:41:51.187477 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ebda1aab-b373-4dd9-9bad-cd8f8826cf73 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5317b3fe-44b4-4af5-9826-ecd39d9acad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:41:51.189783 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ebda1aab-b373-4dd9-9bad-cd8f8826cf73 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5317b3fe-44b4-4af5-9826-ecd39d9acad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:41:51.192076 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ebda1aab-b373-4dd9-9bad-cd8f8826cf73 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (625c7d05-3beb-4baf-a6b6-d6cc00231db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:41:51.192930 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-ebda1aab-b373-4dd9-9bad-cd8f8826cf73 tempest-VolumesSnapshotTestJSON-639273304 None] Volume 8ef25d71-29cc-4203-a518-c92289384c4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ef25d71-29cc-4203-a518-c92289384c4b', 'volume_size': 1} Dec 25 21:41:51.193331 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ebda1aab-b373-4dd9-9bad-cd8f8826cf73 tempest-VolumesSnapshotTestJSON-639273304 None] creating volume 'volume-8ef25d71-29cc-4203-a518-c92289384c4b' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:41:51.198854 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ebda1aab-b373-4dd9-9bad-cd8f8826cf73 tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:41:53.230097 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ebda1aab-b373-4dd9-9bad-cd8f8826cf73 tempest-VolumesSnapshotTestJSON-639273304 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:41:53.230700 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ebda1aab-b373-4dd9-9bad-cd8f8826cf73 tempest-VolumesSnapshotTestJSON-639273304 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:41:53.232644 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ebda1aab-b373-4dd9-9bad-cd8f8826cf73 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (625c7d05-3beb-4baf-a6b6-d6cc00231db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ef25d71-29cc-4203-a518-c92289384c4b', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:41:53.235151 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ebda1aab-b373-4dd9-9bad-cd8f8826cf73 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9e24f71-3bbd-49f2-ac4b-366b671458e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:41:53.340203 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-ebda1aab-b373-4dd9-9bad-cd8f8826cf73 tempest-VolumesSnapshotTestJSON-639273304 None] Volume volume-8ef25d71-29cc-4203-a518-c92289384c4b (8ef25d71-29cc-4203-a518-c92289384c4b): created successfully Dec 25 21:41:53.342472 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ebda1aab-b373-4dd9-9bad-cd8f8826cf73 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9e24f71-3bbd-49f2-ac4b-366b671458e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:41:53.345458 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ebda1aab-b373-4dd9-9bad-cd8f8826cf73 tempest-VolumesSnapshotTestJSON-639273304 None] Flow 'volume_create_manager' (63d62db4-4ecb-4439-811e-7136f0137804) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:41:53.448675 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-ebda1aab-b373-4dd9-9bad-cd8f8826cf73 tempest-VolumesSnapshotTestJSON-639273304 None] Created volume successfully. Dec 25 21:41:54.499932 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-510f9629-1afa-48c4-8fab-dc6a56d47236 tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:41:59.717430 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-510f9629-1afa-48c4-8fab-dc6a56d47236 tempest-VolumesSnapshotTestJSON-639273304 None] Create snapshot completed successfully Dec 25 21:42:01.455780 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-114c847a-be5b-475e-9b01-44eb368709be tempest-VolumesSnapshotTestJSON-639273304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:42:01.459707 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-114c847a-be5b-475e-9b01-44eb368709be tempest-VolumesSnapshotTestJSON-639273304 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:42:01.460152 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-114c847a-be5b-475e-9b01-44eb368709be tempest-VolumesSnapshotTestJSON-639273304 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:42:01.484657 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-114c847a-be5b-475e-9b01-44eb368709be tempest-VolumesSnapshotTestJSON-639273304 None] Flow 'volume_create_manager' (48e05ea3-5f0e-41b3-881a-946d99e39f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:42:01.488507 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-114c847a-be5b-475e-9b01-44eb368709be tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbb19447-6d76-48eb-899e-9aa898fd5385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:42:01.495904 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-114c847a-be5b-475e-9b01-44eb368709be tempest-VolumesSnapshotTestJSON-639273304 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:42:01.508418 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-114c847a-be5b-475e-9b01-44eb368709be tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbb19447-6d76-48eb-899e-9aa898fd5385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-74500600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9829f26f-2a07-49f2-ad32-73b90d638581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a416565d81324f55b88111b36c4a777c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:42:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=4d6bb17b-6ba3-4ba0-a7e3-56086ec66cd1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:42:01Z,use_quota=True,user_id='c3a55c151bef4387a4fef00ab6687a20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:42:01.511098 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-114c847a-be5b-475e-9b01-44eb368709be tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b924490c-f8ea-422d-a180-339a2b2264fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:42:01.513541 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-114c847a-be5b-475e-9b01-44eb368709be tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b924490c-f8ea-422d-a180-339a2b2264fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:42:01.515974 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-114c847a-be5b-475e-9b01-44eb368709be tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2815742c-9a3e-42de-99d4-1ab61dde7a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:42:01.518290 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-114c847a-be5b-475e-9b01-44eb368709be tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2815742c-9a3e-42de-99d4-1ab61dde7a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9829f26f-2a07-49f2-ad32-73b90d638581', 'volume_name': 'volume-9829f26f-2a07-49f2-ad32-73b90d638581', 'volume_size': 2, 'snapshot_id': '4d6bb17b-6ba3-4ba0-a7e3-56086ec66cd1'}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:42:01.521099 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-114c847a-be5b-475e-9b01-44eb368709be tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2e6bb8b-6148-488a-9698-13553824602a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:42:01.523223 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-114c847a-be5b-475e-9b01-44eb368709be tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2e6bb8b-6148-488a-9698-13553824602a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:42:01.525939 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-114c847a-be5b-475e-9b01-44eb368709be tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (300d45f5-d21d-4482-90a4-9eeb3d6af89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:42:01.526390 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-114c847a-be5b-475e-9b01-44eb368709be tempest-VolumesSnapshotTestJSON-639273304 None] Volume 9829f26f-2a07-49f2-ad32-73b90d638581: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9829f26f-2a07-49f2-ad32-73b90d638581', 'volume_size': 2, 'snapshot_id': '4d6bb17b-6ba3-4ba0-a7e3-56086ec66cd1'} Dec 25 21:42:01.548273 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-114c847a-be5b-475e-9b01-44eb368709be tempest-VolumesSnapshotTestJSON-639273304 None] cloning volumes/volume-8ef25d71-29cc-4203-a518-c92289384c4b@snapshot-4d6bb17b-6ba3-4ba0-a7e3-56086ec66cd1 to volume-9829f26f-2a07-49f2-ad32-73b90d638581 {{(pid=129926) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Dec 25 21:42:01.549355 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-114c847a-be5b-475e-9b01-44eb368709be tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:42:01.594412 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-114c847a-be5b-475e-9b01-44eb368709be tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:42:03.608252 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-114c847a-be5b-475e-9b01-44eb368709be tempest-VolumesSnapshotTestJSON-639273304 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:42:03.609180 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-114c847a-be5b-475e-9b01-44eb368709be tempest-VolumesSnapshotTestJSON-639273304 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:42:03.615361 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-114c847a-be5b-475e-9b01-44eb368709be tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:42:05.241922 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-4e5e29d2-86fa-49b7-82f4-be229232b47d tempest-VolumesBackupsTest-596628470 None] Terminate volume connection completed successfully. Dec 25 21:42:05.259083 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-4e5e29d2-86fa-49b7-82f4-be229232b47d tempest-VolumesBackupsTest-596628470 None] Remove volume export completed successfully. Dec 25 21:42:05.414979 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-114c847a-be5b-475e-9b01-44eb368709be tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (300d45f5-d21d-4482-90a4-9eeb3d6af89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9829f26f-2a07-49f2-ad32-73b90d638581', 'volume_size': 2, 'snapshot_id': '4d6bb17b-6ba3-4ba0-a7e3-56086ec66cd1'}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:42:05.417268 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-114c847a-be5b-475e-9b01-44eb368709be tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (334bfa09-cfb4-4a2f-b21a-a9e964df7ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:42:05.459934 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-114c847a-be5b-475e-9b01-44eb368709be tempest-VolumesSnapshotTestJSON-639273304 None] Volume volume-9829f26f-2a07-49f2-ad32-73b90d638581 (9829f26f-2a07-49f2-ad32-73b90d638581): created successfully Dec 25 21:42:05.461853 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-114c847a-be5b-475e-9b01-44eb368709be tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (334bfa09-cfb4-4a2f-b21a-a9e964df7ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:42:05.464781 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-114c847a-be5b-475e-9b01-44eb368709be tempest-VolumesSnapshotTestJSON-639273304 None] Flow 'volume_create_manager' (48e05ea3-5f0e-41b3-881a-946d99e39f10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:42:05.517284 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-114c847a-be5b-475e-9b01-44eb368709be tempest-VolumesSnapshotTestJSON-639273304 None] Created volume successfully. Dec 25 21:42:06.715881 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-4c91fbb1-c77e-4616-bc05-82c9f67c90b4 tempest-VolumesSnapshotTestJSON-639273304 None] Lock "b'cinder-9829f26f-2a07-49f2-ad32-73b90d638581-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:42:06.820434 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a9faf64-891d-4d7d-9537-8eea7c0f36a0 tempest-VolumesBackupsTest-596628470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:42:06.823867 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-0a9faf64-891d-4d7d-9537-8eea7c0f36a0 tempest-VolumesBackupsTest-596628470 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:42:06.824358 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-0a9faf64-891d-4d7d-9537-8eea7c0f36a0 tempest-VolumesBackupsTest-596628470 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:42:06.838655 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0a9faf64-891d-4d7d-9537-8eea7c0f36a0 tempest-VolumesBackupsTest-596628470 None] Flow 'volume_create_manager' (59d1a219-b736-4ef3-9096-b5e94ef8572d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:42:06.841933 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0a9faf64-891d-4d7d-9537-8eea7c0f36a0 tempest-VolumesBackupsTest-596628470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74e948a2-7dd2-4ce0-a9c1-7707a47f2b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:42:06.850636 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-0a9faf64-891d-4d7d-9537-8eea7c0f36a0 tempest-VolumesBackupsTest-596628470 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:42:06.865519 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0a9faf64-891d-4d7d-9537-8eea7c0f36a0 tempest-VolumesBackupsTest-596628470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74e948a2-7dd2-4ce0-a9c1-7707a47f2b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:42:06Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_9572109d-ce58-4d2d-8b06-f838523c3b76',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3fcdc80c-5f5d-49b4-9b24-27ff806ca9a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a6f7f2d4b1243369e6e2a101f68557c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:42:07Z,use_quota=True,user_id='0b6c0fe828da4c18ae9764400f30740d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:42:06.869744 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0a9faf64-891d-4d7d-9537-8eea7c0f36a0 tempest-VolumesBackupsTest-596628470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08c55e74-0949-4f08-97ff-07df5fa891dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:42:06.870449 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0a9faf64-891d-4d7d-9537-8eea7c0f36a0 tempest-VolumesBackupsTest-596628470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08c55e74-0949-4f08-97ff-07df5fa891dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:42:06.872866 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0a9faf64-891d-4d7d-9537-8eea7c0f36a0 tempest-VolumesBackupsTest-596628470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96c2985f-16d4-4798-a223-ece3b7dca288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:42:06.875356 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0a9faf64-891d-4d7d-9537-8eea7c0f36a0 tempest-VolumesBackupsTest-596628470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96c2985f-16d4-4798-a223-ece3b7dca288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fcdc80c-5f5d-49b4-9b24-27ff806ca9a5', 'volume_name': 'volume-3fcdc80c-5f5d-49b4-9b24-27ff806ca9a5', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:42:06.877851 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0a9faf64-891d-4d7d-9537-8eea7c0f36a0 tempest-VolumesBackupsTest-596628470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd40bec-b4ee-417c-9165-51ebbf5329a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:42:06.880641 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0a9faf64-891d-4d7d-9537-8eea7c0f36a0 tempest-VolumesBackupsTest-596628470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd40bec-b4ee-417c-9165-51ebbf5329a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:42:06.883041 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0a9faf64-891d-4d7d-9537-8eea7c0f36a0 tempest-VolumesBackupsTest-596628470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d9cadf1-ec11-4c17-bf27-cc5b9af6708d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:42:06.883865 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-0a9faf64-891d-4d7d-9537-8eea7c0f36a0 tempest-VolumesBackupsTest-596628470 None] Volume 3fcdc80c-5f5d-49b4-9b24-27ff806ca9a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fcdc80c-5f5d-49b4-9b24-27ff806ca9a5', 'volume_size': 1} Dec 25 21:42:06.884262 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0a9faf64-891d-4d7d-9537-8eea7c0f36a0 tempest-VolumesBackupsTest-596628470 None] creating volume 'volume-3fcdc80c-5f5d-49b4-9b24-27ff806ca9a5' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:42:06.885275 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0a9faf64-891d-4d7d-9537-8eea7c0f36a0 tempest-VolumesBackupsTest-596628470 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:42:06.910954 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-4c91fbb1-c77e-4616-bc05-82c9f67c90b4 tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:42:07.402399 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-4c91fbb1-c77e-4616-bc05-82c9f67c90b4 tempest-VolumesSnapshotTestJSON-639273304 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:42:07.724816 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-4c91fbb1-c77e-4616-bc05-82c9f67c90b4 tempest-VolumesSnapshotTestJSON-639273304 None] deleting rbd volume volume-9829f26f-2a07-49f2-ad32-73b90d638581 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:42:07.914872 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0a9faf64-891d-4d7d-9537-8eea7c0f36a0 tempest-VolumesBackupsTest-596628470 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:42:07.915249 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0a9faf64-891d-4d7d-9537-8eea7c0f36a0 tempest-VolumesBackupsTest-596628470 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:42:07.917351 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0a9faf64-891d-4d7d-9537-8eea7c0f36a0 tempest-VolumesBackupsTest-596628470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d9cadf1-ec11-4c17-bf27-cc5b9af6708d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fcdc80c-5f5d-49b4-9b24-27ff806ca9a5', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:42:07.919494 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0a9faf64-891d-4d7d-9537-8eea7c0f36a0 tempest-VolumesBackupsTest-596628470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2908f19-e928-4c2f-884c-953456886bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:42:08.014584 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-0a9faf64-891d-4d7d-9537-8eea7c0f36a0 tempest-VolumesBackupsTest-596628470 None] Volume volume-3fcdc80c-5f5d-49b4-9b24-27ff806ca9a5 (3fcdc80c-5f5d-49b4-9b24-27ff806ca9a5): created successfully Dec 25 21:42:08.016543 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0a9faf64-891d-4d7d-9537-8eea7c0f36a0 tempest-VolumesBackupsTest-596628470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2908f19-e928-4c2f-884c-953456886bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:42:08.020389 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0a9faf64-891d-4d7d-9537-8eea7c0f36a0 tempest-VolumesBackupsTest-596628470 None] Flow 'volume_create_manager' (59d1a219-b736-4ef3-9096-b5e94ef8572d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:42:08.094045 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-0a9faf64-891d-4d7d-9537-8eea7c0f36a0 tempest-VolumesBackupsTest-596628470 None] Created volume successfully. Dec 25 21:42:08.752856 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [None req-0a9faf64-891d-4d7d-9537-8eea7c0f36a0 tempest-VolumesBackupsTest-596628470 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:42:09.414083 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [None req-0a9faf64-891d-4d7d-9537-8eea7c0f36a0 tempest-VolumesBackupsTest-596628470 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.661s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:42:09.414810 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0a9faf64-891d-4d7d-9537-8eea7c0f36a0 tempest-VolumesBackupsTest-596628470 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3fcdc80c-5f5d-49b4-9b24-27ff806ca9a5', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': '3fcdc80c-5f5d-49b4-9b24-27ff806ca9a5', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 21:42:09.428219 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-0a9faf64-891d-4d7d-9537-8eea7c0f36a0 tempest-VolumesBackupsTest-596628470 None] Initialize volume connection completed successfully. Dec 25 21:42:16.232229 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-4c91fbb1-c77e-4616-bc05-82c9f67c90b4 tempest-VolumesSnapshotTestJSON-639273304 None] Created reservations ['80a4f3c7-a5dd-4327-bcd3-973d9ea0a4d6', '87ec0dad-ff76-47e3-9da6-d8d51faa0dde', 'bf83a625-624c-4f75-94bb-5e639be9a5b3', '8a604c77-2364-4edc-8b2d-8a6bac23c6b5'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:42:16.506399 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-4c91fbb1-c77e-4616-bc05-82c9f67c90b4 tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:42:16.532425 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-4c91fbb1-c77e-4616-bc05-82c9f67c90b4 tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:42:16.556772 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-4c91fbb1-c77e-4616-bc05-82c9f67c90b4 tempest-VolumesSnapshotTestJSON-639273304 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:42:16.562753 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-4c91fbb1-c77e-4616-bc05-82c9f67c90b4 tempest-VolumesSnapshotTestJSON-639273304 None] Deleted volume successfully. Dec 25 21:42:16.633006 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-4c91fbb1-c77e-4616-bc05-82c9f67c90b4 tempest-VolumesSnapshotTestJSON-639273304 None] Lock "b'cinder-9829f26f-2a07-49f2-ad32-73b90d638581-delete_volume'" released by "delete_volume" :: held 9.917s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:42:18.016366 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad58c94a-32ad-4c30-a59a-00f70a7f3a42 tempest-VolumesSnapshotTestJSON-639273304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:42:18.020562 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-ad58c94a-32ad-4c30-a59a-00f70a7f3a42 tempest-VolumesSnapshotTestJSON-639273304 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:42:18.021122 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-ad58c94a-32ad-4c30-a59a-00f70a7f3a42 tempest-VolumesSnapshotTestJSON-639273304 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:42:18.034786 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ad58c94a-32ad-4c30-a59a-00f70a7f3a42 tempest-VolumesSnapshotTestJSON-639273304 None] Flow 'volume_create_manager' (5672b1d9-cb16-4465-ad64-629b58f9b082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:42:18.038202 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ad58c94a-32ad-4c30-a59a-00f70a7f3a42 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92dfe125-3d77-4de7-8502-58f938104d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:42:18.044804 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-ad58c94a-32ad-4c30-a59a-00f70a7f3a42 tempest-VolumesSnapshotTestJSON-639273304 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:42:18.062874 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ad58c94a-32ad-4c30-a59a-00f70a7f3a42 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92dfe125-3d77-4de7-8502-58f938104d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1410210857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=cd0f54d7-50c4-4101-9ba4-d7a078fa56dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a416565d81324f55b88111b36c4a777c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:42:18Z,use_quota=True,user_id='c3a55c151bef4387a4fef00ab6687a20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:42:18.065701 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ad58c94a-32ad-4c30-a59a-00f70a7f3a42 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a358720-e4e3-4082-8760-d0827baf6c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:42:18.068715 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ad58c94a-32ad-4c30-a59a-00f70a7f3a42 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a358720-e4e3-4082-8760-d0827baf6c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:42:18.071175 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ad58c94a-32ad-4c30-a59a-00f70a7f3a42 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc18f659-122f-4f99-af9d-1813ea1c390c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:42:18.073489 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ad58c94a-32ad-4c30-a59a-00f70a7f3a42 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc18f659-122f-4f99-af9d-1813ea1c390c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd0f54d7-50c4-4101-9ba4-d7a078fa56dc', 'volume_name': 'volume-cd0f54d7-50c4-4101-9ba4-d7a078fa56dc', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:42:18.075812 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ad58c94a-32ad-4c30-a59a-00f70a7f3a42 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2614c266-6d35-4477-965d-570da9e32ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:42:18.078003 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ad58c94a-32ad-4c30-a59a-00f70a7f3a42 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2614c266-6d35-4477-965d-570da9e32ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:42:18.080199 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ad58c94a-32ad-4c30-a59a-00f70a7f3a42 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efbeb311-2cd3-4bb6-97fa-5a02e48a7001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:42:18.081051 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-ad58c94a-32ad-4c30-a59a-00f70a7f3a42 tempest-VolumesSnapshotTestJSON-639273304 None] Volume cd0f54d7-50c4-4101-9ba4-d7a078fa56dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd0f54d7-50c4-4101-9ba4-d7a078fa56dc', 'volume_size': 1} Dec 25 21:42:18.081453 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ad58c94a-32ad-4c30-a59a-00f70a7f3a42 tempest-VolumesSnapshotTestJSON-639273304 None] creating volume 'volume-cd0f54d7-50c4-4101-9ba4-d7a078fa56dc' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:42:18.082469 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ad58c94a-32ad-4c30-a59a-00f70a7f3a42 tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:42:19.337388 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ad58c94a-32ad-4c30-a59a-00f70a7f3a42 tempest-VolumesSnapshotTestJSON-639273304 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:42:19.338047 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-ad58c94a-32ad-4c30-a59a-00f70a7f3a42 tempest-VolumesSnapshotTestJSON-639273304 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:42:19.339894 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ad58c94a-32ad-4c30-a59a-00f70a7f3a42 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efbeb311-2cd3-4bb6-97fa-5a02e48a7001) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd0f54d7-50c4-4101-9ba4-d7a078fa56dc', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:42:19.342083 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ad58c94a-32ad-4c30-a59a-00f70a7f3a42 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (569c8fcc-33fd-4574-9864-31689a58bbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:42:19.426639 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-ad58c94a-32ad-4c30-a59a-00f70a7f3a42 tempest-VolumesSnapshotTestJSON-639273304 None] Volume volume-cd0f54d7-50c4-4101-9ba4-d7a078fa56dc (cd0f54d7-50c4-4101-9ba4-d7a078fa56dc): created successfully Dec 25 21:42:19.428716 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ad58c94a-32ad-4c30-a59a-00f70a7f3a42 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (569c8fcc-33fd-4574-9864-31689a58bbcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:42:19.432060 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-ad58c94a-32ad-4c30-a59a-00f70a7f3a42 tempest-VolumesSnapshotTestJSON-639273304 None] Flow 'volume_create_manager' (5672b1d9-cb16-4465-ad64-629b58f9b082) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:42:19.506637 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-ad58c94a-32ad-4c30-a59a-00f70a7f3a42 tempest-VolumesSnapshotTestJSON-639273304 None] Created volume successfully. Dec 25 21:42:20.443452 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-d30a8254-8c0b-464c-9d42-9771a912d2f5 tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:42:25.191568 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-d30a8254-8c0b-464c-9d42-9771a912d2f5 tempest-VolumesSnapshotTestJSON-639273304 None] Create snapshot completed successfully Dec 25 21:42:26.352379 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-44c37aee-bb54-4fd1-b7dc-b2e289b998e7 tempest-VolumesSnapshotTestJSON-639273304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:42:26.355629 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-44c37aee-bb54-4fd1-b7dc-b2e289b998e7 tempest-VolumesSnapshotTestJSON-639273304 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:42:26.356079 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-44c37aee-bb54-4fd1-b7dc-b2e289b998e7 tempest-VolumesSnapshotTestJSON-639273304 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:42:26.376409 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-44c37aee-bb54-4fd1-b7dc-b2e289b998e7 tempest-VolumesSnapshotTestJSON-639273304 None] Flow 'volume_create_manager' (83780b61-4630-4390-9590-61136d27c3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:42:26.380016 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-44c37aee-bb54-4fd1-b7dc-b2e289b998e7 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (276a5309-db14-4d00-8719-0703ccf0c179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:42:26.386528 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-44c37aee-bb54-4fd1-b7dc-b2e289b998e7 tempest-VolumesSnapshotTestJSON-639273304 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:42:26.399080 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-44c37aee-bb54-4fd1-b7dc-b2e289b998e7 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (276a5309-db14-4d00-8719-0703ccf0c179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1179215594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0ec188d6-a5d7-43e7-bcd2-1454de81a431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a416565d81324f55b88111b36c4a777c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e4df9630-297a-4886-b1fd-75ceced3c273,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:42:26Z,use_quota=True,user_id='c3a55c151bef4387a4fef00ab6687a20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:42:26.401700 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-44c37aee-bb54-4fd1-b7dc-b2e289b998e7 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7825f1b3-9120-4146-8772-acef339d29bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:42:26.403865 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-44c37aee-bb54-4fd1-b7dc-b2e289b998e7 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7825f1b3-9120-4146-8772-acef339d29bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:42:26.406372 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-44c37aee-bb54-4fd1-b7dc-b2e289b998e7 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d863529-5b03-4260-8c98-50f07e72aaee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:42:26.408616 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-44c37aee-bb54-4fd1-b7dc-b2e289b998e7 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d863529-5b03-4260-8c98-50f07e72aaee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0ec188d6-a5d7-43e7-bcd2-1454de81a431', 'volume_name': 'volume-0ec188d6-a5d7-43e7-bcd2-1454de81a431', 'volume_size': 1, 'snapshot_id': 'e4df9630-297a-4886-b1fd-75ceced3c273'}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:42:26.410961 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-44c37aee-bb54-4fd1-b7dc-b2e289b998e7 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb63c7dc-8668-4401-8dac-44f97ec4a65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:42:26.413126 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-44c37aee-bb54-4fd1-b7dc-b2e289b998e7 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb63c7dc-8668-4401-8dac-44f97ec4a65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:42:26.415344 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-44c37aee-bb54-4fd1-b7dc-b2e289b998e7 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8552d25-d2d4-448c-8ab8-9f94b84df84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:42:26.418635 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-44c37aee-bb54-4fd1-b7dc-b2e289b998e7 tempest-VolumesSnapshotTestJSON-639273304 None] Volume 0ec188d6-a5d7-43e7-bcd2-1454de81a431: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0ec188d6-a5d7-43e7-bcd2-1454de81a431', 'volume_size': 1, 'snapshot_id': 'e4df9630-297a-4886-b1fd-75ceced3c273'} Dec 25 21:42:26.434255 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-44c37aee-bb54-4fd1-b7dc-b2e289b998e7 tempest-VolumesSnapshotTestJSON-639273304 None] cloning volumes/volume-cd0f54d7-50c4-4101-9ba4-d7a078fa56dc@snapshot-e4df9630-297a-4886-b1fd-75ceced3c273 to volume-0ec188d6-a5d7-43e7-bcd2-1454de81a431 {{(pid=129926) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Dec 25 21:42:26.435146 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-44c37aee-bb54-4fd1-b7dc-b2e289b998e7 tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:42:26.480505 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-44c37aee-bb54-4fd1-b7dc-b2e289b998e7 tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:42:30.731544 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-44c37aee-bb54-4fd1-b7dc-b2e289b998e7 tempest-VolumesSnapshotTestJSON-639273304 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:42:30.733561 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-44c37aee-bb54-4fd1-b7dc-b2e289b998e7 tempest-VolumesSnapshotTestJSON-639273304 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:42:30.749090 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-44c37aee-bb54-4fd1-b7dc-b2e289b998e7 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8552d25-d2d4-448c-8ab8-9f94b84df84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ec188d6-a5d7-43e7-bcd2-1454de81a431', 'volume_size': 1, 'snapshot_id': 'e4df9630-297a-4886-b1fd-75ceced3c273'}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:42:30.751433 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-44c37aee-bb54-4fd1-b7dc-b2e289b998e7 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95268607-539d-47d9-b2db-a7029503dc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:42:30.890744 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-44c37aee-bb54-4fd1-b7dc-b2e289b998e7 tempest-VolumesSnapshotTestJSON-639273304 None] Volume volume-0ec188d6-a5d7-43e7-bcd2-1454de81a431 (0ec188d6-a5d7-43e7-bcd2-1454de81a431): created successfully Dec 25 21:42:30.890744 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-44c37aee-bb54-4fd1-b7dc-b2e289b998e7 tempest-VolumesSnapshotTestJSON-639273304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95268607-539d-47d9-b2db-a7029503dc19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:42:30.890744 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-44c37aee-bb54-4fd1-b7dc-b2e289b998e7 tempest-VolumesSnapshotTestJSON-639273304 None] Flow 'volume_create_manager' (83780b61-4630-4390-9590-61136d27c3c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:42:31.002065 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-44c37aee-bb54-4fd1-b7dc-b2e289b998e7 tempest-VolumesSnapshotTestJSON-639273304 None] Created volume successfully. Dec 25 21:42:31.557680 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-013b7be0-7379-428f-aff6-bcc569572c41 tempest-VolumesSnapshotTestJSON-639273304 None] Lock "b'cinder-0ec188d6-a5d7-43e7-bcd2-1454de81a431-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:42:31.682981 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-013b7be0-7379-428f-aff6-bcc569572c41 tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:42:32.118932 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-013b7be0-7379-428f-aff6-bcc569572c41 tempest-VolumesSnapshotTestJSON-639273304 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:42:32.456623 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-013b7be0-7379-428f-aff6-bcc569572c41 tempest-VolumesSnapshotTestJSON-639273304 None] deleting rbd volume volume-0ec188d6-a5d7-43e7-bcd2-1454de81a431 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:42:32.458305 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:42:32.459539 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:42:32.497390 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:42:32.526783 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:42:45.706845 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-013b7be0-7379-428f-aff6-bcc569572c41 tempest-VolumesSnapshotTestJSON-639273304 None] Created reservations ['4147ba69-2db3-43a6-8b9d-f5706aa07db4', '4de231ce-ad62-422c-8a38-e070096776fe', '7c2dc97c-2869-4d7e-83e3-89bcaf108921', 'e4dbd72f-fd71-4a1b-b4c1-750633a4ff46'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:42:46.015182 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-013b7be0-7379-428f-aff6-bcc569572c41 tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:42:46.047418 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-013b7be0-7379-428f-aff6-bcc569572c41 tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:42:46.074146 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-013b7be0-7379-428f-aff6-bcc569572c41 tempest-VolumesSnapshotTestJSON-639273304 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:42:46.081807 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-013b7be0-7379-428f-aff6-bcc569572c41 tempest-VolumesSnapshotTestJSON-639273304 None] Deleted volume successfully. Dec 25 21:42:46.150764 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-013b7be0-7379-428f-aff6-bcc569572c41 tempest-VolumesSnapshotTestJSON-639273304 None] Lock "b'cinder-0ec188d6-a5d7-43e7-bcd2-1454de81a431-delete_volume'" released by "delete_volume" :: held 14.593s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:42:46.563982 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-060584ad-9758-4785-8466-d57124347d24 tempest-VolumesSnapshotTestJSON-639273304 None] Lock "b'cinder-e4df9630-297a-4886-b1fd-75ceced3c273-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:42:46.567630 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-060584ad-9758-4785-8466-d57124347d24 tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:42:52.764337 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-060584ad-9758-4785-8466-d57124347d24 tempest-VolumesSnapshotTestJSON-639273304 None] Created reservations ['ce4f456f-6bbc-4428-8799-11f11cc29b03', 'c9110665-60ba-4234-87ff-4b0ff45258a1', '6ffe1fe1-2488-4329-82aa-28b0e48f7af5', '3821da58-70a1-4b89-8576-e80ff791f79f'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:42:52.963342 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-060584ad-9758-4785-8466-d57124347d24 tempest-VolumesSnapshotTestJSON-639273304 None] Delete snapshot completed successfully. Dec 25 21:42:52.968281 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-060584ad-9758-4785-8466-d57124347d24 tempest-VolumesSnapshotTestJSON-639273304 None] Lock "b'cinder-e4df9630-297a-4886-b1fd-75ceced3c273-delete_snapshot'" released by "delete_snapshot" :: held 6.404s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:42:54.174682 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-2a05647f-febc-4448-b81a-a1c8aafcde38 tempest-VolumesSnapshotTestJSON-639273304 None] Lock "b'cinder-cd0f54d7-50c4-4101-9ba4-d7a078fa56dc-delete_volume'" acquired by "delete_volume" :: waited 0.049s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:42:54.324454 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-2a05647f-febc-4448-b81a-a1c8aafcde38 tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:42:54.685459 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-2a05647f-febc-4448-b81a-a1c8aafcde38 tempest-VolumesSnapshotTestJSON-639273304 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:42:54.685459 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-2a05647f-febc-4448-b81a-a1c8aafcde38 tempest-VolumesSnapshotTestJSON-639273304 None] Volume volume-cd0f54d7-50c4-4101-9ba4-d7a078fa56dc is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:42:55.141045 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-2a05647f-febc-4448-b81a-a1c8aafcde38 tempest-VolumesSnapshotTestJSON-639273304 None] deleting rbd volume volume-cd0f54d7-50c4-4101-9ba4-d7a078fa56dc {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:43:04.415312 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-2a05647f-febc-4448-b81a-a1c8aafcde38 tempest-VolumesSnapshotTestJSON-639273304 None] Created reservations ['d5efa138-750b-496e-8a64-45d96fbdb73b', '2677843a-1398-4b8c-9b90-8da51a1706d7', 'bcc6ffb2-7cd8-44e0-989b-d89b7e53e9a3', 'a5d2aa0d-8c20-482b-a348-b6a8c70e9a8b'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:43:04.630292 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-2a05647f-febc-4448-b81a-a1c8aafcde38 tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:43:04.654804 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-2a05647f-febc-4448-b81a-a1c8aafcde38 tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:43:04.689755 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-2a05647f-febc-4448-b81a-a1c8aafcde38 tempest-VolumesSnapshotTestJSON-639273304 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:43:04.694257 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-2a05647f-febc-4448-b81a-a1c8aafcde38 tempest-VolumesSnapshotTestJSON-639273304 None] Deleted volume successfully. Dec 25 21:43:04.859242 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-2a05647f-febc-4448-b81a-a1c8aafcde38 tempest-VolumesSnapshotTestJSON-639273304 None] Lock "b'cinder-cd0f54d7-50c4-4101-9ba4-d7a078fa56dc-delete_volume'" released by "delete_volume" :: held 10.684s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:43:05.040530 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-e8f33e73-3a57-4f09-98ec-ba9195e9f82a tempest-VolumesSnapshotTestJSON-639273304 None] Lock "b'cinder-4d6bb17b-6ba3-4ba0-a7e3-56086ec66cd1-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:43:05.041834 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-e8f33e73-3a57-4f09-98ec-ba9195e9f82a tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:43:05.528997 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-0a9faf64-891d-4d7d-9537-8eea7c0f36a0 tempest-VolumesBackupsTest-596628470 None] Terminate volume connection completed successfully. Dec 25 21:43:05.548227 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-0a9faf64-891d-4d7d-9537-8eea7c0f36a0 tempest-VolumesBackupsTest-596628470 None] Remove volume export completed successfully. Dec 25 21:43:06.795196 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-7858ffbf-2d5d-4a9f-b853-3121807b4152 tempest-VolumesBackupsTest-596628470 None] Lock "b'cinder-3fcdc80c-5f5d-49b4-9b24-27ff806ca9a5-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:43:06.892847 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7858ffbf-2d5d-4a9f-b853-3121807b4152 tempest-VolumesBackupsTest-596628470 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:43:10.171210 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7858ffbf-2d5d-4a9f-b853-3121807b4152 tempest-VolumesBackupsTest-596628470 None] Volume volume-3fcdc80c-5f5d-49b4-9b24-27ff806ca9a5 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:43:11.127707 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7858ffbf-2d5d-4a9f-b853-3121807b4152 tempest-VolumesBackupsTest-596628470 None] deleting rbd volume volume-3fcdc80c-5f5d-49b4-9b24-27ff806ca9a5 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:43:12.298973 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-e8f33e73-3a57-4f09-98ec-ba9195e9f82a tempest-VolumesSnapshotTestJSON-639273304 None] Created reservations ['a2667558-7e8b-485f-8a80-9411f89f3a34', '217218c5-11ed-4188-96fd-53956cc04bcb', '706db881-cab7-4ac4-96b3-f6f8946b21da', '237b07f0-1888-47ae-aab6-e84667081249'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:43:12.527265 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-e8f33e73-3a57-4f09-98ec-ba9195e9f82a tempest-VolumesSnapshotTestJSON-639273304 None] Delete snapshot completed successfully. Dec 25 21:43:12.532827 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-e8f33e73-3a57-4f09-98ec-ba9195e9f82a tempest-VolumesSnapshotTestJSON-639273304 None] Lock "b'cinder-4d6bb17b-6ba3-4ba0-a7e3-56086ec66cd1-delete_snapshot'" released by "delete_snapshot" :: held 7.493s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:43:13.647239 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-17e28c80-e250-4c9e-bfb1-d804da73e9e4 tempest-VolumesSnapshotTestJSON-639273304 None] Lock "b'cinder-8ef25d71-29cc-4203-a518-c92289384c4b-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:43:13.783019 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-17e28c80-e250-4c9e-bfb1-d804da73e9e4 tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:43:18.182715 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-17e28c80-e250-4c9e-bfb1-d804da73e9e4 tempest-VolumesSnapshotTestJSON-639273304 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:43:18.184636 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-17e28c80-e250-4c9e-bfb1-d804da73e9e4 tempest-VolumesSnapshotTestJSON-639273304 None] Volume volume-8ef25d71-29cc-4203-a518-c92289384c4b is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:43:18.568477 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-17e28c80-e250-4c9e-bfb1-d804da73e9e4 tempest-VolumesSnapshotTestJSON-639273304 None] deleting rbd volume volume-8ef25d71-29cc-4203-a518-c92289384c4b {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:43:23.877878 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-7858ffbf-2d5d-4a9f-b853-3121807b4152 tempest-VolumesBackupsTest-596628470 None] Created reservations ['74eb885b-8ee1-4d08-8227-828196501552', 'd20e43db-ec9a-4362-ae8a-ad675f91cfaa', '126b6bb6-40de-40a6-910d-0bac8a63b410', '76db367f-226e-47c9-9505-6c159b99113d'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:43:24.127108 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7858ffbf-2d5d-4a9f-b853-3121807b4152 tempest-VolumesBackupsTest-596628470 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:43:24.160278 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-7858ffbf-2d5d-4a9f-b853-3121807b4152 tempest-VolumesBackupsTest-596628470 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:43:24.191481 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-7858ffbf-2d5d-4a9f-b853-3121807b4152 tempest-VolumesBackupsTest-596628470 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:43:24.197201 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-7858ffbf-2d5d-4a9f-b853-3121807b4152 tempest-VolumesBackupsTest-596628470 None] Deleted volume successfully. Dec 25 21:43:24.281464 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-7858ffbf-2d5d-4a9f-b853-3121807b4152 tempest-VolumesBackupsTest-596628470 None] Lock "b'cinder-3fcdc80c-5f5d-49b4-9b24-27ff806ca9a5-delete_volume'" released by "delete_volume" :: held 17.484s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:43:26.221380 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-17e28c80-e250-4c9e-bfb1-d804da73e9e4 tempest-VolumesSnapshotTestJSON-639273304 None] Created reservations ['f6d88ce6-8cb0-4c5c-a928-35dd94e38bd2', '44e4a864-5bd9-4748-ab1d-1f83c36fb59a', 'ad545927-c786-4074-8ec6-055264cb4adc', '97cc9df2-2ce0-4ad5-b2f2-12eae59ef16d'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:43:26.467021 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-17e28c80-e250-4c9e-bfb1-d804da73e9e4 tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:43:26.582797 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-17e28c80-e250-4c9e-bfb1-d804da73e9e4 tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:43:26.636451 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-17e28c80-e250-4c9e-bfb1-d804da73e9e4 tempest-VolumesSnapshotTestJSON-639273304 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:43:26.641261 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-17e28c80-e250-4c9e-bfb1-d804da73e9e4 tempest-VolumesSnapshotTestJSON-639273304 None] Deleted volume successfully. Dec 25 21:43:26.712228 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-17e28c80-e250-4c9e-bfb1-d804da73e9e4 tempest-VolumesSnapshotTestJSON-639273304 None] Lock "b'cinder-8ef25d71-29cc-4203-a518-c92289384c4b-delete_volume'" released by "delete_volume" :: held 13.065s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:43:26.806015 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-0d702619-5da5-402c-84b6-0030d21fca56 tempest-VolumesSnapshotTestJSON-639273304 None] Lock "b'cinder-84b7c2f5-06e2-4582-b712-ba8e2cf1d2a7-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:43:26.895843 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0d702619-5da5-402c-84b6-0030d21fca56 tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:43:27.444000 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0d702619-5da5-402c-84b6-0030d21fca56 tempest-VolumesSnapshotTestJSON-639273304 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:43:27.861452 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0d702619-5da5-402c-84b6-0030d21fca56 tempest-VolumesSnapshotTestJSON-639273304 None] deleting rbd volume volume-84b7c2f5-06e2-4582-b712-ba8e2cf1d2a7 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:43:32.462380 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:43:32.464321 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:43:32.615923 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:43:32.671749 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:43:36.347702 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0d702619-5da5-402c-84b6-0030d21fca56 tempest-VolumesSnapshotTestJSON-639273304 None] volume is a clone so cleaning references {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 25 21:43:36.721205 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0d702619-5da5-402c-84b6-0030d21fca56 tempest-VolumesSnapshotTestJSON-639273304 None] deleting parent snapshot volume-84b7c2f5-06e2-4582-b712-ba8e2cf1d2a7.clone_snap {{(pid=129926) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 25 21:43:42.407470 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-0d702619-5da5-402c-84b6-0030d21fca56 tempest-VolumesSnapshotTestJSON-639273304 None] Created reservations ['c2efbe61-3aa6-4469-9500-901eabd5b407', '1abe4dbf-3533-4f48-8e14-dd1c7235482f', '17ec4999-402c-456e-8b2f-94b8b928ee49', '755004b9-572a-43f8-88bd-513d7e13e8b8'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:43:42.607254 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0d702619-5da5-402c-84b6-0030d21fca56 tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:43:42.701127 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0d702619-5da5-402c-84b6-0030d21fca56 tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:43:42.788533 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-0d702619-5da5-402c-84b6-0030d21fca56 tempest-VolumesSnapshotTestJSON-639273304 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:43:42.802609 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-0d702619-5da5-402c-84b6-0030d21fca56 tempest-VolumesSnapshotTestJSON-639273304 None] Deleted volume successfully. Dec 25 21:43:42.848385 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-adb40b8e-80d4-40f5-879c-3c13f8fe62bc tempest-VolumesSnapshotTestJSON-639273304 None] Lock "b'cinder-fa65ec2d-542f-4a76-8b2c-0f05d2f40f68-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:43:42.850961 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-adb40b8e-80d4-40f5-879c-3c13f8fe62bc tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:43:43.039670 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-0d702619-5da5-402c-84b6-0030d21fca56 tempest-VolumesSnapshotTestJSON-639273304 None] Lock "b'cinder-84b7c2f5-06e2-4582-b712-ba8e2cf1d2a7-delete_volume'" released by "delete_volume" :: held 16.232s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:43:43.827053 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-b7ace96e-cb1f-41d4-abd8-f0c43b8f1630 tempest-VolumesBackupsTest-596628470 None] Lock "b'cinder-e2767895-8ea1-400c-9c10-00e5832d20fb-delete_volume'" acquired by "delete_volume" :: waited 0.035s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:43:43.964307 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b7ace96e-cb1f-41d4-abd8-f0c43b8f1630 tempest-VolumesBackupsTest-596628470 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:43:46.388810 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b7ace96e-cb1f-41d4-abd8-f0c43b8f1630 tempest-VolumesBackupsTest-596628470 None] deleting rbd volume volume-e2767895-8ea1-400c-9c10-00e5832d20fb {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:43:46.415115 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-001fcb54-4f4f-46e9-913e-b54bb0f24a04 req-e9cb8e1c-1a83-479f-b26d-db41229162bc tempest-TestVolumeBackupRestore-1733305645 None] Terminate volume connection completed successfully. Dec 25 21:43:46.415975 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-001fcb54-4f4f-46e9-913e-b54bb0f24a04 req-e9cb8e1c-1a83-479f-b26d-db41229162bc tempest-TestVolumeBackupRestore-1733305645 None] Deleting attachment f8e0ae83-d7a6-4f34-88bd-82923b623217. {{(pid=129926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 25 21:43:47.444415 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-adb40b8e-80d4-40f5-879c-3c13f8fe62bc tempest-VolumesSnapshotTestJSON-639273304 None] Created reservations ['5cf93b04-fb68-4bd4-984d-7ea3fc5a2d08', '39f5bfeb-81fb-4b7d-9264-6cbe8d2165ce', 'd8a0211e-2023-4073-9a1a-ce9afd1fdf12', '54a77300-93f2-47a3-b172-388d301a03df'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:43:47.771367 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-adb40b8e-80d4-40f5-879c-3c13f8fe62bc tempest-VolumesSnapshotTestJSON-639273304 None] Delete snapshot completed successfully. Dec 25 21:43:47.780030 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-adb40b8e-80d4-40f5-879c-3c13f8fe62bc tempest-VolumesSnapshotTestJSON-639273304 None] Lock "b'cinder-fa65ec2d-542f-4a76-8b2c-0f05d2f40f68-delete_snapshot'" released by "delete_snapshot" :: held 4.932s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:43:48.337125 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-62dd1319-0502-4c9c-87a0-b4af83d173d7 tempest-VolumesSnapshotTestJSON-639273304 None] Lock "b'cinder-f03e9745-84e8-42ce-aae1-83a861dbd629-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:43:48.496421 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-62dd1319-0502-4c9c-87a0-b4af83d173d7 tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:43:48.875023 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-62dd1319-0502-4c9c-87a0-b4af83d173d7 tempest-VolumesSnapshotTestJSON-639273304 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:43:48.875444 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-62dd1319-0502-4c9c-87a0-b4af83d173d7 tempest-VolumesSnapshotTestJSON-639273304 None] Volume volume-f03e9745-84e8-42ce-aae1-83a861dbd629 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:43:49.121199 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-62dd1319-0502-4c9c-87a0-b4af83d173d7 tempest-VolumesSnapshotTestJSON-639273304 None] deleting rbd volume volume-f03e9745-84e8-42ce-aae1-83a861dbd629 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:43:49.144915 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-656136b0-75fe-4ef3-99be-0a24364b6604 tempest-TestVolumeBackupRestore-1733305645 None] Lock "b'cinder-beb1f33b-8577-4e27-b087-711ea8d893c7-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:43:49.268463 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-656136b0-75fe-4ef3-99be-0a24364b6604 tempest-TestVolumeBackupRestore-1733305645 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:43:52.701408 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-656136b0-75fe-4ef3-99be-0a24364b6604 tempest-TestVolumeBackupRestore-1733305645 None] Volume volume-beb1f33b-8577-4e27-b087-711ea8d893c7 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:43:53.792553 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-656136b0-75fe-4ef3-99be-0a24364b6604 tempest-TestVolumeBackupRestore-1733305645 None] deleting rbd volume volume-beb1f33b-8577-4e27-b087-711ea8d893c7 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:43:53.826919 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-2de197bc-d684-45b0-8114-e508d37d719e tempest-TestVolumeBackupRestore-1733305645 None] Lock "b'cinder-26e57931-5e2e-498f-907c-ba032fee0597-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:43:54.056168 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-2de197bc-d684-45b0-8114-e508d37d719e tempest-TestVolumeBackupRestore-1733305645 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:43:57.358479 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-2de197bc-d684-45b0-8114-e508d37d719e tempest-TestVolumeBackupRestore-1733305645 None] deleting rbd volume volume-26e57931-5e2e-498f-907c-ba032fee0597 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:43:57.361476 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b7ace96e-cb1f-41d4-abd8-f0c43b8f1630 tempest-VolumesBackupsTest-596628470 None] volume is a clone so cleaning references {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 25 21:43:57.674501 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b7ace96e-cb1f-41d4-abd8-f0c43b8f1630 tempest-VolumesBackupsTest-596628470 None] deleting parent snapshot volume-e2767895-8ea1-400c-9c10-00e5832d20fb.clone_snap {{(pid=129926) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 25 21:44:02.015321 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-62dd1319-0502-4c9c-87a0-b4af83d173d7 tempest-VolumesSnapshotTestJSON-639273304 None] Created reservations ['a4c0edc8-a5ff-4afc-9c73-8872591a7fd1', 'a2fb62ad-c65a-44fb-8035-ef501beb74cd', 'aa7649c1-6a6e-4466-ad35-8d0fb4f7f262', '278cadd7-031a-47bb-8bc4-5616d3c38266'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:44:02.018712 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-b7ace96e-cb1f-41d4-abd8-f0c43b8f1630 tempest-VolumesBackupsTest-596628470 None] Created reservations ['fdec2dc0-1934-4473-9287-a2062958dbe1', '5e7b3406-f272-46c7-803b-12af56e77ff2', '15cf0f54-d72a-4fdc-ac13-d7259f8cc60b', '4923fc0b-e552-473d-9518-739403fc0729'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:44:02.394079 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b7ace96e-cb1f-41d4-abd8-f0c43b8f1630 tempest-VolumesBackupsTest-596628470 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:44:02.423280 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-b7ace96e-cb1f-41d4-abd8-f0c43b8f1630 tempest-VolumesBackupsTest-596628470 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:44:02.490470 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-b7ace96e-cb1f-41d4-abd8-f0c43b8f1630 tempest-VolumesBackupsTest-596628470 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:44:02.513249 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-b7ace96e-cb1f-41d4-abd8-f0c43b8f1630 tempest-VolumesBackupsTest-596628470 None] Deleted volume successfully. Dec 25 21:44:02.608569 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-b7ace96e-cb1f-41d4-abd8-f0c43b8f1630 tempest-VolumesBackupsTest-596628470 None] Lock "b'cinder-e2767895-8ea1-400c-9c10-00e5832d20fb-delete_volume'" released by "delete_volume" :: held 18.782s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:44:02.626688 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-62dd1319-0502-4c9c-87a0-b4af83d173d7 tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:44:02.688859 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-62dd1319-0502-4c9c-87a0-b4af83d173d7 tempest-VolumesSnapshotTestJSON-639273304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:44:02.798014 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-62dd1319-0502-4c9c-87a0-b4af83d173d7 tempest-VolumesSnapshotTestJSON-639273304 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:44:02.803180 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-62dd1319-0502-4c9c-87a0-b4af83d173d7 tempest-VolumesSnapshotTestJSON-639273304 None] Deleted volume successfully. Dec 25 21:44:03.004636 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-62dd1319-0502-4c9c-87a0-b4af83d173d7 tempest-VolumesSnapshotTestJSON-639273304 None] Lock "b'cinder-f03e9745-84e8-42ce-aae1-83a861dbd629-delete_volume'" released by "delete_volume" :: held 14.667s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:44:06.416621 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-2de197bc-d684-45b0-8114-e508d37d719e tempest-TestVolumeBackupRestore-1733305645 None] volume is a clone so cleaning references {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 25 21:44:06.616654 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-2de197bc-d684-45b0-8114-e508d37d719e tempest-TestVolumeBackupRestore-1733305645 None] deleting parent snapshot volume-26e57931-5e2e-498f-907c-ba032fee0597.clone_snap {{(pid=129926) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 25 21:44:09.833209 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-2de197bc-d684-45b0-8114-e508d37d719e tempest-TestVolumeBackupRestore-1733305645 None] Created reservations ['75be8a69-1085-449e-8b3a-a7c30e9d98f2', '9aa6b98d-9890-4c77-b6b9-ebc9723e85de', '835b1437-5a79-45d2-aa3e-0720aa011a67', '0e4551eb-4003-4624-b587-d1eeef4bded1'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:44:09.908477 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-656136b0-75fe-4ef3-99be-0a24364b6604 tempest-TestVolumeBackupRestore-1733305645 None] Created reservations ['b5785c79-31c9-4843-9773-48918b2c19c8', 'f4e82d23-955f-4af6-99fc-a0b9b03d66d2', 'a2dfecb9-ac4f-4168-9f69-55378ba5bf23', 'e8d15ce1-a197-4e7c-ba30-552d8c1616ab'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:44:10.137743 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-2de197bc-d684-45b0-8114-e508d37d719e tempest-TestVolumeBackupRestore-1733305645 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:44:10.216632 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-2de197bc-d684-45b0-8114-e508d37d719e tempest-TestVolumeBackupRestore-1733305645 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:44:10.269135 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-2de197bc-d684-45b0-8114-e508d37d719e tempest-TestVolumeBackupRestore-1733305645 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:44:10.275675 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-656136b0-75fe-4ef3-99be-0a24364b6604 tempest-TestVolumeBackupRestore-1733305645 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:44:10.350510 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-656136b0-75fe-4ef3-99be-0a24364b6604 tempest-TestVolumeBackupRestore-1733305645 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:44:10.425016 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-656136b0-75fe-4ef3-99be-0a24364b6604 tempest-TestVolumeBackupRestore-1733305645 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:44:10.428943 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-2de197bc-d684-45b0-8114-e508d37d719e tempest-TestVolumeBackupRestore-1733305645 None] Deleted volume successfully. Dec 25 21:44:10.457970 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-656136b0-75fe-4ef3-99be-0a24364b6604 tempest-TestVolumeBackupRestore-1733305645 None] Deleted volume successfully. Dec 25 21:44:10.525083 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-2de197bc-d684-45b0-8114-e508d37d719e tempest-TestVolumeBackupRestore-1733305645 None] Lock "b'cinder-26e57931-5e2e-498f-907c-ba032fee0597-delete_volume'" released by "delete_volume" :: held 16.699s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:44:10.561873 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-656136b0-75fe-4ef3-99be-0a24364b6604 tempest-TestVolumeBackupRestore-1733305645 None] Lock "b'cinder-beb1f33b-8577-4e27-b087-711ea8d893c7-delete_volume'" released by "delete_volume" :: held 21.417s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:44:32.467415 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:44:32.468066 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:44:32.527871 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:44:32.588013 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:45:32.463818 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:45:32.464569 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:45:32.494853 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:45:32.532238 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:45:51.325297 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ebeefa3-b278-4c94-ae8f-5bbeb8edc02d tempest-VolumesServicesTestJSON-1758176808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:45:51.328534 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-5ebeefa3-b278-4c94-ae8f-5bbeb8edc02d tempest-VolumesServicesTestJSON-1758176808 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:45:51.329012 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-5ebeefa3-b278-4c94-ae8f-5bbeb8edc02d tempest-VolumesServicesTestJSON-1758176808 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:45:51.341407 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5ebeefa3-b278-4c94-ae8f-5bbeb8edc02d tempest-VolumesServicesTestJSON-1758176808 None] Flow 'volume_create_manager' (1c4bf288-7a43-4e3a-a51c-dff75ecafe50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:45:51.344670 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5ebeefa3-b278-4c94-ae8f-5bbeb8edc02d tempest-VolumesServicesTestJSON-1758176808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d9fc175-0d8f-4d14-9b75-fa65a9d9b7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:45:51.353342 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-5ebeefa3-b278-4c94-ae8f-5bbeb8edc02d tempest-VolumesServicesTestJSON-1758176808 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:45:51.366252 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5ebeefa3-b278-4c94-ae8f-5bbeb8edc02d tempest-VolumesServicesTestJSON-1758176808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d9fc175-0d8f-4d14-9b75-fa65a9d9b7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:45:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-787069385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5d9cd4a2-be50-4f7a-8ac8-b431d3798818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279819639ef54e359d1e00a99cb324e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:45:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:45:51Z,use_quota=True,user_id='6c8a9e34d2244d84ac3abc21964c0261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:45:51.368856 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5ebeefa3-b278-4c94-ae8f-5bbeb8edc02d tempest-VolumesServicesTestJSON-1758176808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28e4bd16-0c0c-4de8-bfd3-8a2bdd6c0f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:45:51.371037 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5ebeefa3-b278-4c94-ae8f-5bbeb8edc02d tempest-VolumesServicesTestJSON-1758176808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28e4bd16-0c0c-4de8-bfd3-8a2bdd6c0f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:45:51.373491 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5ebeefa3-b278-4c94-ae8f-5bbeb8edc02d tempest-VolumesServicesTestJSON-1758176808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4abbd07c-167f-4c4a-ad67-27c7fcc2fca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:45:51.375747 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5ebeefa3-b278-4c94-ae8f-5bbeb8edc02d tempest-VolumesServicesTestJSON-1758176808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4abbd07c-167f-4c4a-ad67-27c7fcc2fca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d9cd4a2-be50-4f7a-8ac8-b431d3798818', 'volume_name': 'volume-5d9cd4a2-be50-4f7a-8ac8-b431d3798818', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:45:51.378091 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5ebeefa3-b278-4c94-ae8f-5bbeb8edc02d tempest-VolumesServicesTestJSON-1758176808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6a0ee37-75c8-4c84-b997-b61333a66bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:45:51.380213 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5ebeefa3-b278-4c94-ae8f-5bbeb8edc02d tempest-VolumesServicesTestJSON-1758176808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6a0ee37-75c8-4c84-b997-b61333a66bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:45:51.382450 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5ebeefa3-b278-4c94-ae8f-5bbeb8edc02d tempest-VolumesServicesTestJSON-1758176808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb9502c2-3b2f-4a6e-9128-c7dfb9753f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:45:51.383342 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-5ebeefa3-b278-4c94-ae8f-5bbeb8edc02d tempest-VolumesServicesTestJSON-1758176808 None] Volume 5d9cd4a2-be50-4f7a-8ac8-b431d3798818: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d9cd4a2-be50-4f7a-8ac8-b431d3798818', 'volume_size': 1} Dec 25 21:45:51.383743 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-5ebeefa3-b278-4c94-ae8f-5bbeb8edc02d tempest-VolumesServicesTestJSON-1758176808 None] creating volume 'volume-5d9cd4a2-be50-4f7a-8ac8-b431d3798818' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:45:51.384759 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-5ebeefa3-b278-4c94-ae8f-5bbeb8edc02d tempest-VolumesServicesTestJSON-1758176808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:45:51.897922 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-5ebeefa3-b278-4c94-ae8f-5bbeb8edc02d tempest-VolumesServicesTestJSON-1758176808 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:45:51.898308 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-5ebeefa3-b278-4c94-ae8f-5bbeb8edc02d tempest-VolumesServicesTestJSON-1758176808 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:45:51.900380 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5ebeefa3-b278-4c94-ae8f-5bbeb8edc02d tempest-VolumesServicesTestJSON-1758176808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb9502c2-3b2f-4a6e-9128-c7dfb9753f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d9cd4a2-be50-4f7a-8ac8-b431d3798818', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:45:51.902602 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5ebeefa3-b278-4c94-ae8f-5bbeb8edc02d tempest-VolumesServicesTestJSON-1758176808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2408bb51-cb3a-436b-a5e3-22483356324d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:45:52.004099 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-5ebeefa3-b278-4c94-ae8f-5bbeb8edc02d tempest-VolumesServicesTestJSON-1758176808 None] Volume volume-5d9cd4a2-be50-4f7a-8ac8-b431d3798818 (5d9cd4a2-be50-4f7a-8ac8-b431d3798818): created successfully Dec 25 21:45:52.006199 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5ebeefa3-b278-4c94-ae8f-5bbeb8edc02d tempest-VolumesServicesTestJSON-1758176808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2408bb51-cb3a-436b-a5e3-22483356324d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:45:52.009235 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-5ebeefa3-b278-4c94-ae8f-5bbeb8edc02d tempest-VolumesServicesTestJSON-1758176808 None] Flow 'volume_create_manager' (1c4bf288-7a43-4e3a-a51c-dff75ecafe50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:45:52.071897 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-5ebeefa3-b278-4c94-ae8f-5bbeb8edc02d tempest-VolumesServicesTestJSON-1758176808 None] Created volume successfully. Dec 25 21:45:52.401291 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-c2c8da3f-af9a-4c39-b947-f275a9564903 tempest-VolumesServicesTestJSON-1758176808 None] Lock "b'cinder-5d9cd4a2-be50-4f7a-8ac8-b431d3798818-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:45:52.483061 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-c2c8da3f-af9a-4c39-b947-f275a9564903 tempest-VolumesServicesTestJSON-1758176808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:45:52.642438 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-c2c8da3f-af9a-4c39-b947-f275a9564903 tempest-VolumesServicesTestJSON-1758176808 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:45:52.642900 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-c2c8da3f-af9a-4c39-b947-f275a9564903 tempest-VolumesServicesTestJSON-1758176808 None] Volume volume-5d9cd4a2-be50-4f7a-8ac8-b431d3798818 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:45:52.735315 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-c2c8da3f-af9a-4c39-b947-f275a9564903 tempest-VolumesServicesTestJSON-1758176808 None] deleting rbd volume volume-5d9cd4a2-be50-4f7a-8ac8-b431d3798818 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:45:55.922893 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-c2c8da3f-af9a-4c39-b947-f275a9564903 tempest-VolumesServicesTestJSON-1758176808 None] Created reservations ['3821da07-d0a2-4791-b171-6775d50a6be3', 'e59abe49-7512-403e-aade-ae58c4533117', 'db8dd28e-576c-4cf5-aa5e-a984be253c33', '9b35f53c-b3fa-4bff-bd63-5ebf2fc4f192'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:45:56.135722 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-c2c8da3f-af9a-4c39-b947-f275a9564903 tempest-VolumesServicesTestJSON-1758176808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:45:56.168422 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-c2c8da3f-af9a-4c39-b947-f275a9564903 tempest-VolumesServicesTestJSON-1758176808 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:45:56.209265 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-c2c8da3f-af9a-4c39-b947-f275a9564903 tempest-VolumesServicesTestJSON-1758176808 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:45:56.214732 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-c2c8da3f-af9a-4c39-b947-f275a9564903 tempest-VolumesServicesTestJSON-1758176808 None] Deleted volume successfully. Dec 25 21:45:56.265533 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-c2c8da3f-af9a-4c39-b947-f275a9564903 tempest-VolumesServicesTestJSON-1758176808 None] Lock "b'cinder-5d9cd4a2-be50-4f7a-8ac8-b431d3798818-delete_volume'" released by "delete_volume" :: held 3.864s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:46:02.153246 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-14c20a55-1fc7-4f55-b6e6-0f5c45309609 tempest-VolumeTypesAccessTest-438453360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:46:02.156406 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-14c20a55-1fc7-4f55-b6e6-0f5c45309609 tempest-VolumeTypesAccessTest-438453360 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:46:02.156854 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-14c20a55-1fc7-4f55-b6e6-0f5c45309609 tempest-VolumeTypesAccessTest-438453360 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:46:02.169735 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-14c20a55-1fc7-4f55-b6e6-0f5c45309609 tempest-VolumeTypesAccessTest-438453360 None] Flow 'volume_create_manager' (39f9b7cc-03ae-483c-97e3-1fb8557b29c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:46:02.172839 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-14c20a55-1fc7-4f55-b6e6-0f5c45309609 tempest-VolumeTypesAccessTest-438453360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63d0cf0e-4cbb-4be6-a67d-347cdadf16e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:46:02.178981 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-14c20a55-1fc7-4f55-b6e6-0f5c45309609 tempest-VolumeTypesAccessTest-438453360 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:46:02.191081 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-14c20a55-1fc7-4f55-b6e6-0f5c45309609 tempest-VolumeTypesAccessTest-438453360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63d0cf0e-4cbb-4be6-a67d-347cdadf16e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-382407427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2f2d8f03-aafc-40f6-a5e2-2b8e57ccfd60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='149356e4ad8c46bf99b5a68754160755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:46:02Z,use_quota=True,user_id='9741b10f619c44f9b5c14c9945d125cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86c0d2e2-fb84-4f57-a264-663e7bbda452),volume_type_id=86c0d2e2-fb84-4f57-a264-663e7bbda452)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:46:02.193669 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-14c20a55-1fc7-4f55-b6e6-0f5c45309609 tempest-VolumeTypesAccessTest-438453360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (044612c3-1038-45ce-bb47-5e355b43a0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:46:02.195780 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-14c20a55-1fc7-4f55-b6e6-0f5c45309609 tempest-VolumeTypesAccessTest-438453360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (044612c3-1038-45ce-bb47-5e355b43a0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:46:02.198191 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-14c20a55-1fc7-4f55-b6e6-0f5c45309609 tempest-VolumeTypesAccessTest-438453360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95893066-0edd-4a85-a2a8-6e85532a23df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:46:02.200401 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-14c20a55-1fc7-4f55-b6e6-0f5c45309609 tempest-VolumeTypesAccessTest-438453360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95893066-0edd-4a85-a2a8-6e85532a23df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f2d8f03-aafc-40f6-a5e2-2b8e57ccfd60', 'volume_name': 'volume-2f2d8f03-aafc-40f6-a5e2-2b8e57ccfd60', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:46:02.202820 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-14c20a55-1fc7-4f55-b6e6-0f5c45309609 tempest-VolumeTypesAccessTest-438453360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97a67858-0e66-4b3d-a074-850d5a3831be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:46:02.204934 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-14c20a55-1fc7-4f55-b6e6-0f5c45309609 tempest-VolumeTypesAccessTest-438453360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97a67858-0e66-4b3d-a074-850d5a3831be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:46:02.207112 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-14c20a55-1fc7-4f55-b6e6-0f5c45309609 tempest-VolumeTypesAccessTest-438453360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c64cdf8-ce1c-40f5-b058-501b6b8a4eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:46:02.207924 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-14c20a55-1fc7-4f55-b6e6-0f5c45309609 tempest-VolumeTypesAccessTest-438453360 None] Volume 2f2d8f03-aafc-40f6-a5e2-2b8e57ccfd60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f2d8f03-aafc-40f6-a5e2-2b8e57ccfd60', 'volume_size': 1} Dec 25 21:46:02.208320 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-14c20a55-1fc7-4f55-b6e6-0f5c45309609 tempest-VolumeTypesAccessTest-438453360 None] creating volume 'volume-2f2d8f03-aafc-40f6-a5e2-2b8e57ccfd60' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:46:02.209801 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-14c20a55-1fc7-4f55-b6e6-0f5c45309609 tempest-VolumeTypesAccessTest-438453360 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:46:02.622921 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-14c20a55-1fc7-4f55-b6e6-0f5c45309609 tempest-VolumeTypesAccessTest-438453360 None] extra_specs: {} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:46:02.623297 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-14c20a55-1fc7-4f55-b6e6-0f5c45309609 tempest-VolumeTypesAccessTest-438453360 None] extra_specs: {} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:46:02.625427 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-14c20a55-1fc7-4f55-b6e6-0f5c45309609 tempest-VolumeTypesAccessTest-438453360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c64cdf8-ce1c-40f5-b058-501b6b8a4eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f2d8f03-aafc-40f6-a5e2-2b8e57ccfd60', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:46:02.627623 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-14c20a55-1fc7-4f55-b6e6-0f5c45309609 tempest-VolumeTypesAccessTest-438453360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (368505b0-74ca-4021-9a7f-4b2d5ce25f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:46:02.734239 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-14c20a55-1fc7-4f55-b6e6-0f5c45309609 tempest-VolumeTypesAccessTest-438453360 None] Volume volume-2f2d8f03-aafc-40f6-a5e2-2b8e57ccfd60 (2f2d8f03-aafc-40f6-a5e2-2b8e57ccfd60): created successfully Dec 25 21:46:02.736194 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-14c20a55-1fc7-4f55-b6e6-0f5c45309609 tempest-VolumeTypesAccessTest-438453360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (368505b0-74ca-4021-9a7f-4b2d5ce25f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:46:02.739315 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-14c20a55-1fc7-4f55-b6e6-0f5c45309609 tempest-VolumeTypesAccessTest-438453360 None] Flow 'volume_create_manager' (39f9b7cc-03ae-483c-97e3-1fb8557b29c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:46:02.820173 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-14c20a55-1fc7-4f55-b6e6-0f5c45309609 tempest-VolumeTypesAccessTest-438453360 None] Created volume successfully. Dec 25 21:46:03.839857 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-edf9f1fb-3fdc-4b0e-9325-9decb8ca3163 tempest-VolumeTypesAccessTest-438453360 None] Lock "b'cinder-2f2d8f03-aafc-40f6-a5e2-2b8e57ccfd60-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:46:03.977599 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-edf9f1fb-3fdc-4b0e-9325-9decb8ca3163 tempest-VolumeTypesAccessTest-438453360 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:46:04.099801 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-edf9f1fb-3fdc-4b0e-9325-9decb8ca3163 tempest-VolumeTypesAccessTest-438453360 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:46:04.100148 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-edf9f1fb-3fdc-4b0e-9325-9decb8ca3163 tempest-VolumeTypesAccessTest-438453360 None] Volume volume-2f2d8f03-aafc-40f6-a5e2-2b8e57ccfd60 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:46:04.214891 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-edf9f1fb-3fdc-4b0e-9325-9decb8ca3163 tempest-VolumeTypesAccessTest-438453360 None] deleting rbd volume volume-2f2d8f03-aafc-40f6-a5e2-2b8e57ccfd60 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:46:07.239196 ncdv-master-1 cinder-volume[129926]: WARNING cinder.quota [None req-edf9f1fb-3fdc-4b0e-9325-9decb8ca3163 tempest-VolumeTypesAccessTest-438453360 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-765028823 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-765028823, it is now deprecated. Please use the default quota class for default quota. Dec 25 21:46:07.239987 ncdv-master-1 cinder-volume[129926]: WARNING cinder.quota [None req-edf9f1fb-3fdc-4b0e-9325-9decb8ca3163 tempest-VolumeTypesAccessTest-438453360 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-765028823 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-765028823, it is now deprecated. Please use the default quota class for default quota. Dec 25 21:46:07.334339 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-edf9f1fb-3fdc-4b0e-9325-9decb8ca3163 tempest-VolumeTypesAccessTest-438453360 None] Created reservations ['5a97ad8b-c148-463a-a09a-dc8b2c73974e', 'e088a6a3-812f-4ae3-b9e1-ac5983e189d1', 'f81375c6-2eaf-47e9-b9f1-7788a764ae67', 'b10cee2d-e17f-42e1-9f1a-01ac739000e2'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:46:07.471913 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-edf9f1fb-3fdc-4b0e-9325-9decb8ca3163 tempest-VolumeTypesAccessTest-438453360 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:46:07.498681 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-edf9f1fb-3fdc-4b0e-9325-9decb8ca3163 tempest-VolumeTypesAccessTest-438453360 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:46:07.528285 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-edf9f1fb-3fdc-4b0e-9325-9decb8ca3163 tempest-VolumeTypesAccessTest-438453360 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:46:07.533257 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-edf9f1fb-3fdc-4b0e-9325-9decb8ca3163 tempest-VolumeTypesAccessTest-438453360 None] Deleted volume successfully. Dec 25 21:46:07.587823 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-edf9f1fb-3fdc-4b0e-9325-9decb8ca3163 tempest-VolumeTypesAccessTest-438453360 None] Lock "b'cinder-2f2d8f03-aafc-40f6-a5e2-2b8e57ccfd60-delete_volume'" released by "delete_volume" :: held 3.748s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:46:13.701782 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-680ef31d-3880-46f5-80ce-bc9bb81dedb7 tempest-VolumesBackupsAdminTest-869564114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:46:13.705142 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-680ef31d-3880-46f5-80ce-bc9bb81dedb7 tempest-VolumesBackupsAdminTest-869564114 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:46:13.705590 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-680ef31d-3880-46f5-80ce-bc9bb81dedb7 tempest-VolumesBackupsAdminTest-869564114 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:46:13.717776 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-680ef31d-3880-46f5-80ce-bc9bb81dedb7 tempest-VolumesBackupsAdminTest-869564114 None] Flow 'volume_create_manager' (7a6e6336-3b23-4307-8c32-2f049714de38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:46:13.720950 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-680ef31d-3880-46f5-80ce-bc9bb81dedb7 tempest-VolumesBackupsAdminTest-869564114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e76ae38-ed4e-4d41-8f1c-3beb061d9d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:46:13.727085 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-680ef31d-3880-46f5-80ce-bc9bb81dedb7 tempest-VolumesBackupsAdminTest-869564114 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:46:13.740177 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-680ef31d-3880-46f5-80ce-bc9bb81dedb7 tempest-VolumesBackupsAdminTest-869564114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e76ae38-ed4e-4d41-8f1c-3beb061d9d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:46:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-1643294350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5b13f37b-b766-43c1-8d43-9ce551127c45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa8630d2e43497ba2b768b480d83a98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:46:14Z,use_quota=True,user_id='b45633f2a78049f6b73c1f46e5ecb1a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:46:13.742812 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-680ef31d-3880-46f5-80ce-bc9bb81dedb7 tempest-VolumesBackupsAdminTest-869564114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cb322d5-cecd-4323-ab56-8a4fa23cefb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:46:13.745542 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-680ef31d-3880-46f5-80ce-bc9bb81dedb7 tempest-VolumesBackupsAdminTest-869564114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cb322d5-cecd-4323-ab56-8a4fa23cefb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:46:13.748010 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-680ef31d-3880-46f5-80ce-bc9bb81dedb7 tempest-VolumesBackupsAdminTest-869564114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1060d89-2c68-471f-8ee1-e882f8f2305a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:46:13.750314 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-680ef31d-3880-46f5-80ce-bc9bb81dedb7 tempest-VolumesBackupsAdminTest-869564114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1060d89-2c68-471f-8ee1-e882f8f2305a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b13f37b-b766-43c1-8d43-9ce551127c45', 'volume_name': 'volume-5b13f37b-b766-43c1-8d43-9ce551127c45', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:46:13.752598 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-680ef31d-3880-46f5-80ce-bc9bb81dedb7 tempest-VolumesBackupsAdminTest-869564114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6bea424-48f8-400e-ac4f-cc54a9dfe5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:46:13.754744 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-680ef31d-3880-46f5-80ce-bc9bb81dedb7 tempest-VolumesBackupsAdminTest-869564114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6bea424-48f8-400e-ac4f-cc54a9dfe5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:46:13.756954 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-680ef31d-3880-46f5-80ce-bc9bb81dedb7 tempest-VolumesBackupsAdminTest-869564114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be9094de-d391-4871-925f-98699aa7ee13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:46:13.757758 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-680ef31d-3880-46f5-80ce-bc9bb81dedb7 tempest-VolumesBackupsAdminTest-869564114 None] Volume 5b13f37b-b766-43c1-8d43-9ce551127c45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b13f37b-b766-43c1-8d43-9ce551127c45', 'volume_size': 1} Dec 25 21:46:13.758149 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-680ef31d-3880-46f5-80ce-bc9bb81dedb7 tempest-VolumesBackupsAdminTest-869564114 None] creating volume 'volume-5b13f37b-b766-43c1-8d43-9ce551127c45' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:46:13.759137 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-680ef31d-3880-46f5-80ce-bc9bb81dedb7 tempest-VolumesBackupsAdminTest-869564114 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:46:14.291645 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-680ef31d-3880-46f5-80ce-bc9bb81dedb7 tempest-VolumesBackupsAdminTest-869564114 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:46:14.292089 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-680ef31d-3880-46f5-80ce-bc9bb81dedb7 tempest-VolumesBackupsAdminTest-869564114 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:46:14.294136 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-680ef31d-3880-46f5-80ce-bc9bb81dedb7 tempest-VolumesBackupsAdminTest-869564114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be9094de-d391-4871-925f-98699aa7ee13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b13f37b-b766-43c1-8d43-9ce551127c45', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:46:14.297750 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-680ef31d-3880-46f5-80ce-bc9bb81dedb7 tempest-VolumesBackupsAdminTest-869564114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d6865b2-c017-4ceb-8e40-bf6c0b23c6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:46:14.408612 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-680ef31d-3880-46f5-80ce-bc9bb81dedb7 tempest-VolumesBackupsAdminTest-869564114 None] Volume volume-5b13f37b-b766-43c1-8d43-9ce551127c45 (5b13f37b-b766-43c1-8d43-9ce551127c45): created successfully Dec 25 21:46:14.410614 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-680ef31d-3880-46f5-80ce-bc9bb81dedb7 tempest-VolumesBackupsAdminTest-869564114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d6865b2-c017-4ceb-8e40-bf6c0b23c6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:46:14.413813 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-680ef31d-3880-46f5-80ce-bc9bb81dedb7 tempest-VolumesBackupsAdminTest-869564114 None] Flow 'volume_create_manager' (7a6e6336-3b23-4307-8c32-2f049714de38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:46:14.526631 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-680ef31d-3880-46f5-80ce-bc9bb81dedb7 tempest-VolumesBackupsAdminTest-869564114 None] Created volume successfully. Dec 25 21:46:15.367530 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [None req-4bc3ad18-a239-4469-bf70-595fcd5e8bbd tempest-VolumesBackupsAdminTest-869564114 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:46:16.023595 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [None req-4bc3ad18-a239-4469-bf70-595fcd5e8bbd tempest-VolumesBackupsAdminTest-869564114 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.656s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:46:16.024400 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-4bc3ad18-a239-4469-bf70-595fcd5e8bbd tempest-VolumesBackupsAdminTest-869564114 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5b13f37b-b766-43c1-8d43-9ce551127c45', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': '5b13f37b-b766-43c1-8d43-9ce551127c45', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 21:46:16.039878 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-4bc3ad18-a239-4469-bf70-595fcd5e8bbd tempest-VolumesBackupsAdminTest-869564114 None] Initialize volume connection completed successfully. Dec 25 21:46:19.953593 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-4bc3ad18-a239-4469-bf70-595fcd5e8bbd tempest-VolumesBackupsAdminTest-869564114 None] Terminate volume connection completed successfully. Dec 25 21:46:19.978726 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-4bc3ad18-a239-4469-bf70-595fcd5e8bbd tempest-VolumesBackupsAdminTest-869564114 None] Remove volume export completed successfully. Dec 25 21:46:22.783006 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-09d8e2da-4a5b-4d01-8cc8-657637f6875c tempest-VolumesBackupsAdminTest-869564114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:46:22.787909 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-09d8e2da-4a5b-4d01-8cc8-657637f6875c tempest-VolumesBackupsAdminTest-869564114 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:46:22.788497 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-09d8e2da-4a5b-4d01-8cc8-657637f6875c tempest-VolumesBackupsAdminTest-869564114 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:46:22.802562 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-09d8e2da-4a5b-4d01-8cc8-657637f6875c tempest-VolumesBackupsAdminTest-869564114 None] Flow 'volume_create_manager' (47ceb27c-cd1d-476c-bb93-44ca1a0b2207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:46:22.805924 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-09d8e2da-4a5b-4d01-8cc8-657637f6875c tempest-VolumesBackupsAdminTest-869564114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e18a5b3-f4b4-4591-98e7-ece1632df6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:46:22.812563 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-09d8e2da-4a5b-4d01-8cc8-657637f6875c tempest-VolumesBackupsAdminTest-869564114 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:46:22.826887 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-09d8e2da-4a5b-4d01-8cc8-657637f6875c tempest-VolumesBackupsAdminTest-869564114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e18a5b3-f4b4-4591-98e7-ece1632df6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:46:22Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_db8899c3-364f-425e-837b-0faa75339ff4',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=fbff126a-a78a-41f1-84fc-eb484dd711c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa8630d2e43497ba2b768b480d83a98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:46:23Z,use_quota=True,user_id='b45633f2a78049f6b73c1f46e5ecb1a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:46:22.829510 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-09d8e2da-4a5b-4d01-8cc8-657637f6875c tempest-VolumesBackupsAdminTest-869564114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cee40ca-3bad-446f-b7ef-8e844a182610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:46:22.831712 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-09d8e2da-4a5b-4d01-8cc8-657637f6875c tempest-VolumesBackupsAdminTest-869564114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cee40ca-3bad-446f-b7ef-8e844a182610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:46:22.834175 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-09d8e2da-4a5b-4d01-8cc8-657637f6875c tempest-VolumesBackupsAdminTest-869564114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1352fad2-950b-4914-bfdb-f0e13016f2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:46:22.836590 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-09d8e2da-4a5b-4d01-8cc8-657637f6875c tempest-VolumesBackupsAdminTest-869564114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1352fad2-950b-4914-bfdb-f0e13016f2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbff126a-a78a-41f1-84fc-eb484dd711c7', 'volume_name': 'volume-fbff126a-a78a-41f1-84fc-eb484dd711c7', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:46:22.839559 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-09d8e2da-4a5b-4d01-8cc8-657637f6875c tempest-VolumesBackupsAdminTest-869564114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8e9716b-04d2-4836-97ea-0567fd278713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:46:22.841749 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-09d8e2da-4a5b-4d01-8cc8-657637f6875c tempest-VolumesBackupsAdminTest-869564114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8e9716b-04d2-4836-97ea-0567fd278713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:46:22.844171 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-09d8e2da-4a5b-4d01-8cc8-657637f6875c tempest-VolumesBackupsAdminTest-869564114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf131a34-5db9-452c-a664-cca16a38d49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:46:22.845023 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-09d8e2da-4a5b-4d01-8cc8-657637f6875c tempest-VolumesBackupsAdminTest-869564114 None] Volume fbff126a-a78a-41f1-84fc-eb484dd711c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbff126a-a78a-41f1-84fc-eb484dd711c7', 'volume_size': 1} Dec 25 21:46:22.848192 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-09d8e2da-4a5b-4d01-8cc8-657637f6875c tempest-VolumesBackupsAdminTest-869564114 None] creating volume 'volume-fbff126a-a78a-41f1-84fc-eb484dd711c7' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:46:22.848192 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-09d8e2da-4a5b-4d01-8cc8-657637f6875c tempest-VolumesBackupsAdminTest-869564114 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:46:23.269378 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-09d8e2da-4a5b-4d01-8cc8-657637f6875c tempest-VolumesBackupsAdminTest-869564114 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:46:23.269922 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-09d8e2da-4a5b-4d01-8cc8-657637f6875c tempest-VolumesBackupsAdminTest-869564114 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:46:23.272107 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-09d8e2da-4a5b-4d01-8cc8-657637f6875c tempest-VolumesBackupsAdminTest-869564114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf131a34-5db9-452c-a664-cca16a38d49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbff126a-a78a-41f1-84fc-eb484dd711c7', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:46:23.274506 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-09d8e2da-4a5b-4d01-8cc8-657637f6875c tempest-VolumesBackupsAdminTest-869564114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c567b18-9874-4170-a18a-2cf0f9572f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:46:23.322901 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-09d8e2da-4a5b-4d01-8cc8-657637f6875c tempest-VolumesBackupsAdminTest-869564114 None] Volume volume-fbff126a-a78a-41f1-84fc-eb484dd711c7 (fbff126a-a78a-41f1-84fc-eb484dd711c7): created successfully Dec 25 21:46:23.325202 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-09d8e2da-4a5b-4d01-8cc8-657637f6875c tempest-VolumesBackupsAdminTest-869564114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c567b18-9874-4170-a18a-2cf0f9572f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:46:23.328368 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-09d8e2da-4a5b-4d01-8cc8-657637f6875c tempest-VolumesBackupsAdminTest-869564114 None] Flow 'volume_create_manager' (47ceb27c-cd1d-476c-bb93-44ca1a0b2207) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:46:23.408489 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-09d8e2da-4a5b-4d01-8cc8-657637f6875c tempest-VolumesBackupsAdminTest-869564114 None] Created volume successfully. Dec 25 21:46:23.829707 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [None req-09d8e2da-4a5b-4d01-8cc8-657637f6875c tempest-VolumesBackupsAdminTest-869564114 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:46:24.499173 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [None req-09d8e2da-4a5b-4d01-8cc8-657637f6875c tempest-VolumesBackupsAdminTest-869564114 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.672s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:46:24.499998 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-09d8e2da-4a5b-4d01-8cc8-657637f6875c tempest-VolumesBackupsAdminTest-869564114 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-fbff126a-a78a-41f1-84fc-eb484dd711c7', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': 'fbff126a-a78a-41f1-84fc-eb484dd711c7', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 21:46:24.516592 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-09d8e2da-4a5b-4d01-8cc8-657637f6875c tempest-VolumesBackupsAdminTest-869564114 None] Initialize volume connection completed successfully. Dec 25 21:46:27.267481 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-09d8e2da-4a5b-4d01-8cc8-657637f6875c tempest-VolumesBackupsAdminTest-869564114 None] Terminate volume connection completed successfully. Dec 25 21:46:27.287076 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-09d8e2da-4a5b-4d01-8cc8-657637f6875c tempest-VolumesBackupsAdminTest-869564114 None] Remove volume export completed successfully. Dec 25 21:46:28.180028 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-cc65c44e-c43b-467e-ba9d-4b07a26084ff tempest-VolumesBackupsAdminTest-869564114 None] Lock "b'cinder-fbff126a-a78a-41f1-84fc-eb484dd711c7-delete_volume'" acquired by "delete_volume" :: waited 0.028s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:46:28.315123 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-cc65c44e-c43b-467e-ba9d-4b07a26084ff tempest-VolumesBackupsAdminTest-869564114 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:46:30.489677 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-cc65c44e-c43b-467e-ba9d-4b07a26084ff tempest-VolumesBackupsAdminTest-869564114 None] Volume volume-fbff126a-a78a-41f1-84fc-eb484dd711c7 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:46:30.866349 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-cc65c44e-c43b-467e-ba9d-4b07a26084ff tempest-VolumesBackupsAdminTest-869564114 None] deleting rbd volume volume-fbff126a-a78a-41f1-84fc-eb484dd711c7 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:46:32.467229 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:46:32.468020 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:46:32.597880 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:46:32.652341 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:46:36.546607 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-cc65c44e-c43b-467e-ba9d-4b07a26084ff tempest-VolumesBackupsAdminTest-869564114 None] Created reservations ['aa7a885b-9e40-4d35-b036-d3972eb5c55e', '2cb3225f-9cc2-4ce1-a59e-a640e9b7ddad', '9d55ef4a-5afc-4d09-9b3b-6c7db3d5df03', '9a9f26d4-faa1-4378-a7bd-b298e5ff5ee1'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:46:36.717000 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-cc65c44e-c43b-467e-ba9d-4b07a26084ff tempest-VolumesBackupsAdminTest-869564114 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:46:36.784207 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-cc65c44e-c43b-467e-ba9d-4b07a26084ff tempest-VolumesBackupsAdminTest-869564114 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:46:36.852936 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-cc65c44e-c43b-467e-ba9d-4b07a26084ff tempest-VolumesBackupsAdminTest-869564114 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:46:36.857841 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-cc65c44e-c43b-467e-ba9d-4b07a26084ff tempest-VolumesBackupsAdminTest-869564114 None] Deleted volume successfully. Dec 25 21:46:36.974512 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-cc65c44e-c43b-467e-ba9d-4b07a26084ff tempest-VolumesBackupsAdminTest-869564114 None] Lock "b'cinder-fbff126a-a78a-41f1-84fc-eb484dd711c7-delete_volume'" released by "delete_volume" :: held 8.794s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:46:39.790071 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa9862e2-80c1-4339-ad24-0eb9bec5e99d tempest-VolumesBackupsAdminTest-869564114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:46:39.798296 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-fa9862e2-80c1-4339-ad24-0eb9bec5e99d tempest-VolumesBackupsAdminTest-869564114 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:46:39.799039 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-fa9862e2-80c1-4339-ad24-0eb9bec5e99d tempest-VolumesBackupsAdminTest-869564114 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:46:39.825924 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-fa9862e2-80c1-4339-ad24-0eb9bec5e99d tempest-VolumesBackupsAdminTest-869564114 None] Flow 'volume_create_manager' (6be008be-5113-4cf6-9cbd-46505cb4b59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:46:39.833729 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-fa9862e2-80c1-4339-ad24-0eb9bec5e99d tempest-VolumesBackupsAdminTest-869564114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d55225c-c573-4bca-a532-da5f2c6f1437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:46:39.854767 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-fa9862e2-80c1-4339-ad24-0eb9bec5e99d tempest-VolumesBackupsAdminTest-869564114 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:46:39.881484 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-fa9862e2-80c1-4339-ad24-0eb9bec5e99d tempest-VolumesBackupsAdminTest-869564114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d55225c-c573-4bca-a532-da5f2c6f1437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:46:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-521674702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=cd13dd2c-fc3f-43c6-bd53-e46cb8d21cd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa8630d2e43497ba2b768b480d83a98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:46:40Z,use_quota=True,user_id='b45633f2a78049f6b73c1f46e5ecb1a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:46:39.891801 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-fa9862e2-80c1-4339-ad24-0eb9bec5e99d tempest-VolumesBackupsAdminTest-869564114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39690d0f-4501-4df8-ac03-0b98d38b15b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:46:39.894356 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-fa9862e2-80c1-4339-ad24-0eb9bec5e99d tempest-VolumesBackupsAdminTest-869564114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39690d0f-4501-4df8-ac03-0b98d38b15b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:46:39.900267 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-fa9862e2-80c1-4339-ad24-0eb9bec5e99d tempest-VolumesBackupsAdminTest-869564114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (014649cd-98b4-4050-9093-4b1b1d9a520f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:46:39.905787 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-fa9862e2-80c1-4339-ad24-0eb9bec5e99d tempest-VolumesBackupsAdminTest-869564114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (014649cd-98b4-4050-9093-4b1b1d9a520f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd13dd2c-fc3f-43c6-bd53-e46cb8d21cd6', 'volume_name': 'volume-cd13dd2c-fc3f-43c6-bd53-e46cb8d21cd6', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:46:39.916439 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-fa9862e2-80c1-4339-ad24-0eb9bec5e99d tempest-VolumesBackupsAdminTest-869564114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e43bd231-4e8f-433f-bfbf-4211bdcbb467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:46:39.919282 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-fa9862e2-80c1-4339-ad24-0eb9bec5e99d tempest-VolumesBackupsAdminTest-869564114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e43bd231-4e8f-433f-bfbf-4211bdcbb467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:46:39.928025 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-fa9862e2-80c1-4339-ad24-0eb9bec5e99d tempest-VolumesBackupsAdminTest-869564114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f61dce9-9419-4418-af06-c77fdfb590ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:46:39.929572 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-fa9862e2-80c1-4339-ad24-0eb9bec5e99d tempest-VolumesBackupsAdminTest-869564114 None] Volume cd13dd2c-fc3f-43c6-bd53-e46cb8d21cd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd13dd2c-fc3f-43c6-bd53-e46cb8d21cd6', 'volume_size': 1} Dec 25 21:46:39.930139 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-fa9862e2-80c1-4339-ad24-0eb9bec5e99d tempest-VolumesBackupsAdminTest-869564114 None] creating volume 'volume-cd13dd2c-fc3f-43c6-bd53-e46cb8d21cd6' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:46:39.931929 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-fa9862e2-80c1-4339-ad24-0eb9bec5e99d tempest-VolumesBackupsAdminTest-869564114 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:46:40.868197 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-fa9862e2-80c1-4339-ad24-0eb9bec5e99d tempest-VolumesBackupsAdminTest-869564114 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:46:40.868808 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-fa9862e2-80c1-4339-ad24-0eb9bec5e99d tempest-VolumesBackupsAdminTest-869564114 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:46:40.872366 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-fa9862e2-80c1-4339-ad24-0eb9bec5e99d tempest-VolumesBackupsAdminTest-869564114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f61dce9-9419-4418-af06-c77fdfb590ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd13dd2c-fc3f-43c6-bd53-e46cb8d21cd6', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:46:40.875639 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-fa9862e2-80c1-4339-ad24-0eb9bec5e99d tempest-VolumesBackupsAdminTest-869564114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f14b4a3c-fb50-47ee-997f-e7fe2eef0c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:46:40.967182 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-fa9862e2-80c1-4339-ad24-0eb9bec5e99d tempest-VolumesBackupsAdminTest-869564114 None] Volume volume-cd13dd2c-fc3f-43c6-bd53-e46cb8d21cd6 (cd13dd2c-fc3f-43c6-bd53-e46cb8d21cd6): created successfully Dec 25 21:46:40.975179 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-fa9862e2-80c1-4339-ad24-0eb9bec5e99d tempest-VolumesBackupsAdminTest-869564114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f14b4a3c-fb50-47ee-997f-e7fe2eef0c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:46:40.980949 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-fa9862e2-80c1-4339-ad24-0eb9bec5e99d tempest-VolumesBackupsAdminTest-869564114 None] Flow 'volume_create_manager' (6be008be-5113-4cf6-9cbd-46505cb4b59b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:46:41.069084 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-fa9862e2-80c1-4339-ad24-0eb9bec5e99d tempest-VolumesBackupsAdminTest-869564114 None] Created volume successfully. Dec 25 21:46:42.793992 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [None req-0b6715ab-57ca-431e-b787-a828aacc0fc2 tempest-VolumesBackupsAdminTest-869564114 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:46:43.843050 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [None req-0b6715ab-57ca-431e-b787-a828aacc0fc2 tempest-VolumesBackupsAdminTest-869564114 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.054s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:46:43.846474 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0b6715ab-57ca-431e-b787-a828aacc0fc2 tempest-VolumesBackupsAdminTest-869564114 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-cd13dd2c-fc3f-43c6-bd53-e46cb8d21cd6', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': 'cd13dd2c-fc3f-43c6-bd53-e46cb8d21cd6', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 21:46:43.875603 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-0b6715ab-57ca-431e-b787-a828aacc0fc2 tempest-VolumesBackupsAdminTest-869564114 None] Initialize volume connection completed successfully. Dec 25 21:46:49.912794 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-0b6715ab-57ca-431e-b787-a828aacc0fc2 tempest-VolumesBackupsAdminTest-869564114 None] Terminate volume connection completed successfully. Dec 25 21:46:49.932755 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-0b6715ab-57ca-431e-b787-a828aacc0fc2 tempest-VolumesBackupsAdminTest-869564114 None] Remove volume export completed successfully. Dec 25 21:46:58.325431 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-d9c148ba-faff-43b7-8338-66cb165df285 tempest-VolumesBackupsAdminTest-869564114 None] Lock "b'cinder-cd13dd2c-fc3f-43c6-bd53-e46cb8d21cd6-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:46:58.414222 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-d9c148ba-faff-43b7-8338-66cb165df285 tempest-VolumesBackupsAdminTest-869564114 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:47:00.824630 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-d9c148ba-faff-43b7-8338-66cb165df285 tempest-VolumesBackupsAdminTest-869564114 None] Volume volume-cd13dd2c-fc3f-43c6-bd53-e46cb8d21cd6 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:47:01.282377 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-d9c148ba-faff-43b7-8338-66cb165df285 tempest-VolumesBackupsAdminTest-869564114 None] deleting rbd volume volume-cd13dd2c-fc3f-43c6-bd53-e46cb8d21cd6 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:47:04.659096 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-d9c148ba-faff-43b7-8338-66cb165df285 tempest-VolumesBackupsAdminTest-869564114 None] Created reservations ['30902155-2383-4e62-8965-c6c190a1124d', '96ac5140-9221-4b1c-b096-d1455994985c', '661b6a40-9cd3-44bc-9e5b-b148ada4284f', 'e4578e44-ce72-4202-90ea-4986a3bfb817'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:47:04.820214 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-d9c148ba-faff-43b7-8338-66cb165df285 tempest-VolumesBackupsAdminTest-869564114 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:47:04.844158 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-d9c148ba-faff-43b7-8338-66cb165df285 tempest-VolumesBackupsAdminTest-869564114 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:47:04.872759 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-d9c148ba-faff-43b7-8338-66cb165df285 tempest-VolumesBackupsAdminTest-869564114 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:47:04.876989 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-d9c148ba-faff-43b7-8338-66cb165df285 tempest-VolumesBackupsAdminTest-869564114 None] Deleted volume successfully. Dec 25 21:47:04.978196 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-d9c148ba-faff-43b7-8338-66cb165df285 tempest-VolumesBackupsAdminTest-869564114 None] Lock "b'cinder-cd13dd2c-fc3f-43c6-bd53-e46cb8d21cd6-delete_volume'" released by "delete_volume" :: held 6.652s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:47:05.827134 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-79595469-01cb-4385-b119-95a3feaf60a1 tempest-VolumesBackupsAdminTest-869564114 None] Lock "b'cinder-5b13f37b-b766-43c1-8d43-9ce551127c45-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:47:05.933840 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-79595469-01cb-4385-b119-95a3feaf60a1 tempest-VolumesBackupsAdminTest-869564114 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:47:07.807079 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-79595469-01cb-4385-b119-95a3feaf60a1 tempest-VolumesBackupsAdminTest-869564114 None] Volume volume-5b13f37b-b766-43c1-8d43-9ce551127c45 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:47:08.196730 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-79595469-01cb-4385-b119-95a3feaf60a1 tempest-VolumesBackupsAdminTest-869564114 None] deleting rbd volume volume-5b13f37b-b766-43c1-8d43-9ce551127c45 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:47:11.413447 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-79595469-01cb-4385-b119-95a3feaf60a1 tempest-VolumesBackupsAdminTest-869564114 None] Created reservations ['1b3f5085-67fb-4e43-8ce1-be2254027ec8', 'b4937dad-bbd8-4455-9845-a0032e61ab16', '19d746ab-4f79-4fbe-9f6b-c2641aba0227', 'bb81f739-cf79-4516-b69a-e511785eed14'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:47:11.545264 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-79595469-01cb-4385-b119-95a3feaf60a1 tempest-VolumesBackupsAdminTest-869564114 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:47:11.567008 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-79595469-01cb-4385-b119-95a3feaf60a1 tempest-VolumesBackupsAdminTest-869564114 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:47:11.590016 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-79595469-01cb-4385-b119-95a3feaf60a1 tempest-VolumesBackupsAdminTest-869564114 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:47:11.595474 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-79595469-01cb-4385-b119-95a3feaf60a1 tempest-VolumesBackupsAdminTest-869564114 None] Deleted volume successfully. Dec 25 21:47:11.664151 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-79595469-01cb-4385-b119-95a3feaf60a1 tempest-VolumesBackupsAdminTest-869564114 None] Lock "b'cinder-5b13f37b-b766-43c1-8d43-9ce551127c45-delete_volume'" released by "delete_volume" :: held 5.837s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:47:16.341585 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-c81a6bba-edcb-42b4-87c3-a38da39648c0 tempest-VolumesMetadataTest-345175428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:47:16.345353 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-c81a6bba-edcb-42b4-87c3-a38da39648c0 tempest-VolumesMetadataTest-345175428 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:47:16.345835 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-c81a6bba-edcb-42b4-87c3-a38da39648c0 tempest-VolumesMetadataTest-345175428 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:47:16.359381 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-c81a6bba-edcb-42b4-87c3-a38da39648c0 tempest-VolumesMetadataTest-345175428 None] Flow 'volume_create_manager' (160cf3f2-924f-4fd8-b9f0-c98df202f9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:47:16.362719 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-c81a6bba-edcb-42b4-87c3-a38da39648c0 tempest-VolumesMetadataTest-345175428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eb659c5-d61d-44f5-a80f-3d2f81327edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:47:16.373423 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-c81a6bba-edcb-42b4-87c3-a38da39648c0 tempest-VolumesMetadataTest-345175428 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:47:16.380944 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-c81a6bba-edcb-42b4-87c3-a38da39648c0 tempest-VolumesMetadataTest-345175428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eb659c5-d61d-44f5-a80f-3d2f81327edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:47:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1011277407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2153d74a-269e-4b7c-a1e8-d4d20da7ff13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66934462c37d4394a5fd25935c7bf534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:47:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:47:16Z,use_quota=True,user_id='a8d3f65362a945dc861069fd57bcd8fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:47:16.384062 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-c81a6bba-edcb-42b4-87c3-a38da39648c0 tempest-VolumesMetadataTest-345175428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f0ac35-c92e-4db1-8aa3-0861d6c1d1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:47:16.386224 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-c81a6bba-edcb-42b4-87c3-a38da39648c0 tempest-VolumesMetadataTest-345175428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f0ac35-c92e-4db1-8aa3-0861d6c1d1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:47:16.388638 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-c81a6bba-edcb-42b4-87c3-a38da39648c0 tempest-VolumesMetadataTest-345175428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b550d936-5037-4568-8de9-a013be20c76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:47:16.390912 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-c81a6bba-edcb-42b4-87c3-a38da39648c0 tempest-VolumesMetadataTest-345175428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b550d936-5037-4568-8de9-a013be20c76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2153d74a-269e-4b7c-a1e8-d4d20da7ff13', 'volume_name': 'volume-2153d74a-269e-4b7c-a1e8-d4d20da7ff13', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:47:16.393213 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-c81a6bba-edcb-42b4-87c3-a38da39648c0 tempest-VolumesMetadataTest-345175428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19e376ce-32a8-4301-8e79-c91f18e89cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:47:16.395316 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-c81a6bba-edcb-42b4-87c3-a38da39648c0 tempest-VolumesMetadataTest-345175428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19e376ce-32a8-4301-8e79-c91f18e89cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:47:16.397564 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-c81a6bba-edcb-42b4-87c3-a38da39648c0 tempest-VolumesMetadataTest-345175428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0de31177-06a3-4e01-a0b4-c8374a073d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:47:16.398363 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-c81a6bba-edcb-42b4-87c3-a38da39648c0 tempest-VolumesMetadataTest-345175428 None] Volume 2153d74a-269e-4b7c-a1e8-d4d20da7ff13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2153d74a-269e-4b7c-a1e8-d4d20da7ff13', 'volume_size': 1} Dec 25 21:47:16.398765 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-c81a6bba-edcb-42b4-87c3-a38da39648c0 tempest-VolumesMetadataTest-345175428 None] creating volume 'volume-2153d74a-269e-4b7c-a1e8-d4d20da7ff13' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:47:16.399718 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-c81a6bba-edcb-42b4-87c3-a38da39648c0 tempest-VolumesMetadataTest-345175428 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:47:16.799210 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-c81a6bba-edcb-42b4-87c3-a38da39648c0 tempest-VolumesMetadataTest-345175428 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:47:16.799589 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-c81a6bba-edcb-42b4-87c3-a38da39648c0 tempest-VolumesMetadataTest-345175428 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:47:16.801719 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-c81a6bba-edcb-42b4-87c3-a38da39648c0 tempest-VolumesMetadataTest-345175428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0de31177-06a3-4e01-a0b4-c8374a073d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2153d74a-269e-4b7c-a1e8-d4d20da7ff13', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:47:16.803888 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-c81a6bba-edcb-42b4-87c3-a38da39648c0 tempest-VolumesMetadataTest-345175428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2e9e703-c0f0-4baf-8638-b600a251f8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:47:16.870633 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-c81a6bba-edcb-42b4-87c3-a38da39648c0 tempest-VolumesMetadataTest-345175428 None] Volume volume-2153d74a-269e-4b7c-a1e8-d4d20da7ff13 (2153d74a-269e-4b7c-a1e8-d4d20da7ff13): created successfully Dec 25 21:47:16.872515 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-c81a6bba-edcb-42b4-87c3-a38da39648c0 tempest-VolumesMetadataTest-345175428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2e9e703-c0f0-4baf-8638-b600a251f8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:47:16.875509 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-c81a6bba-edcb-42b4-87c3-a38da39648c0 tempest-VolumesMetadataTest-345175428 None] Flow 'volume_create_manager' (160cf3f2-924f-4fd8-b9f0-c98df202f9b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:47:16.961929 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-c81a6bba-edcb-42b4-87c3-a38da39648c0 tempest-VolumesMetadataTest-345175428 None] Created volume successfully. Dec 25 21:47:18.325767 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-4ee52a0f-c58a-47ed-8575-16d94069bf25 tempest-VolumesMetadataTest-345175428 None] Lock "b'cinder-2153d74a-269e-4b7c-a1e8-d4d20da7ff13-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:47:18.460198 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-4ee52a0f-c58a-47ed-8575-16d94069bf25 tempest-VolumesMetadataTest-345175428 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:47:18.607171 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-4ee52a0f-c58a-47ed-8575-16d94069bf25 tempest-VolumesMetadataTest-345175428 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:47:18.608465 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-4ee52a0f-c58a-47ed-8575-16d94069bf25 tempest-VolumesMetadataTest-345175428 None] Volume volume-2153d74a-269e-4b7c-a1e8-d4d20da7ff13 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:47:18.695022 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-4ee52a0f-c58a-47ed-8575-16d94069bf25 tempest-VolumesMetadataTest-345175428 None] deleting rbd volume volume-2153d74a-269e-4b7c-a1e8-d4d20da7ff13 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:47:21.665225 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-4ee52a0f-c58a-47ed-8575-16d94069bf25 tempest-VolumesMetadataTest-345175428 None] Created reservations ['c95bb3c3-d86a-4dbc-80a4-5c8cc9a5aede', 'e51e39c4-6668-4828-bdb0-a45a87e1dc1f', '7fefab1c-19b7-45a7-9743-caabc5e1fd2a', '94dfde1d-f798-4164-9e17-520512c8b45f'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:47:21.819840 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-4ee52a0f-c58a-47ed-8575-16d94069bf25 tempest-VolumesMetadataTest-345175428 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:47:21.842580 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-4ee52a0f-c58a-47ed-8575-16d94069bf25 tempest-VolumesMetadataTest-345175428 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:47:21.865755 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-4ee52a0f-c58a-47ed-8575-16d94069bf25 tempest-VolumesMetadataTest-345175428 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:47:21.869937 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-4ee52a0f-c58a-47ed-8575-16d94069bf25 tempest-VolumesMetadataTest-345175428 None] Deleted volume successfully. Dec 25 21:47:21.945184 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-4ee52a0f-c58a-47ed-8575-16d94069bf25 tempest-VolumesMetadataTest-345175428 None] Lock "b'cinder-2153d74a-269e-4b7c-a1e8-d4d20da7ff13-delete_volume'" released by "delete_volume" :: held 3.619s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:47:26.735141 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c7ebf5d-cc6c-438b-a374-b5e22d32f288 tempest-VolumesTransfersV355Test-546791116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:47:26.738504 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-0c7ebf5d-cc6c-438b-a374-b5e22d32f288 tempest-VolumesTransfersV355Test-546791116 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:47:26.738950 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-0c7ebf5d-cc6c-438b-a374-b5e22d32f288 tempest-VolumesTransfersV355Test-546791116 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:47:26.752953 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0c7ebf5d-cc6c-438b-a374-b5e22d32f288 tempest-VolumesTransfersV355Test-546791116 None] Flow 'volume_create_manager' (034edaec-8d0a-4935-a031-6a759c6b49d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:47:26.756055 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0c7ebf5d-cc6c-438b-a374-b5e22d32f288 tempest-VolumesTransfersV355Test-546791116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (090c5e0b-0049-4f25-befa-fdc1957545ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:47:26.762129 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-0c7ebf5d-cc6c-438b-a374-b5e22d32f288 tempest-VolumesTransfersV355Test-546791116 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:47:26.774283 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0c7ebf5d-cc6c-438b-a374-b5e22d32f288 tempest-VolumesTransfersV355Test-546791116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (090c5e0b-0049-4f25-befa-fdc1957545ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:47:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-587229693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f72f2c85-7230-47c5-adfa-c4048a88c0de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8892d086e634f9699010eceffbb59d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:47:27Z,use_quota=True,user_id='74053d7091ef41a1ad314ee0da374068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:47:26.776839 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0c7ebf5d-cc6c-438b-a374-b5e22d32f288 tempest-VolumesTransfersV355Test-546791116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c09c9c90-6584-4931-9135-dccdd54bd9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:47:26.779511 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0c7ebf5d-cc6c-438b-a374-b5e22d32f288 tempest-VolumesTransfersV355Test-546791116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c09c9c90-6584-4931-9135-dccdd54bd9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:47:26.781941 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0c7ebf5d-cc6c-438b-a374-b5e22d32f288 tempest-VolumesTransfersV355Test-546791116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e57a557-8843-423c-a048-ceac2dbdb0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:47:26.784163 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0c7ebf5d-cc6c-438b-a374-b5e22d32f288 tempest-VolumesTransfersV355Test-546791116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e57a557-8843-423c-a048-ceac2dbdb0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f72f2c85-7230-47c5-adfa-c4048a88c0de', 'volume_name': 'volume-f72f2c85-7230-47c5-adfa-c4048a88c0de', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:47:26.786476 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0c7ebf5d-cc6c-438b-a374-b5e22d32f288 tempest-VolumesTransfersV355Test-546791116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31196584-cebb-4e8a-ad58-250a23e609b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:47:26.788589 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0c7ebf5d-cc6c-438b-a374-b5e22d32f288 tempest-VolumesTransfersV355Test-546791116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31196584-cebb-4e8a-ad58-250a23e609b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:47:26.790861 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0c7ebf5d-cc6c-438b-a374-b5e22d32f288 tempest-VolumesTransfersV355Test-546791116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc6503ae-0785-4b95-b0c6-9b00d629688e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:47:26.791651 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-0c7ebf5d-cc6c-438b-a374-b5e22d32f288 tempest-VolumesTransfersV355Test-546791116 None] Volume f72f2c85-7230-47c5-adfa-c4048a88c0de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f72f2c85-7230-47c5-adfa-c4048a88c0de', 'volume_size': 1} Dec 25 21:47:26.792042 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0c7ebf5d-cc6c-438b-a374-b5e22d32f288 tempest-VolumesTransfersV355Test-546791116 None] creating volume 'volume-f72f2c85-7230-47c5-adfa-c4048a88c0de' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:47:26.793022 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0c7ebf5d-cc6c-438b-a374-b5e22d32f288 tempest-VolumesTransfersV355Test-546791116 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:47:27.319067 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0c7ebf5d-cc6c-438b-a374-b5e22d32f288 tempest-VolumesTransfersV355Test-546791116 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:47:27.319446 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-0c7ebf5d-cc6c-438b-a374-b5e22d32f288 tempest-VolumesTransfersV355Test-546791116 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:47:27.321467 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0c7ebf5d-cc6c-438b-a374-b5e22d32f288 tempest-VolumesTransfersV355Test-546791116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc6503ae-0785-4b95-b0c6-9b00d629688e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f72f2c85-7230-47c5-adfa-c4048a88c0de', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:47:27.323628 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0c7ebf5d-cc6c-438b-a374-b5e22d32f288 tempest-VolumesTransfersV355Test-546791116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b49ae233-9440-416d-92ea-10e3c9440a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:47:27.407895 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-0c7ebf5d-cc6c-438b-a374-b5e22d32f288 tempest-VolumesTransfersV355Test-546791116 None] Volume volume-f72f2c85-7230-47c5-adfa-c4048a88c0de (f72f2c85-7230-47c5-adfa-c4048a88c0de): created successfully Dec 25 21:47:27.409861 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0c7ebf5d-cc6c-438b-a374-b5e22d32f288 tempest-VolumesTransfersV355Test-546791116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b49ae233-9440-416d-92ea-10e3c9440a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:47:27.412806 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-0c7ebf5d-cc6c-438b-a374-b5e22d32f288 tempest-VolumesTransfersV355Test-546791116 None] Flow 'volume_create_manager' (034edaec-8d0a-4935-a031-6a759c6b49d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:47:27.464885 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-0c7ebf5d-cc6c-438b-a374-b5e22d32f288 tempest-VolumesTransfersV355Test-546791116 None] Created volume successfully. Dec 25 21:47:28.484293 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-9a5e9055-1790-424a-be56-09ad095ffdd3 tempest-VolumesTransfersV355Test-2009654655 None] Transfer volume completed successfully. Dec 25 21:47:29.274202 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-74dd71a9-8219-4b72-82a6-d3158be82d4b tempest-VolumesTransfersV355Test-24177827 None] Lock "b'cinder-f72f2c85-7230-47c5-adfa-c4048a88c0de-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:47:29.354907 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-74dd71a9-8219-4b72-82a6-d3158be82d4b tempest-VolumesTransfersV355Test-24177827 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:47:29.498936 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-74dd71a9-8219-4b72-82a6-d3158be82d4b tempest-VolumesTransfersV355Test-24177827 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:47:29.499574 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-74dd71a9-8219-4b72-82a6-d3158be82d4b tempest-VolumesTransfersV355Test-24177827 None] Volume volume-f72f2c85-7230-47c5-adfa-c4048a88c0de is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:47:29.578840 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-74dd71a9-8219-4b72-82a6-d3158be82d4b tempest-VolumesTransfersV355Test-24177827 None] deleting rbd volume volume-f72f2c85-7230-47c5-adfa-c4048a88c0de {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:47:32.465246 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:47:32.469002 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:47:32.504343 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:47:32.541389 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:47:32.882381 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-74dd71a9-8219-4b72-82a6-d3158be82d4b tempest-VolumesTransfersV355Test-24177827 None] Created reservations ['a3de7b89-8f17-4328-82e0-9da8f412a4df', '9ee1ff78-391e-4ef1-a8ab-040cc5b0a731', '039c99b8-3313-4ccd-831a-b1c01d9f3be2', '50103414-5d25-4a2b-bc40-bd064c0cb92a'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:47:33.025449 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-74dd71a9-8219-4b72-82a6-d3158be82d4b tempest-VolumesTransfersV355Test-24177827 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:47:33.047445 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-74dd71a9-8219-4b72-82a6-d3158be82d4b tempest-VolumesTransfersV355Test-24177827 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:47:33.070910 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-74dd71a9-8219-4b72-82a6-d3158be82d4b tempest-VolumesTransfersV355Test-24177827 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:47:33.075781 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-74dd71a9-8219-4b72-82a6-d3158be82d4b tempest-VolumesTransfersV355Test-24177827 None] Deleted volume successfully. Dec 25 21:47:33.137927 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-74dd71a9-8219-4b72-82a6-d3158be82d4b tempest-VolumesTransfersV355Test-24177827 None] Lock "b'cinder-f72f2c85-7230-47c5-adfa-c4048a88c0de-delete_volume'" released by "delete_volume" :: held 3.864s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:47:34.181083 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb30a97c-b3fc-47b9-900f-5a3c7d85ead8 tempest-VolumesTransfersV355Test-546791116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 21:47:34.184401 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-cb30a97c-b3fc-47b9-900f-5a3c7d85ead8 tempest-VolumesTransfersV355Test-546791116 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 21:47:34.185623 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-cb30a97c-b3fc-47b9-900f-5a3c7d85ead8 tempest-VolumesTransfersV355Test-546791116 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 21:47:34.199852 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-cb30a97c-b3fc-47b9-900f-5a3c7d85ead8 tempest-VolumesTransfersV355Test-546791116 None] Flow 'volume_create_manager' (7df892ff-5991-447a-b2d4-b52b5daa763f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:47:34.203675 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-cb30a97c-b3fc-47b9-900f-5a3c7d85ead8 tempest-VolumesTransfersV355Test-546791116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d4c9090-7914-4259-a205-764b1427361e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:47:34.209822 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-cb30a97c-b3fc-47b9-900f-5a3c7d85ead8 tempest-VolumesTransfersV355Test-546791116 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:47:34.230423 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-cb30a97c-b3fc-47b9-900f-5a3c7d85ead8 tempest-VolumesTransfersV355Test-546791116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d4c9090-7914-4259-a205-764b1427361e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T21:47:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1847721004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e5d7d935-6e46-4d2a-808e-49999862d3a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8892d086e634f9699010eceffbb59d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T21:47:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T21:47:34Z,use_quota=True,user_id='74053d7091ef41a1ad314ee0da374068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:47:34.230642 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-cb30a97c-b3fc-47b9-900f-5a3c7d85ead8 tempest-VolumesTransfersV355Test-546791116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90687649-9ac2-4d63-9844-a2a7310cb21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:47:34.230642 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-cb30a97c-b3fc-47b9-900f-5a3c7d85ead8 tempest-VolumesTransfersV355Test-546791116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90687649-9ac2-4d63-9844-a2a7310cb21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:47:34.230642 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-cb30a97c-b3fc-47b9-900f-5a3c7d85ead8 tempest-VolumesTransfersV355Test-546791116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8117f816-ff62-486e-a3e8-64c82f4fc693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:47:34.231777 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-cb30a97c-b3fc-47b9-900f-5a3c7d85ead8 tempest-VolumesTransfersV355Test-546791116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8117f816-ff62-486e-a3e8-64c82f4fc693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5d7d935-6e46-4d2a-808e-49999862d3a6', 'volume_name': 'volume-e5d7d935-6e46-4d2a-808e-49999862d3a6', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:47:34.234101 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-cb30a97c-b3fc-47b9-900f-5a3c7d85ead8 tempest-VolumesTransfersV355Test-546791116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d24a690-8ace-480e-bd0d-88b59122ba98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:47:34.236282 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-cb30a97c-b3fc-47b9-900f-5a3c7d85ead8 tempest-VolumesTransfersV355Test-546791116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d24a690-8ace-480e-bd0d-88b59122ba98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:47:34.238493 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-cb30a97c-b3fc-47b9-900f-5a3c7d85ead8 tempest-VolumesTransfersV355Test-546791116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f5c7e5a-379d-4d50-823e-b6da135a7bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:47:34.239291 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-cb30a97c-b3fc-47b9-900f-5a3c7d85ead8 tempest-VolumesTransfersV355Test-546791116 None] Volume e5d7d935-6e46-4d2a-808e-49999862d3a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5d7d935-6e46-4d2a-808e-49999862d3a6', 'volume_size': 1} Dec 25 21:47:34.239685 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-cb30a97c-b3fc-47b9-900f-5a3c7d85ead8 tempest-VolumesTransfersV355Test-546791116 None] creating volume 'volume-e5d7d935-6e46-4d2a-808e-49999862d3a6' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 21:47:34.240725 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-cb30a97c-b3fc-47b9-900f-5a3c7d85ead8 tempest-VolumesTransfersV355Test-546791116 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:47:34.884437 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-cb30a97c-b3fc-47b9-900f-5a3c7d85ead8 tempest-VolumesTransfersV355Test-546791116 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 21:47:34.884812 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-cb30a97c-b3fc-47b9-900f-5a3c7d85ead8 tempest-VolumesTransfersV355Test-546791116 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 21:47:34.887051 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-cb30a97c-b3fc-47b9-900f-5a3c7d85ead8 tempest-VolumesTransfersV355Test-546791116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f5c7e5a-379d-4d50-823e-b6da135a7bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5d7d935-6e46-4d2a-808e-49999862d3a6', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:47:34.889246 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-cb30a97c-b3fc-47b9-900f-5a3c7d85ead8 tempest-VolumesTransfersV355Test-546791116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec8b9d3d-e24c-4311-b833-591d089955f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 21:47:34.955204 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-cb30a97c-b3fc-47b9-900f-5a3c7d85ead8 tempest-VolumesTransfersV355Test-546791116 None] Volume volume-e5d7d935-6e46-4d2a-808e-49999862d3a6 (e5d7d935-6e46-4d2a-808e-49999862d3a6): created successfully Dec 25 21:47:34.957222 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-cb30a97c-b3fc-47b9-900f-5a3c7d85ead8 tempest-VolumesTransfersV355Test-546791116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec8b9d3d-e24c-4311-b833-591d089955f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 21:47:34.960174 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-cb30a97c-b3fc-47b9-900f-5a3c7d85ead8 tempest-VolumesTransfersV355Test-546791116 None] Flow 'volume_create_manager' (7df892ff-5991-447a-b2d4-b52b5daa763f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 21:47:35.030013 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-cb30a97c-b3fc-47b9-900f-5a3c7d85ead8 tempest-VolumesTransfersV355Test-546791116 None] Created volume successfully. Dec 25 21:47:35.647563 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-75af61d1-cf3d-4b43-876f-315f27920c14 tempest-VolumesTransfersV355Test-24177827 None] Lock "b'cinder-e5d7d935-6e46-4d2a-808e-49999862d3a6-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 21:47:35.744333 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-75af61d1-cf3d-4b43-876f-315f27920c14 tempest-VolumesTransfersV355Test-24177827 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:47:35.932984 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-75af61d1-cf3d-4b43-876f-315f27920c14 tempest-VolumesTransfersV355Test-24177827 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 21:47:35.934848 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-75af61d1-cf3d-4b43-876f-315f27920c14 tempest-VolumesTransfersV355Test-24177827 None] Volume volume-e5d7d935-6e46-4d2a-808e-49999862d3a6 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 21:47:36.002503 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-75af61d1-cf3d-4b43-876f-315f27920c14 tempest-VolumesTransfersV355Test-24177827 None] deleting rbd volume volume-e5d7d935-6e46-4d2a-808e-49999862d3a6 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 21:47:39.259947 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-75af61d1-cf3d-4b43-876f-315f27920c14 tempest-VolumesTransfersV355Test-24177827 None] Created reservations ['d2cbca3b-ee9b-4d38-9582-6b7a8fed5aed', '7844a10a-e8f3-4ea9-a18f-6a95e78838e7', 'df546a68-d450-4470-8903-5a1eb07b77d9', '4f5ca507-33b6-40e8-b1c2-587c467b5c7f'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 21:47:39.415465 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-75af61d1-cf3d-4b43-876f-315f27920c14 tempest-VolumesTransfersV355Test-24177827 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:47:39.475361 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-75af61d1-cf3d-4b43-876f-315f27920c14 tempest-VolumesTransfersV355Test-24177827 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:47:39.537886 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-75af61d1-cf3d-4b43-876f-315f27920c14 tempest-VolumesTransfersV355Test-24177827 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:47:39.549640 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-75af61d1-cf3d-4b43-876f-315f27920c14 tempest-VolumesTransfersV355Test-24177827 None] Deleted volume successfully. Dec 25 21:47:39.624579 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-75af61d1-cf3d-4b43-876f-315f27920c14 tempest-VolumesTransfersV355Test-24177827 None] Lock "b'cinder-e5d7d935-6e46-4d2a-808e-49999862d3a6-delete_volume'" released by "delete_volume" :: held 3.976s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 21:48:32.467858 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:48:32.468563 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:48:32.490231 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:48:32.513119 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:49:32.468580 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:49:32.469827 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:49:32.495954 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:49:32.518001 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:50:32.472270 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:50:32.472954 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:50:32.493423 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:50:32.515637 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:51:32.470620 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:51:32.471286 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:51:32.493331 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:51:32.515186 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:52:32.469820 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:52:32.470495 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:52:32.495411 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:52:32.580738 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:53:32.465421 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:53:32.466111 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:53:32.487987 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:53:32.511840 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:54:32.466886 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:54:32.468055 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:54:32.489188 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:54:32.511035 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:55:32.466363 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:55:32.467109 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:55:32.488161 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:55:32.510000 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:56:32.465833 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:56:32.466512 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:56:32.526945 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:56:32.550069 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:57:32.465357 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:57:32.466041 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:57:32.486884 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:57:32.509229 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:58:32.464408 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:58:32.465126 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:58:32.485956 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:58:32.509218 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 21:59:32.464153 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 21:59:32.464952 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:59:32.486021 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 21:59:32.511667 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 22:00:32.464083 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 22:00:32.464866 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:00:32.487728 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:00:32.514100 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 22:01:32.468951 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 22:01:32.469601 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:01:32.491174 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:01:32.512829 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 22:02:32.467548 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 22:02:32.468272 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:02:32.495375 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:02:32.524813 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 22:03:32.470882 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 22:03:32.471583 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:03:32.494071 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:03:32.515892 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 22:04:12.370837 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6e0465e-7501-4d43-a058-d5b2a6132d90 tempest-ServerActionsTestJSON-124567319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 22:04:12.374047 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-f6e0465e-7501-4d43-a058-d5b2a6132d90 tempest-ServerActionsTestJSON-124567319 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 22:04:12.374498 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-f6e0465e-7501-4d43-a058-d5b2a6132d90 tempest-ServerActionsTestJSON-124567319 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 22:04:12.386795 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f6e0465e-7501-4d43-a058-d5b2a6132d90 tempest-ServerActionsTestJSON-124567319 None] Flow 'volume_create_manager' (f7519c72-8e36-4d66-a40e-c8667a57a17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 22:04:12.389912 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f6e0465e-7501-4d43-a058-d5b2a6132d90 tempest-ServerActionsTestJSON-124567319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e702604-4a65-4bfb-960f-1bedf4317992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 22:04:12.398419 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-f6e0465e-7501-4d43-a058-d5b2a6132d90 tempest-ServerActionsTestJSON-124567319 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 22:04:12.410470 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f6e0465e-7501-4d43-a058-d5b2a6132d90 tempest-ServerActionsTestJSON-124567319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e702604-4a65-4bfb-960f-1bedf4317992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T22:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1032767035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=790def48-8e2e-49ed-a6c3-8d0acad43e91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e594b8d48e948b8ae34d96bebfc2a36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T22:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T22:04:12Z,use_quota=True,user_id='119465233440460aba79a1ff63865c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 22:04:12.413077 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f6e0465e-7501-4d43-a058-d5b2a6132d90 tempest-ServerActionsTestJSON-124567319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29a18500-ac9e-4153-8c32-b1df632207a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 22:04:12.415223 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f6e0465e-7501-4d43-a058-d5b2a6132d90 tempest-ServerActionsTestJSON-124567319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29a18500-ac9e-4153-8c32-b1df632207a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 22:04:12.417671 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f6e0465e-7501-4d43-a058-d5b2a6132d90 tempest-ServerActionsTestJSON-124567319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29395419-91c5-414e-a8f3-8c997e75ee45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 22:04:12.419920 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f6e0465e-7501-4d43-a058-d5b2a6132d90 tempest-ServerActionsTestJSON-124567319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29395419-91c5-414e-a8f3-8c997e75ee45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '790def48-8e2e-49ed-a6c3-8d0acad43e91', 'volume_name': 'volume-790def48-8e2e-49ed-a6c3-8d0acad43e91', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 22:04:12.422262 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f6e0465e-7501-4d43-a058-d5b2a6132d90 tempest-ServerActionsTestJSON-124567319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf7ce65e-76a4-41c6-8ea9-cae57b2b4a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 22:04:12.424378 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f6e0465e-7501-4d43-a058-d5b2a6132d90 tempest-ServerActionsTestJSON-124567319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf7ce65e-76a4-41c6-8ea9-cae57b2b4a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 22:04:12.426606 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f6e0465e-7501-4d43-a058-d5b2a6132d90 tempest-ServerActionsTestJSON-124567319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1184326a-da83-40ec-8392-f0d2e2536d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 22:04:12.427408 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-f6e0465e-7501-4d43-a058-d5b2a6132d90 tempest-ServerActionsTestJSON-124567319 None] Volume 790def48-8e2e-49ed-a6c3-8d0acad43e91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-790def48-8e2e-49ed-a6c3-8d0acad43e91', 'volume_size': 1} Dec 25 22:04:12.427801 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f6e0465e-7501-4d43-a058-d5b2a6132d90 tempest-ServerActionsTestJSON-124567319 None] creating volume 'volume-790def48-8e2e-49ed-a6c3-8d0acad43e91' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 22:04:12.428787 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f6e0465e-7501-4d43-a058-d5b2a6132d90 tempest-ServerActionsTestJSON-124567319 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:04:12.881439 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f6e0465e-7501-4d43-a058-d5b2a6132d90 tempest-ServerActionsTestJSON-124567319 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 22:04:12.881813 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-f6e0465e-7501-4d43-a058-d5b2a6132d90 tempest-ServerActionsTestJSON-124567319 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 22:04:12.884342 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f6e0465e-7501-4d43-a058-d5b2a6132d90 tempest-ServerActionsTestJSON-124567319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1184326a-da83-40ec-8392-f0d2e2536d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-790def48-8e2e-49ed-a6c3-8d0acad43e91', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 22:04:12.886539 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f6e0465e-7501-4d43-a058-d5b2a6132d90 tempest-ServerActionsTestJSON-124567319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7532c94f-24b6-49f9-9851-654b504d4739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 22:04:12.957806 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-f6e0465e-7501-4d43-a058-d5b2a6132d90 tempest-ServerActionsTestJSON-124567319 None] Volume volume-790def48-8e2e-49ed-a6c3-8d0acad43e91 (790def48-8e2e-49ed-a6c3-8d0acad43e91): created successfully Dec 25 22:04:12.960036 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f6e0465e-7501-4d43-a058-d5b2a6132d90 tempest-ServerActionsTestJSON-124567319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7532c94f-24b6-49f9-9851-654b504d4739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 22:04:12.963085 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-f6e0465e-7501-4d43-a058-d5b2a6132d90 tempest-ServerActionsTestJSON-124567319 None] Flow 'volume_create_manager' (f7519c72-8e36-4d66-a40e-c8667a57a17c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 22:04:13.060589 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-f6e0465e-7501-4d43-a058-d5b2a6132d90 tempest-ServerActionsTestJSON-124567319 None] Created volume successfully. Dec 25 22:04:14.321820 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-31d3d16d-2280-4018-8419-b2361a47bb92 req-61c67cb8-9fee-41f6-b20f-ff0d0535117d tempest-ServerActionsTestJSON-124567319 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 22:04:14.947491 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-31d3d16d-2280-4018-8419-b2361a47bb92 req-61c67cb8-9fee-41f6-b20f-ff0d0535117d tempest-ServerActionsTestJSON-124567319 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.625s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 22:04:14.948401 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-31d3d16d-2280-4018-8419-b2361a47bb92 req-61c67cb8-9fee-41f6-b20f-ff0d0535117d tempest-ServerActionsTestJSON-124567319 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-790def48-8e2e-49ed-a6c3-8d0acad43e91', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': '790def48-8e2e-49ed-a6c3-8d0acad43e91', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 22:04:15.066482 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-31d3d16d-2280-4018-8419-b2361a47bb92 req-61c67cb8-9fee-41f6-b20f-ff0d0535117d tempest-ServerActionsTestJSON-124567319 None] Connection info returned from driver {'name': 'volumes/volume-790def48-8e2e-49ed-a6c3-8d0acad43e91', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '790def48-8e2e-49ed-a6c3-8d0acad43e91', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '45df6437-bd96-45ca-b029-7d73bd58b979'} {{(pid=129926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 25 22:04:15.184786 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-31d3d16d-2280-4018-8419-b2361a47bb92 req-61c67cb8-9fee-41f6-b20f-ff0d0535117d tempest-ServerActionsTestJSON-124567319 None] attachment_update completed successfully. Dec 25 22:04:32.470909 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 22:04:32.471885 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:04:32.496493 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:04:32.518588 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 22:04:33.002480 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-5e2bc979-abe8-4038-88b6-4c5405f14ca9 req-2e29185e-ae6d-449c-9431-a61d17a7f8c1 tempest-ServerActionsTestJSON-124567319 None] Terminate volume connection completed successfully. Dec 25 22:04:33.002889 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-5e2bc979-abe8-4038-88b6-4c5405f14ca9 req-2e29185e-ae6d-449c-9431-a61d17a7f8c1 tempest-ServerActionsTestJSON-124567319 None] Deleting attachment 45df6437-bd96-45ca-b029-7d73bd58b979. {{(pid=129926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 25 22:04:34.507500 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-5e2bc979-abe8-4038-88b6-4c5405f14ca9 req-ee242788-c061-4f9f-99e2-3e572800c55e tempest-ServerActionsTestJSON-124567319 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 22:04:35.137939 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-5e2bc979-abe8-4038-88b6-4c5405f14ca9 req-ee242788-c061-4f9f-99e2-3e572800c55e tempest-ServerActionsTestJSON-124567319 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.630s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 22:04:35.138779 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-5e2bc979-abe8-4038-88b6-4c5405f14ca9 req-ee242788-c061-4f9f-99e2-3e572800c55e tempest-ServerActionsTestJSON-124567319 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-790def48-8e2e-49ed-a6c3-8d0acad43e91', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': '790def48-8e2e-49ed-a6c3-8d0acad43e91', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 22:04:35.226230 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-5e2bc979-abe8-4038-88b6-4c5405f14ca9 req-ee242788-c061-4f9f-99e2-3e572800c55e tempest-ServerActionsTestJSON-124567319 None] Connection info returned from driver {'name': 'volumes/volume-790def48-8e2e-49ed-a6c3-8d0acad43e91', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '790def48-8e2e-49ed-a6c3-8d0acad43e91', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f6267227-3847-4b4d-9385-3dae60cd2f40'} {{(pid=129926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 25 22:04:35.342433 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-5e2bc979-abe8-4038-88b6-4c5405f14ca9 req-ee242788-c061-4f9f-99e2-3e572800c55e tempest-ServerActionsTestJSON-124567319 None] attachment_update completed successfully. Dec 25 22:04:42.842266 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-80958bc7-5d34-45e9-bd12-30e5e87b5c7b req-0769952f-534a-433a-831e-9867cd83feae tempest-ServerActionsTestJSON-124567319 None] Terminate volume connection completed successfully. Dec 25 22:04:42.842885 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-80958bc7-5d34-45e9-bd12-30e5e87b5c7b req-0769952f-534a-433a-831e-9867cd83feae tempest-ServerActionsTestJSON-124567319 None] Deleting attachment f6267227-3847-4b4d-9385-3dae60cd2f40. {{(pid=129926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 25 22:04:45.052898 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-80958bc7-5d34-45e9-bd12-30e5e87b5c7b req-776c2a70-26f0-437f-a6db-4db6ae60663d tempest-ServerActionsTestJSON-124567319 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 22:04:45.676203 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-80958bc7-5d34-45e9-bd12-30e5e87b5c7b req-776c2a70-26f0-437f-a6db-4db6ae60663d tempest-ServerActionsTestJSON-124567319 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.623s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 22:04:45.677028 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-80958bc7-5d34-45e9-bd12-30e5e87b5c7b req-776c2a70-26f0-437f-a6db-4db6ae60663d tempest-ServerActionsTestJSON-124567319 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-790def48-8e2e-49ed-a6c3-8d0acad43e91', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': '790def48-8e2e-49ed-a6c3-8d0acad43e91', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 22:04:45.788275 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-80958bc7-5d34-45e9-bd12-30e5e87b5c7b req-776c2a70-26f0-437f-a6db-4db6ae60663d tempest-ServerActionsTestJSON-124567319 None] Connection info returned from driver {'name': 'volumes/volume-790def48-8e2e-49ed-a6c3-8d0acad43e91', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '790def48-8e2e-49ed-a6c3-8d0acad43e91', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '4e62ee45-aad0-4e0c-b176-8f85d01d8c6f'} {{(pid=129926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 25 22:04:45.884349 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-80958bc7-5d34-45e9-bd12-30e5e87b5c7b req-776c2a70-26f0-437f-a6db-4db6ae60663d tempest-ServerActionsTestJSON-124567319 None] attachment_update completed successfully. Dec 25 22:04:53.146803 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-10f0e54b-b656-4436-863f-43a17ad3c2e4 req-ffd11ab6-cf19-41ab-9376-b2f00d8afc59 tempest-ServerActionsTestJSON-124567319 None] Terminate volume connection completed successfully. Dec 25 22:04:53.149612 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-10f0e54b-b656-4436-863f-43a17ad3c2e4 req-ffd11ab6-cf19-41ab-9376-b2f00d8afc59 tempest-ServerActionsTestJSON-124567319 None] Deleting attachment 4e62ee45-aad0-4e0c-b176-8f85d01d8c6f. {{(pid=129926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 25 22:04:55.405518 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-eba0f37c-b587-4d6f-82ff-f6c0d82ca1d7 tempest-ServerActionsTestJSON-124567319 None] Lock "b'cinder-790def48-8e2e-49ed-a6c3-8d0acad43e91-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 22:04:55.523285 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-eba0f37c-b587-4d6f-82ff-f6c0d82ca1d7 tempest-ServerActionsTestJSON-124567319 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:04:55.648382 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-eba0f37c-b587-4d6f-82ff-f6c0d82ca1d7 tempest-ServerActionsTestJSON-124567319 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 22:04:55.648764 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-eba0f37c-b587-4d6f-82ff-f6c0d82ca1d7 tempest-ServerActionsTestJSON-124567319 None] Volume volume-790def48-8e2e-49ed-a6c3-8d0acad43e91 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 22:04:55.765476 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-eba0f37c-b587-4d6f-82ff-f6c0d82ca1d7 tempest-ServerActionsTestJSON-124567319 None] deleting rbd volume volume-790def48-8e2e-49ed-a6c3-8d0acad43e91 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 22:04:58.962853 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-eba0f37c-b587-4d6f-82ff-f6c0d82ca1d7 tempest-ServerActionsTestJSON-124567319 None] Created reservations ['28c2beb8-368a-40bb-b96e-fabf82dfec62', '0ea0dcfe-ca44-4d1d-9637-3f8b84e94c37', 'a3c0fbbd-e6af-4782-944b-19d5f12d08b9', 'ff2c0f24-ac70-467b-8dc9-0b6f11d465ab'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 22:04:59.128750 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-eba0f37c-b587-4d6f-82ff-f6c0d82ca1d7 tempest-ServerActionsTestJSON-124567319 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:04:59.151166 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-eba0f37c-b587-4d6f-82ff-f6c0d82ca1d7 tempest-ServerActionsTestJSON-124567319 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:04:59.173050 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-eba0f37c-b587-4d6f-82ff-f6c0d82ca1d7 tempest-ServerActionsTestJSON-124567319 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 22:04:59.177358 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-eba0f37c-b587-4d6f-82ff-f6c0d82ca1d7 tempest-ServerActionsTestJSON-124567319 None] Deleted volume successfully. Dec 25 22:04:59.237598 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-eba0f37c-b587-4d6f-82ff-f6c0d82ca1d7 tempest-ServerActionsTestJSON-124567319 None] Lock "b'cinder-790def48-8e2e-49ed-a6c3-8d0acad43e91-delete_volume'" released by "delete_volume" :: held 3.832s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 22:05:32.473861 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 22:05:32.474557 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:05:32.497083 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:05:32.518401 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 22:06:32.473563 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 22:06:32.476398 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:06:32.552044 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:06:32.616758 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 22:07:06.099040 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f10bdeb-9a99-446e-a8ca-02c693f3c605 tempest-TestMinimumBasicScenario-655218334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 22:07:06.102883 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-6f10bdeb-9a99-446e-a8ca-02c693f3c605 tempest-TestMinimumBasicScenario-655218334 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 22:07:06.103367 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-6f10bdeb-9a99-446e-a8ca-02c693f3c605 tempest-TestMinimumBasicScenario-655218334 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 22:07:06.116663 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6f10bdeb-9a99-446e-a8ca-02c693f3c605 tempest-TestMinimumBasicScenario-655218334 None] Flow 'volume_create_manager' (2ec0a70f-6557-4f8c-9e71-36a299d70ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 22:07:06.119884 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6f10bdeb-9a99-446e-a8ca-02c693f3c605 tempest-TestMinimumBasicScenario-655218334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ceea3ba-2f67-4a07-88dc-9c45bdb3b71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 22:07:06.125727 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-6f10bdeb-9a99-446e-a8ca-02c693f3c605 tempest-TestMinimumBasicScenario-655218334 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 22:07:06.138335 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6f10bdeb-9a99-446e-a8ca-02c693f3c605 tempest-TestMinimumBasicScenario-655218334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ceea3ba-2f67-4a07-88dc-9c45bdb3b71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T22:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-377150897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f0773704-6d3d-4e7e-b90d-d5f66c21bc65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29cc4c1ab18949cf9fcd5658c1535162',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T22:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T22:07:06Z,use_quota=True,user_id='102a4e79336a4125ab08f043bfb262c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 22:07:06.140813 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6f10bdeb-9a99-446e-a8ca-02c693f3c605 tempest-TestMinimumBasicScenario-655218334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (484455c5-f26f-4c72-845a-215ad3228d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 22:07:06.142949 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6f10bdeb-9a99-446e-a8ca-02c693f3c605 tempest-TestMinimumBasicScenario-655218334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (484455c5-f26f-4c72-845a-215ad3228d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 22:07:06.145459 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6f10bdeb-9a99-446e-a8ca-02c693f3c605 tempest-TestMinimumBasicScenario-655218334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e87d367e-5aee-4373-9c75-2ef23e9ea50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 22:07:06.147689 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6f10bdeb-9a99-446e-a8ca-02c693f3c605 tempest-TestMinimumBasicScenario-655218334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e87d367e-5aee-4373-9c75-2ef23e9ea50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0773704-6d3d-4e7e-b90d-d5f66c21bc65', 'volume_name': 'volume-f0773704-6d3d-4e7e-b90d-d5f66c21bc65', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 22:07:06.149972 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6f10bdeb-9a99-446e-a8ca-02c693f3c605 tempest-TestMinimumBasicScenario-655218334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17a78fa8-f1a2-405a-a9e7-e67d4897bf90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 22:07:06.152041 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6f10bdeb-9a99-446e-a8ca-02c693f3c605 tempest-TestMinimumBasicScenario-655218334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17a78fa8-f1a2-405a-a9e7-e67d4897bf90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 22:07:06.154239 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6f10bdeb-9a99-446e-a8ca-02c693f3c605 tempest-TestMinimumBasicScenario-655218334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (112ead24-af44-473d-8070-9d95424f722d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 22:07:06.155021 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-6f10bdeb-9a99-446e-a8ca-02c693f3c605 tempest-TestMinimumBasicScenario-655218334 None] Volume f0773704-6d3d-4e7e-b90d-d5f66c21bc65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0773704-6d3d-4e7e-b90d-d5f66c21bc65', 'volume_size': 1} Dec 25 22:07:06.155415 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-6f10bdeb-9a99-446e-a8ca-02c693f3c605 tempest-TestMinimumBasicScenario-655218334 None] creating volume 'volume-f0773704-6d3d-4e7e-b90d-d5f66c21bc65' {{(pid=129926) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Dec 25 22:07:06.156354 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-6f10bdeb-9a99-446e-a8ca-02c693f3c605 tempest-TestMinimumBasicScenario-655218334 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:07:06.597823 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-6f10bdeb-9a99-446e-a8ca-02c693f3c605 tempest-TestMinimumBasicScenario-655218334 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 22:07:06.598071 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-6f10bdeb-9a99-446e-a8ca-02c693f3c605 tempest-TestMinimumBasicScenario-655218334 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 22:07:06.600114 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6f10bdeb-9a99-446e-a8ca-02c693f3c605 tempest-TestMinimumBasicScenario-655218334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (112ead24-af44-473d-8070-9d95424f722d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0773704-6d3d-4e7e-b90d-d5f66c21bc65', 'volume_size': 1}' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 22:07:06.602570 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6f10bdeb-9a99-446e-a8ca-02c693f3c605 tempest-TestMinimumBasicScenario-655218334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6263125-00c9-4c91-a881-b443f637f24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 22:07:06.658109 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-6f10bdeb-9a99-446e-a8ca-02c693f3c605 tempest-TestMinimumBasicScenario-655218334 None] Volume volume-f0773704-6d3d-4e7e-b90d-d5f66c21bc65 (f0773704-6d3d-4e7e-b90d-d5f66c21bc65): created successfully Dec 25 22:07:06.660032 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6f10bdeb-9a99-446e-a8ca-02c693f3c605 tempest-TestMinimumBasicScenario-655218334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6263125-00c9-4c91-a881-b443f637f24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 22:07:06.662994 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-6f10bdeb-9a99-446e-a8ca-02c693f3c605 tempest-TestMinimumBasicScenario-655218334 None] Flow 'volume_create_manager' (2ec0a70f-6557-4f8c-9e71-36a299d70ae8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 22:07:06.714275 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-6f10bdeb-9a99-446e-a8ca-02c693f3c605 tempest-TestMinimumBasicScenario-655218334 None] Created volume successfully. Dec 25 22:07:08.021000 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-3e1cf7b9-8422-4207-9d5b-9ddd05020188 req-6034ce5c-8d8d-44d1-8f3f-6cc06de2ce8d tempest-TestMinimumBasicScenario-655218334 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 22:07:08.687260 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-3e1cf7b9-8422-4207-9d5b-9ddd05020188 req-6034ce5c-8d8d-44d1-8f3f-6cc06de2ce8d tempest-TestMinimumBasicScenario-655218334 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.666s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 22:07:08.688063 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-3e1cf7b9-8422-4207-9d5b-9ddd05020188 req-6034ce5c-8d8d-44d1-8f3f-6cc06de2ce8d tempest-TestMinimumBasicScenario-655218334 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f0773704-6d3d-4e7e-b90d-d5f66c21bc65', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': 'f0773704-6d3d-4e7e-b90d-d5f66c21bc65', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 22:07:08.772961 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-3e1cf7b9-8422-4207-9d5b-9ddd05020188 req-6034ce5c-8d8d-44d1-8f3f-6cc06de2ce8d tempest-TestMinimumBasicScenario-655218334 None] Connection info returned from driver {'name': 'volumes/volume-f0773704-6d3d-4e7e-b90d-d5f66c21bc65', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f0773704-6d3d-4e7e-b90d-d5f66c21bc65', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '5522366b-d6ea-49c9-bb65-80da2cc1338f'} {{(pid=129926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 25 22:07:08.867328 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-3e1cf7b9-8422-4207-9d5b-9ddd05020188 req-6034ce5c-8d8d-44d1-8f3f-6cc06de2ce8d tempest-TestMinimumBasicScenario-655218334 None] attachment_update completed successfully. Dec 25 22:07:32.473834 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 22:07:32.474820 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:07:32.498085 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:07:32.522419 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 22:08:30.574824 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-d5e1e38a-8b86-4262-ab0d-9bd329c5bc8e req-08eae208-3312-4026-8296-087a80cd2d50 tempest-TestMinimumBasicScenario-655218334 None] Terminate volume connection completed successfully. Dec 25 22:08:30.579440 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-d5e1e38a-8b86-4262-ab0d-9bd329c5bc8e req-08eae208-3312-4026-8296-087a80cd2d50 tempest-TestMinimumBasicScenario-655218334 None] Deleting attachment 5522366b-d6ea-49c9-bb65-80da2cc1338f. {{(pid=129926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 25 22:08:31.312255 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-1271f4bb-adb1-4565-ae40-00f7d7a42099 tempest-TestMinimumBasicScenario-655218334 None] Lock "b'cinder-f0773704-6d3d-4e7e-b90d-d5f66c21bc65-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 22:08:31.403444 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-1271f4bb-adb1-4565-ae40-00f7d7a42099 tempest-TestMinimumBasicScenario-655218334 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:08:31.523640 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-1271f4bb-adb1-4565-ae40-00f7d7a42099 tempest-TestMinimumBasicScenario-655218334 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 22:08:31.524099 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-1271f4bb-adb1-4565-ae40-00f7d7a42099 tempest-TestMinimumBasicScenario-655218334 None] Volume volume-f0773704-6d3d-4e7e-b90d-d5f66c21bc65 is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 22:08:31.610013 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-1271f4bb-adb1-4565-ae40-00f7d7a42099 tempest-TestMinimumBasicScenario-655218334 None] deleting rbd volume volume-f0773704-6d3d-4e7e-b90d-d5f66c21bc65 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 22:08:32.470049 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 22:08:32.470709 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:08:32.492382 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:08:32.513631 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 22:08:34.516718 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [None req-1271f4bb-adb1-4565-ae40-00f7d7a42099 tempest-TestMinimumBasicScenario-655218334 None] Created reservations ['a30fc666-9727-4bae-96ad-cb6830a247a7', 'adbf061f-f30c-4c78-a782-6f3990e96539', '86356a3b-c05b-416e-ae39-9489d7fbc0d5', '3f496b13-973e-4825-a556-c2f081651042'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 22:08:34.671302 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-1271f4bb-adb1-4565-ae40-00f7d7a42099 tempest-TestMinimumBasicScenario-655218334 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:08:34.693728 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-1271f4bb-adb1-4565-ae40-00f7d7a42099 tempest-TestMinimumBasicScenario-655218334 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:08:34.728897 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-1271f4bb-adb1-4565-ae40-00f7d7a42099 tempest-TestMinimumBasicScenario-655218334 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 22:08:34.732769 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-1271f4bb-adb1-4565-ae40-00f7d7a42099 tempest-TestMinimumBasicScenario-655218334 None] Deleted volume successfully. Dec 25 22:08:34.820613 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-1271f4bb-adb1-4565-ae40-00f7d7a42099 tempest-TestMinimumBasicScenario-655218334 None] Lock "b'cinder-f0773704-6d3d-4e7e-b90d-d5f66c21bc65-delete_volume'" released by "delete_volume" :: held 3.508s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 22:09:32.469102 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 22:09:32.469843 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:09:32.490977 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:09:32.512633 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 22:10:32.467431 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 22:10:32.468163 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:10:32.509635 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:10:32.542577 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 22:11:32.469020 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 22:11:32.469992 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:11:32.492013 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:11:32.512716 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 22:12:32.469982 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 22:12:32.470698 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:12:32.492102 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:12:32.513832 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 22:13:32.470240 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 22:13:32.470958 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:13:32.493147 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:13:32.514422 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 22:14:32.470345 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 22:14:32.470960 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:14:32.492231 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:14:32.514226 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 22:15:32.471104 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 22:15:32.472362 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:15:32.506985 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:15:32.532009 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 22:16:32.469092 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 22:16:32.469874 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:16:32.529135 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:16:32.552082 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 22:17:32.467458 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 22:17:32.468131 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:17:32.489711 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:17:32.512113 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 22:18:32.469785 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 22:18:32.470468 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:18:32.550267 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:18:32.572704 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 22:19:32.468609 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 22:19:32.469397 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:19:32.494911 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:19:32.566898 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 22:20:32.471479 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 22:20:32.472193 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:20:32.492942 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:20:32.514377 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 22:21:16.535940 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-a72867b6-04be-4e73-a328-d239385f0859 tempest-TestShelveInstance-985658293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129926) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Dec 25 22:21:16.539873 ncdv-master-1 cinder-volume[129926]: WARNING stevedore.named [None req-a72867b6-04be-4e73-a328-d239385f0859 tempest-TestShelveInstance-985658293 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Dec 25 22:21:16.540353 ncdv-master-1 cinder-volume[129926]: WARNING castellan.key_manager [None req-a72867b6-04be-4e73-a328-d239385f0859 tempest-TestShelveInstance-985658293 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Dec 25 22:21:16.553236 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a72867b6-04be-4e73-a328-d239385f0859 tempest-TestShelveInstance-985658293 None] Flow 'volume_create_manager' (05edeac0-76d5-480d-9520-13c491598bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 22:21:16.556432 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a72867b6-04be-4e73-a328-d239385f0859 tempest-TestShelveInstance-985658293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97e8fa09-a097-45c0-9e25-2aeab9e289ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 22:21:16.562491 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_db.sqlalchemy.engines [None req-a72867b6-04be-4e73-a328-d239385f0859 tempest-TestShelveInstance-985658293 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 22:21:16.575293 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a72867b6-04be-4e73-a328-d239385f0859 tempest-TestShelveInstance-985658293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97e8fa09-a097-45c0-9e25-2aeab9e289ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-12-25T22:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1667123088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ecc0aa9b-79c9-4bcf-8ce0-12c1f9f72694,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aefbad38c734203b2719ed40e315a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-12-25T22:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-12-25T22:21:16Z,use_quota=True,user_id='21adac3627a24f24b10c1c0023d80a69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b985cc-fdee-4ae1-b26b-c03f2f68353c),volume_type_id=f0b985cc-fdee-4ae1-b26b-c03f2f68353c)' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 22:21:16.577965 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a72867b6-04be-4e73-a328-d239385f0859 tempest-TestShelveInstance-985658293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02404f6a-47ca-43a8-9988-0d347d2b7917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 22:21:16.580325 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a72867b6-04be-4e73-a328-d239385f0859 tempest-TestShelveInstance-985658293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02404f6a-47ca-43a8-9988-0d347d2b7917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 22:21:16.583112 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a72867b6-04be-4e73-a328-d239385f0859 tempest-TestShelveInstance-985658293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (271648fa-1efa-45ef-94b2-a14f39faba8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 22:21:16.659501 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a72867b6-04be-4e73-a328-d239385f0859 tempest-TestShelveInstance-985658293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (271648fa-1efa-45ef-94b2-a14f39faba8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ecc0aa9b-79c9-4bcf-8ce0-12c1f9f72694', 'volume_name': 'volume-ecc0aa9b-79c9-4bcf-8ce0-12c1f9f72694', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 22:21:16.661937 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a72867b6-04be-4e73-a328-d239385f0859 tempest-TestShelveInstance-985658293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01701af5-2962-4d69-9d5c-b6a1e150504e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 22:21:16.664100 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a72867b6-04be-4e73-a328-d239385f0859 tempest-TestShelveInstance-985658293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01701af5-2962-4d69-9d5c-b6a1e150504e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 22:21:16.666325 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a72867b6-04be-4e73-a328-d239385f0859 tempest-TestShelveInstance-985658293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3865314a-23b9-4357-b30d-43699a6632d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 22:21:16.668700 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-a72867b6-04be-4e73-a328-d239385f0859 tempest-TestShelveInstance-985658293 None] Volume ecc0aa9b-79c9-4bcf-8ce0-12c1f9f72694: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ecc0aa9b-79c9-4bcf-8ce0-12c1f9f72694', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Dec 25 22:21:16.668700 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-a72867b6-04be-4e73-a328-d239385f0859 tempest-TestShelveInstance-985658293 None] Cloning ecc0aa9b-79c9-4bcf-8ce0-12c1f9f72694 from image aca914d0-5f7b-465f-a024-75efa27d7291 at location (None, None). {{(pid=129926) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Dec 25 22:21:16.676537 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-a72867b6-04be-4e73-a328-d239385f0859 tempest-TestShelveInstance-985658293 None] Lock "b'cinder-aca914d0-5f7b-465f-a024-75efa27d7291'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 22:21:16.739419 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-a72867b6-04be-4e73-a328-d239385f0859 tempest-TestShelveInstance-985658293 None] Found image-volume cache entry: {'id': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'volume_id': '058f5fb3-51e4-40e3-9c98-542207f1fc1f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31), 'last_used': datetime.datetime(2021, 12, 25, 22, 21, 16, 680367)}. {{(pid=129926) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 25 22:21:16.739853 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-a72867b6-04be-4e73-a328-d239385f0859 tempest-TestShelveInstance-985658293 None] Image-volume cache entry image_update_at = 2021-12-25 20:58:31+00:00, requested image updated_at = 2021-12-25 20:58:31+00:00. {{(pid=129926) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 25 22:21:16.740249 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-a72867b6-04be-4e73-a328-d239385f0859 tempest-TestShelveInstance-985658293 None] Found cache entry for image = aca914d0-5f7b-465f-a024-75efa27d7291 on host ncdv-master-1@ceph#ceph. {{(pid=129926) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Dec 25 22:21:16.745030 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [None req-a72867b6-04be-4e73-a328-d239385f0859 tempest-TestShelveInstance-985658293 None] Lock "b'cinder-aca914d0-5f7b-465f-a024-75efa27d7291'" released by "_prepare_image_cache_entry" :: held 0.068s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 22:21:16.745917 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-a72867b6-04be-4e73-a328-d239385f0859 tempest-TestShelveInstance-985658293 None] Attempting to retrieve cache entry for image = aca914d0-5f7b-465f-a024-75efa27d7291 on host ncdv-master-1@ceph#ceph. {{(pid=129926) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Dec 25 22:21:16.751929 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-a72867b6-04be-4e73-a328-d239385f0859 tempest-TestShelveInstance-985658293 None] Found image-volume cache entry: {'id': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'volume_id': '058f5fb3-51e4-40e3-9c98-542207f1fc1f', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31), 'last_used': datetime.datetime(2021, 12, 25, 22, 21, 16, 749559)}. {{(pid=129926) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Dec 25 22:21:16.752367 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.image.cache [None req-a72867b6-04be-4e73-a328-d239385f0859 tempest-TestShelveInstance-985658293 None] Image-volume cache entry image_update_at = 2021-12-25 20:58:31+00:00, requested image updated_at = 2021-12-25 20:58:31+00:00. {{(pid=129926) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Dec 25 22:21:16.752752 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-a72867b6-04be-4e73-a328-d239385f0859 tempest-TestShelveInstance-985658293 None] Creating from source image-volume 058f5fb3-51e4-40e3-9c98-542207f1fc1f {{(pid=129926) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Dec 25 22:21:16.765556 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a72867b6-04be-4e73-a328-d239385f0859 tempest-TestShelveInstance-985658293 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:21:16.905198 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a72867b6-04be-4e73-a328-d239385f0859 tempest-TestShelveInstance-985658293 None] creating snapshot='volume-ecc0aa9b-79c9-4bcf-8ce0-12c1f9f72694.clone_snap' {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Dec 25 22:21:18.214714 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a72867b6-04be-4e73-a328-d239385f0859 tempest-TestShelveInstance-985658293 None] cloning 'volume-058f5fb3-51e4-40e3-9c98-542207f1fc1f@volume-ecc0aa9b-79c9-4bcf-8ce0-12c1f9f72694.clone_snap' to 'volume-ecc0aa9b-79c9-4bcf-8ce0-12c1f9f72694' {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Dec 25 22:21:19.296052 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a72867b6-04be-4e73-a328-d239385f0859 tempest-TestShelveInstance-985658293 None] Volume volume-98b6d31e-e760-499e-8962-7b22479c1e9a.deleted is not a clone. {{(pid=129926) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Dec 25 22:21:19.297804 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a72867b6-04be-4e73-a328-d239385f0859 tempest-TestShelveInstance-985658293 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Dec 25 22:21:19.298180 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a72867b6-04be-4e73-a328-d239385f0859 tempest-TestShelveInstance-985658293 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129926) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Dec 25 22:21:19.566420 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a72867b6-04be-4e73-a328-d239385f0859 tempest-TestShelveInstance-985658293 None] clone created successfully {{(pid=129926) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Dec 25 22:21:19.566933 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.volume_utils [None req-a72867b6-04be-4e73-a328-d239385f0859 tempest-TestShelveInstance-985658293 None] Marking volume ecc0aa9b-79c9-4bcf-8ce0-12c1f9f72694 as bootable. {{(pid=129926) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Dec 25 22:21:19.624016 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-a72867b6-04be-4e73-a328-d239385f0859 tempest-TestShelveInstance-985658293 None] Copying metadata from image aca914d0-5f7b-465f-a024-75efa27d7291 to ecc0aa9b-79c9-4bcf-8ce0-12c1f9f72694. {{(pid=129926) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Dec 25 22:21:19.624534 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.flows.manager.create_volume [None req-a72867b6-04be-4e73-a328-d239385f0859 tempest-TestShelveInstance-985658293 None] Creating volume glance metadata for volume ecc0aa9b-79c9-4bcf-8ce0-12c1f9f72694 backed by image aca914d0-5f7b-465f-a024-75efa27d7291 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129926) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Dec 25 22:21:19.740175 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a72867b6-04be-4e73-a328-d239385f0859 tempest-TestShelveInstance-985658293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3865314a-23b9-4357-b30d-43699a6632d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecc0aa9b-79c9-4bcf-8ce0-12c1f9f72694', 'volume_size': 1, 'image_id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41b3685f056e42a38cb9ec18c9d20fa2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'aca914d0-5f7b-465f-a024-75efa27d7291', 'created_at': datetime.datetime(2021, 12, 25, 20, 58, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 12, 25, 20, 58, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aca914d0-5f7b-465f-a024-75efa27d7291/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 22:21:19.742421 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a72867b6-04be-4e73-a328-d239385f0859 tempest-TestShelveInstance-985658293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c1b1c15-82ce-4079-aef0-e1759052f193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Dec 25 22:21:19.829657 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.flows.manager.create_volume [None req-a72867b6-04be-4e73-a328-d239385f0859 tempest-TestShelveInstance-985658293 None] Volume volume-ecc0aa9b-79c9-4bcf-8ce0-12c1f9f72694 (ecc0aa9b-79c9-4bcf-8ce0-12c1f9f72694): created successfully Dec 25 22:21:19.831778 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a72867b6-04be-4e73-a328-d239385f0859 tempest-TestShelveInstance-985658293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c1b1c15-82ce-4079-aef0-e1759052f193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129926) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Dec 25 22:21:19.834834 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [None req-a72867b6-04be-4e73-a328-d239385f0859 tempest-TestShelveInstance-985658293 None] Flow 'volume_create_manager' (05edeac0-76d5-480d-9520-13c491598bba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129926) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Dec 25 22:21:19.914864 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [None req-a72867b6-04be-4e73-a328-d239385f0859 tempest-TestShelveInstance-985658293 None] Created volume successfully. Dec 25 22:21:24.629846 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-23d205a0-3b94-4881-bb01-7abb7950a469 req-93cb9a15-e184-496e-9a1a-5d8748a7ee77 tempest-TestShelveInstance-985658293 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 22:21:25.308540 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_concurrency.processutils [req-23d205a0-3b94-4881-bb01-7abb7950a469 req-93cb9a15-e184-496e-9a1a-5d8748a7ee77 tempest-TestShelveInstance-985658293 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.678s {{(pid=129926) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 22:21:25.309435 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-23d205a0-3b94-4881-bb01-7abb7950a469 req-93cb9a15-e184-496e-9a1a-5d8748a7ee77 tempest-TestShelveInstance-985658293 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ecc0aa9b-79c9-4bcf-8ce0-12c1f9f72694', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'a784574f-d922-4963-98f5-026decc1035b', 'volume_id': 'ecc0aa9b-79c9-4bcf-8ce0-12c1f9f72694', 'discard': True}} {{(pid=129926) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Dec 25 22:21:25.396614 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-23d205a0-3b94-4881-bb01-7abb7950a469 req-93cb9a15-e184-496e-9a1a-5d8748a7ee77 tempest-TestShelveInstance-985658293 None] Connection info returned from driver {'name': 'volumes/volume-ecc0aa9b-79c9-4bcf-8ce0-12c1f9f72694', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ecc0aa9b-79c9-4bcf-8ce0-12c1f9f72694', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ef400ad6-dfcb-4d6f-93f3-345b9a692d6a'} {{(pid=129926) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Dec 25 22:21:25.493113 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-23d205a0-3b94-4881-bb01-7abb7950a469 req-93cb9a15-e184-496e-9a1a-5d8748a7ee77 tempest-TestShelveInstance-985658293 None] attachment_update completed successfully. Dec 25 22:21:32.471077 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 22:21:32.472132 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:21:32.495672 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:21:32.519881 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 22:22:32.466870 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 22:22:32.468198 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:22:32.490496 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:22:32.512264 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 22:23:32.469538 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 22:23:32.470209 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:23:32.492352 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:23:32.513993 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 22:24:32.469339 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 22:24:32.470018 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:24:32.491735 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:24:32.514491 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 22:25:16.094932 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-cdc857d0-e102-4343-a7b5-0afc5cb52ffb req-3a033aec-a30d-49c7-a351-465c56aad86f tempest-TestShelveInstance-985658293 None] Terminate volume connection completed successfully. Dec 25 22:25:16.095591 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.manager [req-cdc857d0-e102-4343-a7b5-0afc5cb52ffb req-3a033aec-a30d-49c7-a351-465c56aad86f tempest-TestShelveInstance-985658293 None] Deleting attachment ef400ad6-dfcb-4d6f-93f3-345b9a692d6a. {{(pid=129926) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Dec 25 22:25:16.408048 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [req-cdc857d0-e102-4343-a7b5-0afc5cb52ffb req-79d21e4a-e4d8-4a59-bc33-8b3406845739 tempest-TestShelveInstance-985658293 None] Lock "b'cinder-ecc0aa9b-79c9-4bcf-8ce0-12c1f9f72694-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Dec 25 22:25:16.502686 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-cdc857d0-e102-4343-a7b5-0afc5cb52ffb req-79d21e4a-e4d8-4a59-bc33-8b3406845739 tempest-TestShelveInstance-985658293 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:25:16.650163 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-cdc857d0-e102-4343-a7b5-0afc5cb52ffb req-79d21e4a-e4d8-4a59-bc33-8b3406845739 tempest-TestShelveInstance-985658293 None] volume has no backup snaps {{(pid=129926) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Dec 25 22:25:16.755999 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-cdc857d0-e102-4343-a7b5-0afc5cb52ffb req-79d21e4a-e4d8-4a59-bc33-8b3406845739 tempest-TestShelveInstance-985658293 None] deleting rbd volume volume-ecc0aa9b-79c9-4bcf-8ce0-12c1f9f72694 {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Dec 25 22:25:20.844209 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-cdc857d0-e102-4343-a7b5-0afc5cb52ffb req-79d21e4a-e4d8-4a59-bc33-8b3406845739 tempest-TestShelveInstance-985658293 None] volume is a clone so cleaning references {{(pid=129926) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Dec 25 22:25:20.963660 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-cdc857d0-e102-4343-a7b5-0afc5cb52ffb req-79d21e4a-e4d8-4a59-bc33-8b3406845739 tempest-TestShelveInstance-985658293 None] deleting parent snapshot volume-ecc0aa9b-79c9-4bcf-8ce0-12c1f9f72694.clone_snap {{(pid=129926) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Dec 25 22:25:22.954168 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.quota [req-cdc857d0-e102-4343-a7b5-0afc5cb52ffb req-79d21e4a-e4d8-4a59-bc33-8b3406845739 tempest-TestShelveInstance-985658293 None] Created reservations ['bedcbc85-1279-4b5e-b0c4-4452752d1491', 'cbfec667-3c40-41d8-bac0-f3721a3f5755', '3640adca-b0f5-4538-b8ce-7eacda60bfd6', '5a7f574d-1476-4f6d-a22f-d0fb99a15432'] {{(pid=129926) reserve /opt/stack/cinder/cinder/quota.py:755}} Dec 25 22:25:23.140844 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-cdc857d0-e102-4343-a7b5-0afc5cb52ffb req-79d21e4a-e4d8-4a59-bc33-8b3406845739 tempest-TestShelveInstance-985658293 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:25:23.187925 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [req-cdc857d0-e102-4343-a7b5-0afc5cb52ffb req-79d21e4a-e4d8-4a59-bc33-8b3406845739 tempest-TestShelveInstance-985658293 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:25:23.307842 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [req-cdc857d0-e102-4343-a7b5-0afc5cb52ffb req-79d21e4a-e4d8-4a59-bc33-8b3406845739 tempest-TestShelveInstance-985658293 None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 22:25:23.313264 ncdv-master-1 cinder-volume[129926]: INFO cinder.volume.manager [req-cdc857d0-e102-4343-a7b5-0afc5cb52ffb req-79d21e4a-e4d8-4a59-bc33-8b3406845739 tempest-TestShelveInstance-985658293 None] Deleted volume successfully. Dec 25 22:25:23.367506 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.coordination [req-cdc857d0-e102-4343-a7b5-0afc5cb52ffb req-79d21e4a-e4d8-4a59-bc33-8b3406845739 tempest-TestShelveInstance-985658293 None] Lock "b'cinder-ecc0aa9b-79c9-4bcf-8ce0-12c1f9f72694-delete_volume'" released by "delete_volume" :: held 6.959s {{(pid=129926) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Dec 25 22:25:32.469578 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 22:25:32.470233 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:25:32.505734 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:25:32.570103 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 22:26:32.466784 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 22:26:32.467479 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:26:32.527748 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:26:32.550366 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 22:27:32.467006 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 22:27:32.468186 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:27:32.490894 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:27:32.513183 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 22:28:32.470338 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 22:28:32.471015 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:28:32.499426 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:28:32.522860 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 22:29:32.468794 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 22:29:32.469539 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:29:32.491124 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:29:32.512898 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 22:30:32.468672 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 22:30:32.469381 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:30:32.494747 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:30:32.522013 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 22:31:32.467736 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 22:31:32.468397 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:31:32.489887 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:31:32.512183 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 22:32:32.469559 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 22:32:32.470219 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:32:32.491354 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:32:32.513111 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 22:33:32.469169 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 22:33:32.469928 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:33:32.490948 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:33:32.513448 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 22:34:32.469076 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 22:34:32.469767 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:34:32.490574 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:34:32.512372 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 22:35:32.467680 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 22:35:32.468867 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:35:32.491028 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:35:32.512926 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 22:36:32.469355 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 22:36:32.470517 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:36:32.494718 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:36:32.519123 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 22:37:32.474759 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 22:37:32.475441 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:37:32.497133 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:37:32.519501 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Dec 25 22:38:32.475587 ncdv-master-1 cinder-volume[129926]: DEBUG oslo_service.periodic_task [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129926) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Dec 25 22:38:32.476336 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:38:32.499616 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.volume.drivers.rbd [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129926) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Dec 25 22:38:32.524270 ncdv-master-1 cinder-volume[129926]: DEBUG cinder.manager [None req-a69c94f8-bdc3-4c7f-912b-dc0ecdb4f02c None None] Notifying Schedulers of capabilities ... {{(pid=129926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}