-- Logs begin at Sat 2022-02-05 20:01:18 UTC, end at Sat 2022-02-05 22:19:27 UTC. -- Feb 05 20:37:21.828100 ncdv-master-1 systemd[1]: Started Devstack devstack@c-vol.service. Feb 05 20:37:25.001482 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=122510) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 05 20:37:25.002307 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=122510) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 05 20:37:25.377373 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_db.sqlalchemy.engines [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122510) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 20:37:25.679187 ncdv-master-1 cinder-volume[122510]: INFO cinder.rpc [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Feb 05 20:37:25.684299 ncdv-master-1 cinder-volume[122510]: INFO cinder.rpc [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Feb 05 20:37:25.691066 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_db.sqlalchemy.engines [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122510) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 20:37:25.764650 ncdv-master-1 cinder-volume[122510]: INFO cinder.volume.manager [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] Determined volume DB was empty at startup. Feb 05 20:37:25.765159 ncdv-master-1 cinder-volume[122510]: DEBUG cinder.volume.manager [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=122510) __init__ /opt/stack/cinder/cinder/volume/manager.py:282}} Feb 05 20:37:25.772931 ncdv-master-1 cinder-volume[122510]: INFO cinder.volume.manager [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] Service not found for updating active_backend_id, assuming default for driver init. Feb 05 20:37:25.773735 ncdv-master-1 cinder-volume[122510]: WARNING stevedore.named [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 20:37:25.774176 ncdv-master-1 cinder-volume[122510]: WARNING castellan.key_manager [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 20:37:25.775326 ncdv-master-1 cinder-volume[122510]: WARNING cinder.keymgr.conf_key_mgr [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 20:37:25.790094 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_db.sqlalchemy.engines [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122510) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 20:37:25.794717 ncdv-master-1 cinder-volume[122510]: INFO cinder.rpc [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Feb 05 20:37:25.800146 ncdv-master-1 cinder-volume[122510]: INFO cinder.rpc [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] Automatically selected cinder-volume RPC version 3.17 as minimum service version. Feb 05 20:37:25.800853 ncdv-master-1 cinder-volume[122510]: WARNING stevedore.named [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 20:37:25.801262 ncdv-master-1 cinder-volume[122510]: WARNING castellan.key_manager [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 20:37:25.803034 ncdv-master-1 cinder-volume[122510]: INFO cinder.volume.manager [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] Image-volume cache enabled for host ncdv-master-1@ceph. Feb 05 20:37:25.809391 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_db.sqlalchemy.engines [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122510) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 20:37:25.827548 ncdv-master-1 cinder-volume[122510]: INFO oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] Starting 1 workers Feb 05 20:37:25.833093 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] Started child 122683 {{(pid=122510) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Feb 05 20:37:25.834403 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] Full set of CONF: {{(pid=122510) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Feb 05 20:37:25.835109 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ******************************************************************************** {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 05 20:37:25.835703 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] Configuration options gathered from: {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 05 20:37:25.836512 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 05 20:37:25.837323 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 05 20:37:25.837817 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ================================================================================ {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 05 20:37:25.838792 ncdv-master-1 cinder-volume[122683]: INFO cinder.service [-] Starting cinder-volume node (version 19.1.0) Feb 05 20:37:25.839821 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] allow_availability_zone_fallback = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.840699 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] allow_compression_on_image_upload = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.841425 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] allowed_direct_url_schemes = [] {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.842022 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] api_rate_limit = True {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.842698 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] auth_strategy = keystone {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.843326 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] az_cache_duration = 3600 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.843923 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_availability_zone = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.844492 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_host = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.845221 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_name = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.845918 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_stats_polling_interval = 60 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.846769 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backup_api_class = cinder.backup.api.API {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.847354 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.847974 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backup_name_template = backup-%s {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.848628 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backup_use_same_host = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.849295 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backup_use_temp_snapshot = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.849986 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] chap_password = **** {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.850881 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] chap_username = {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.851475 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.852098 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] cinder_internal_tenant_project_id = 2f8b5d83bc3c46ed989f17b6ea4e7019 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.852690 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] cinder_internal_tenant_user_id = 34ee55021e334a59826d686988c1e2d1 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.853291 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] cloned_volume_same_az = True {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.854164 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] cluster = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.854958 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] compression_format = gzip {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.855816 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] compute_api_class = cinder.compute.nova.API {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.856581 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] config_dir = [] {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.857217 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.857804 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] config_source = [] {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.858394 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.859064 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] control_exchange = openstack {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.859701 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] debug = True {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.860360 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] default_availability_zone = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.861269 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] default_group_type = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.863466 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.863466 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] default_volume_type = ceph {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.863466 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] driver_client_cert = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.864478 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] driver_client_cert_key = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.865195 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] driver_data_namespace = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.866106 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] driver_ssl_cert_path = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.867450 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] driver_ssl_cert_verify = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.868493 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] driver_use_ssl = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.869815 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] enable_force_upload = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.870817 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] enable_new_services = True {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.871527 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] enable_unsupported_driver = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.872107 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] enabled_backends = ['ceph'] {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.872693 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] enforce_multipath_for_image_xfer = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.872891 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-461c35d4-3bd9-4732-814d-bf06adabd87b None None] Starting volume driver RBDDriver (1.2.0) Feb 05 20:37:25.873367 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] filter_function = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.873822 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] glance_api_insecure = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.874353 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] glance_api_servers = ['http://10.222.0.32/image'] {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.874845 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] glance_api_ssl_compression = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.875382 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-461c35d4-3bd9-4732-814d-bf06adabd87b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:37:25.875506 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] glance_ca_certificates_file = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.876149 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] glance_catalog_info = image:glance:publicURL {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.876720 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] glance_certfile = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.877490 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.877962 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] glance_keyfile = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.878451 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] glance_num_retries = 3 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.878969 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] glance_request_timeout = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.879432 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] goodness_function = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.879912 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] graceful_shutdown_timeout = 5 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.880488 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] group_api_class = cinder.group.api.API {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.881016 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] host = ncdv-master-1 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.881638 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] iet_conf = /etc/iet/ietd.conf {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.882138 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] image_compress_on_upload = True {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.882614 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] image_conversion_address_space_limit = 1 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.883084 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] image_conversion_cpu_limit = 60 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.883652 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.884109 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] image_upload_use_cinder_backend = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.884553 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] image_upload_use_internal_tenant = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.885986 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] image_volume_cache_enabled = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.886632 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] image_volume_cache_max_count = 0 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.887191 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] image_volume_cache_max_size_gb = 0 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.887811 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] init_host_max_objects_retrieval = 0 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.888319 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] instance_format = [instance: %(uuid)s] {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.888773 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.889260 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] iscsi_iotype = fileio {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.889822 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] iscsi_secondary_ip_addresses = [] {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.890285 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] iscsi_target_flags = {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.890843 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] iscsi_write_cache = on {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.891503 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] iser_helper = tgtadm {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.892181 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] iser_ip_address = 10.222.0.32 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.892705 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] iser_port = 3260 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.893182 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.893657 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] log_config_append = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.894123 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.895136 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] log_dir = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.895618 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] log_file = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.896121 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] log_options = True {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.896676 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] log_rotate_interval = 1 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.897209 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] log_rotate_interval_type = days {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.897794 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] log_rotation_type = none {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.898159 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.898547 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.898979 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.899423 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.899772 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.900213 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] max_age = 0 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.900989 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] max_logfile_count = 30 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.901546 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] max_logfile_size_mb = 200 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.902001 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] max_over_subscription_ratio = 20.0 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.902589 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] message_reap_interval = 86400 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.903010 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] message_ttl = 2592000 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.903449 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] migration_create_volume_timeout_secs = 300 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.903874 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] monkey_patch = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.904302 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] monkey_patch_modules = [] {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.904661 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] my_ip = 10.222.0.32 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.905093 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] no_snapshot_gb_quota = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.905509 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] num_iser_scan_tries = 3 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.905939 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] num_shell_tries = 3 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.906519 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] num_volume_device_scan_tries = 3 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.906874 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] nvmet_ns_id = 10 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.907435 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] nvmet_port_id = 1 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.907938 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] osapi_max_limit = 1000 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.908317 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] osapi_volume_ext_list = [] {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.908697 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.909237 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] osapi_volume_listen = 0.0.0.0 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.909754 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] osapi_volume_listen_port = 8776 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.910245 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] osapi_volume_use_ssl = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.910882 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] osapi_volume_workers = 2 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.912796 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] per_volume_size_limit = -1 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.913638 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] periodic_fuzzy_delay = 60 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.914465 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] periodic_interval = 60 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.914985 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] public_endpoint = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.915477 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] publish_errors = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.917723 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] quota_backup_gigabytes = 1000 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.918446 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] quota_backups = 10 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.919025 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] quota_consistencygroups = 10 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.919564 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.920290 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] quota_gigabytes = 1000 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.920974 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] quota_groups = 10 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.921650 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] quota_snapshots = 10 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.922236 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] quota_volumes = 10 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.922869 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] rate_limit_burst = 0 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.923440 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] rate_limit_except_level = CRITICAL {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.923990 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] rate_limit_interval = 0 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.924544 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] reinit_driver_count = 3 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.925135 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] replication_device = **** {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.925881 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] report_discard_supported = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.926465 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] report_interval = 10 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.927231 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] reservation_clean_interval = 86400 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.928007 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] reservation_expire = 86400 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.929283 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] reserved_percentage = 0 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.930849 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.932340 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.933464 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] rpc_response_timeout = 120 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.934049 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] run_external_periodic_tasks = True {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.934722 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.935348 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] scst_target_driver = iscsi {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.936301 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] scst_target_iqn_name = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.937213 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] service_down_time = 60 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.938221 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] snapshot_name_template = snapshot-%s {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.938834 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] snapshot_same_host = True {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.939419 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] split_loggers = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.939915 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] state_path = /opt/stack/data/cinder {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.940474 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] storage_availability_zone = nova {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.941058 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] storage_protocol = iscsi {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.941766 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] syslog_log_facility = LOG_USER {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.942531 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] target_helper = lioadm {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.946091 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-461c35d4-3bd9-4732-814d-bf06adabd87b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:37:25.950860 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] target_ip_address = 10.222.0.32 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.951440 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] target_port = 3260 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.951837 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.952221 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] target_protocol = iscsi {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.952597 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] trace_flags = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.952993 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] transfer_api_class = cinder.transfer.api.API {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.953522 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] transport_url = **** {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.953910 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] until_refresh = 0 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.954290 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] use_chap_auth = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.954700 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] use_default_quota_class = True {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.955054 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] use_eventlog = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.955403 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] use_journal = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.955762 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] use_json = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.956112 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] use_multipath_for_image_xfer = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.956474 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] use_stderr = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.956820 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] use_syslog = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.957311 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] verify_glance_signatures = enabled {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.957772 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] volume_api_class = cinder.volume.api.API {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.958124 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] volume_backend_name = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.958521 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] volume_clear = zero {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.958861 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] volume_clear_ionice = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.959754 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] volume_clear_size = 0 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.960296 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.961118 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] volume_copy_bps_limit = 0 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.961641 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] volume_dd_blocksize = 1M {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.962152 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.962927 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] volume_name_template = volume-%s {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.963698 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] volume_service_inithost_offload = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.964216 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] volume_usage_audit_period = month {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.964816 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.965359 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] watch_log_file = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.966238 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] zoning_mode = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 05 20:37:25.970460 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.971607 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.972442 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_policy.enforce_new_defaults = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.972838 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_policy.enforce_scope = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.973451 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_policy.policy_default_rule = default {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.973986 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.974448 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_policy.policy_file = policy.yaml {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.975021 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.975542 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.976038 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.976568 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.977106 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.977528 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_concurrency.disable_process_locking = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.977906 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.978346 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] keystone_authtoken.admin_password = **** {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.979325 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] keystone_authtoken.admin_tenant_name = admin {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.979822 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] keystone_authtoken.admin_token = **** {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.980358 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] keystone_authtoken.admin_user = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.980905 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] keystone_authtoken.auth_admin_prefix = {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.981319 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.981698 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] keystone_authtoken.auth_port = 35357 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.982089 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] keystone_authtoken.auth_protocol = https {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.982820 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] keystone_authtoken.auth_section = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.982921 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] keystone_authtoken.auth_type = password {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.983429 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] keystone_authtoken.auth_uri = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.984093 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] keystone_authtoken.auth_version = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.984665 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] keystone_authtoken.cache = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.985211 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.985955 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] keystone_authtoken.certfile = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.986511 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] keystone_authtoken.delay_auth_decision = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.987087 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.987637 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] keystone_authtoken.http_connect_timeout = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.987991 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.988344 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] keystone_authtoken.identity_uri = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.988724 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] keystone_authtoken.include_service_catalog = True {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.989076 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] keystone_authtoken.insecure = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.989492 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] keystone_authtoken.interface = public {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.989850 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] keystone_authtoken.keyfile = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.990202 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.990587 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.990935 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.991293 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.991627 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.991967 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.992349 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.992696 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.993098 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.993447 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] keystone_authtoken.region_name = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.993967 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.994932 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] keystone_authtoken.service_token_roles_required = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.995291 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] keystone_authtoken.service_type = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.995635 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] keystone_authtoken.token_cache_time = 300 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.995997 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] keystone_authtoken.www_authenticate_uri = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.996677 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] cache.backend = dogpile.cache.null {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.997247 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] cache.backend_argument = **** {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.997944 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] cache.config_prefix = cache.oslo {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.998525 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] cache.dead_timeout = 60.0 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.999063 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] cache.debug_cache_backend = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.999574 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] cache.enable_retry_client = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:25.999834 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-461c35d4-3bd9-4732-814d-bf06adabd87b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:37:26.000241 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] cache.enable_socket_keepalive = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.000747 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] cache.enabled = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.001267 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] cache.expiration_time = 600 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.001803 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] cache.hashclient_retry_attempts = 2 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.002787 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] cache.hashclient_retry_delay = 1.0 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.003317 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] cache.memcache_dead_retry = 300 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.003832 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.004326 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.004838 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] cache.memcache_pool_maxsize = 10 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.005349 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.005895 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.006451 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] cache.memcache_socket_timeout = 1.0 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.006981 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] cache.proxies = [] {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.007498 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] cache.retry_attempts = 2 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.008016 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] cache.retry_delay = 0.0 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.008536 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] cache.socket_keepalive_count = 1 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.009037 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] cache.socket_keepalive_idle = 1 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.009531 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] cache.socket_keepalive_interval = 1 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.010057 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] cache.tls_allowed_ciphers = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.010606 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] cache.tls_cafile = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.011093 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] cache.tls_certfile = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.011586 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] cache.tls_enabled = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.012098 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] cache.tls_keyfile = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.012651 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] coordination.backend_url = etcd3+http://10.222.0.32:2379 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.013085 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] database.backend = sqlalchemy {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.013401 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] database.connection = **** {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.013778 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] database.connection_debug = 0 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.014142 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] database.connection_parameters = {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.014523 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] database.connection_recycle_time = 3600 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.014936 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] database.connection_trace = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.015239 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] database.db_inc_retry_interval = True {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.015814 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] database.db_max_retries = 20 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.016167 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] database.db_max_retry_interval = 10 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.016516 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] database.db_retry_interval = 1 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.016873 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] database.max_overflow = 50 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.017218 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] database.max_pool_size = 5 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.017578 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] database.max_retries = 10 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.017923 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] database.mysql_enable_ndb = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.018280 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.018651 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] database.pool_timeout = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.019010 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] database.retry_interval = 10 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.019693 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] database.slave_connection = **** {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.020215 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] database.sqlite_synchronous = True {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.021100 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] database.use_db_reconnect = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.021725 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.022261 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.022678 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.023041 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.023405 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.023824 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] profiler.connection_string = messaging:// {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.024119 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] profiler.enabled = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.024485 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] profiler.es_doc_type = notification {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.024833 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] profiler.es_scroll_size = 10000 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.025197 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] profiler.es_scroll_time = 2m {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.025580 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] profiler.filter_error_trace = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.025954 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] profiler.hmac_keys = SECRET_KEY {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.026411 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] profiler.sentinel_service_name = mymaster {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.027203 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] profiler.socket_timeout = 0.1 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.027584 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] profiler.trace_sqlalchemy = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.028032 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] privsep_osbrick.capabilities = [21] {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.028522 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] privsep_osbrick.group = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.028889 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] privsep_osbrick.helper_command = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.029269 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] privsep_osbrick.logger_name = oslo_privsep.daemon {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.029620 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.029959 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] privsep_osbrick.user = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.030346 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.032357 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] cinder_sys_admin.group = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.032907 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] cinder_sys_admin.helper_command = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.033490 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.035617 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.035617 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] cinder_sys_admin.user = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.038550 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] service_user.auth_section = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.039682 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] service_user.auth_type = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.040114 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] service_user.cafile = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.040543 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] service_user.certfile = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.041541 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] service_user.collect_timing = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.041990 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] service_user.insecure = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.042436 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] service_user.keyfile = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.043072 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] service_user.send_service_user_token = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.043507 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] service_user.split_loggers = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.043928 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] service_user.timeout = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.044406 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.backend_availability_zone = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.044854 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.045276 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.045703 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.chap_password = **** {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.046130 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.chap_username = {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.046596 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.047287 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.deferred_deletion_delay = 0 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.047730 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.deferred_deletion_purge_interval = 60 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.048515 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.driver_client_cert = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.048929 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.driver_client_cert_key = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.049341 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.driver_data_namespace = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.049754 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.050169 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.050622 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.driver_use_ssl = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.051171 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.enable_deferred_deletion = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.051570 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.driver [None req-461c35d4-3bd9-4732-814d-bf06adabd87b None None] Driver hasn't implemented _init_vendor_properties() Feb 05 20:37:26.051674 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.enable_unsupported_driver = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.051949 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.driver [None req-461c35d4-3bd9-4732-814d-bf06adabd87b None None] Initialized capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:6740a15a-ef85-40b2-bb99-93dfa195f6a4:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=122683) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:820}} Feb 05 20:37:26.052088 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.052438 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.extra_capabilities = {} {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.052861 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.filter_function = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.053278 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.goodness_function = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.053996 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.iet_conf = /etc/iet/ietd.conf {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.054593 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.055013 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.055456 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.055872 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.056286 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.056797 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.iscsi_iotype = fileio {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.057236 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.iscsi_secondary_ip_addresses = [] {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.057665 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.iscsi_target_flags = {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.058091 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.iscsi_write_cache = on {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.058806 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.iser_helper = tgtadm {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.059488 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.iser_ip_address = 10.222.0.32 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.059911 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.iser_port = 3260 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.060339 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.060774 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.061197 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.061634 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.num_shell_tries = 3 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.062060 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.063067 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.063497 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.nvmet_port_id = 1 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.063918 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.rados_connect_timeout = -1 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.064337 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.rados_connection_interval = 5 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.064455 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-461c35d4-3bd9-4732-814d-bf06adabd87b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 20:37:26.064778 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.rados_connection_retries = 3 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.065206 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.rbd_ceph_conf = {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.065722 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.rbd_cluster_name = ceph {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.066146 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.rbd_exclusive_cinder_pool = True {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.066586 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.rbd_flatten_volume_from_snapshot = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.067061 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.rbd_max_clone_depth = 5 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.067511 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.rbd_pool = rbd {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.067918 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.rbd_secret_uuid = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.068352 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.rbd_store_chunk_size = 4 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.068779 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.rbd_user = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.069217 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.replication_connect_timeout = 5 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.069619 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.replication_device = **** {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.070028 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.report_discard_supported = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.070460 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.report_dynamic_total_capacity = True {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.070879 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.reserved_percentage = 0 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.071400 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.scst_target_driver = iscsi {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.071819 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.scst_target_iqn_name = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.072814 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.storage_protocol = iscsi {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.073480 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.074478 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.target_helper = tgtadm {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.075181 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.target_ip_address = 10.222.0.32 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.075715 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.target_port = 3260 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.076272 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.076846 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.target_protocol = iscsi {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.077379 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.trace_flags = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.078736 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.unique_fqdn_network = True {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.079037 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.use_chap_auth = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.081887 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.082417 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.volume_backend_name = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.082850 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.volume_clear = zero {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.083465 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.volume_clear_ionice = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.083835 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.volume_clear_size = 0 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.084207 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.084676 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.085153 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.085562 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.086041 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.086716 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_reports.file_event_handler = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.087012 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.087524 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_reports.log_dir = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.088628 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.backend_availability_zone = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.089459 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.backend_host = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.090003 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.backend_native_threads_pool_size = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.090569 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.backup_use_temp_snapshot = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.091112 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.chap_password = **** {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.092024 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.chap_username = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.092618 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.chiscsi_conf = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.093266 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.deferred_deletion_delay = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.093953 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.deferred_deletion_purge_interval = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.094604 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.driver_client_cert = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.095246 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.driver_client_cert_key = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.095801 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.driver_data_namespace = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.096454 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.driver_ssl_cert_path = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.096973 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.driver_ssl_cert_verify = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.097626 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.driver_use_ssl = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.098154 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.enable_deferred_deletion = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.098708 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.enable_unsupported_driver = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.099232 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.enforce_multipath_for_image_xfer = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.099764 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.extra_capabilities = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.100279 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.filter_function = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.100803 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.goodness_function = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.101319 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.iet_conf = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.101791 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.db.sqlalchemy.api [None req-461c35d4-3bd9-4732-814d-bf06adabd87b None None] Building query based on filter {{(pid=122683) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3156}} Feb 05 20:37:26.102222 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.image_upload_use_cinder_backend = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.102672 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.image_upload_use_internal_tenant = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.103115 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.image_volume_cache_enabled = True {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.103877 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.image_volume_cache_max_count = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.104670 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.image_volume_cache_max_size_gb = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.105094 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.iscsi_iotype = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.105617 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.iscsi_secondary_ip_addresses = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.106041 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.iscsi_target_flags = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.106609 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.iscsi_write_cache = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.107037 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.iser_helper = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.107457 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.iser_ip_address = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.108004 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.iser_port = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.108420 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.iser_target_prefix = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.108919 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.max_over_subscription_ratio = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.109336 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.num_iser_scan_tries = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.109752 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.num_shell_tries = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.110152 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.num_volume_device_scan_tries = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.110508 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.nvmet_ns_id = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.110961 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.nvmet_port_id = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.111359 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.rados_connect_timeout = -1 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.112349 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.rados_connection_interval = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.112977 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.rados_connection_retries = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.113701 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.rbd_ceph_conf = /etc/ceph/ceph.conf {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.114519 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.rbd_cluster_name = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.115154 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.rbd_exclusive_cinder_pool = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.115870 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.rbd_flatten_volume_from_snapshot = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.116425 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.rbd_max_clone_depth = 5 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.117182 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.rbd_pool = volumes {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.118015 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.rbd_secret_uuid = 5b2f70e9-748a-4334-b20d-2ef0f056e5f4 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.118582 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.rbd_store_chunk_size = 4 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.119270 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.rbd_user = cinder {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.120264 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.replication_connect_timeout = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.120930 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.replication_device = **** {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.121442 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.report_discard_supported = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.122245 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.report_dynamic_total_capacity = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.122870 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.reserved_percentage = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.123425 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.scst_target_driver = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.124279 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.scst_target_iqn_name = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.124796 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.storage_protocol = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.125251 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.image_utils [None req-461c35d4-3bd9-4732-814d-bf06adabd87b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=122683) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:955}} Feb 05 20:37:26.125758 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.suppress_requests_ssl_warnings = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.126342 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.target_helper = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.127211 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.target_ip_address = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.127744 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.target_port = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.128430 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.target_prefix = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.128952 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.target_protocol = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.129522 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.trace_flags = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.130224 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.unique_fqdn_network = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.130778 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.use_chap_auth = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.131277 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.use_multipath_for_image_xfer = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.131821 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.volume_backend_name = ceph {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.132743 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.volume_clear = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.133274 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.volume_clear_ionice = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.133953 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.volume_clear_size = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.135461 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.volume_copy_blkio_cgroup_name = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.136466 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.volume_copy_bps_limit = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.137523 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.volume_dd_blocksize = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.138804 ncdv-master-1 cinder-volume[122683]: INFO cinder.keymgr.migration [None req-0ec57b97-3bf6-45f4-a298-5f17936ab22c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Feb 05 20:37:26.138977 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.volume_driver = cinder.volume.drivers.rbd.RBDDriver {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.139846 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ceph.volumes_dir = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.140896 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-461c35d4-3bd9-4732-814d-bf06adabd87b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:37:26.141183 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.142435 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.143241 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.143785 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.144472 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.145176 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.146084 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.146726 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.147522 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.148049 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.148829 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.149362 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.149938 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.151230 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.152056 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.152607 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.153001 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.153358 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.153715 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.154161 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.154565 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.154993 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_messaging_rabbit.ssl = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.155358 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.155903 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.156448 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.156817 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_messaging_rabbit.ssl_version = {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.157148 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_messaging_notifications.driver = [] {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.157839 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_messaging_notifications.retry = -1 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.158080 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.158624 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] oslo_messaging_notifications.transport_url = **** {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.159313 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.159775 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] key_manager.fixed_key = **** {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.160371 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.160874 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] barbican.barbican_api_version = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.161221 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] barbican.barbican_endpoint = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.161595 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] barbican.barbican_endpoint_type = public {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.161966 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] barbican.barbican_region_name = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.162309 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] barbican.cafile = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.162821 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] barbican.certfile = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.163208 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] barbican.collect_timing = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.163526 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] barbican.insecure = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.163863 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] barbican.keyfile = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.164220 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] barbican.number_of_retries = 60 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.164570 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] barbican.retry_delay = 1 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.165102 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] barbican.send_service_user_token = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.165249 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] barbican.split_loggers = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.165775 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] barbican.timeout = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.166503 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] barbican.verify_ssl = True {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.167235 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] barbican.verify_ssl_path = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.167633 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] barbican_service_user.auth_section = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.167985 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] barbican_service_user.auth_type = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.168325 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] barbican_service_user.cafile = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.168664 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] barbican_service_user.certfile = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.169034 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] barbican_service_user.collect_timing = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.169649 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] barbican_service_user.insecure = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.169996 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] barbican_service_user.keyfile = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.170560 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] barbican_service_user.split_loggers = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.171056 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] barbican_service_user.timeout = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.171704 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] vault.approle_role_id = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.172202 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] vault.approle_secret_id = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.173003 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] vault.cafile = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.173513 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] vault.certfile = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.174193 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] vault.collect_timing = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.174809 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] vault.insecure = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.175155 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] vault.keyfile = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.175537 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] vault.kv_mountpoint = secret {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.175968 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] vault.kv_version = 2 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.176282 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] vault.namespace = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.176628 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] vault.root_token_id = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.176969 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] vault.split_loggers = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.177303 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] vault.ssl_ca_crt_file = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.177640 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] vault.timeout = None {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.177984 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] vault.use_ssl = False {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.178347 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 05 20:37:26.178651 ncdv-master-1 cinder-volume[122510]: DEBUG oslo_service.service [None req-21f2a9c2-f05a-442a-bb38-489fc736c60c None None] ******************************************************************************** {{(pid=122510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 05 20:37:26.185099 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-461c35d4-3bd9-4732-814d-bf06adabd87b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:37:26.214818 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-461c35d4-3bd9-4732-814d-bf06adabd87b None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 20:37:26.250481 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-461c35d4-3bd9-4732-814d-bf06adabd87b None None] Driver initialization completed successfully. Feb 05 20:37:26.262948 ncdv-master-1 cinder-volume[122683]: INFO cinder.manager [None req-461c35d4-3bd9-4732-814d-bf06adabd87b None None] Initiating service 3 cleanup Feb 05 20:37:26.269236 ncdv-master-1 cinder-volume[122683]: INFO cinder.manager [None req-461c35d4-3bd9-4732-814d-bf06adabd87b None None] Service 3 cleanup completed. Feb 05 20:37:26.269496 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.service [None req-461c35d4-3bd9-4732-814d-bf06adabd87b None None] Creating RPC server for service cinder-volume {{(pid=122683) start /opt/stack/cinder/cinder/service.py:231}} Feb 05 20:37:26.277535 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.service [None req-461c35d4-3bd9-4732-814d-bf06adabd87b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=122683) start /opt/stack/cinder/cinder/service.py:237}} Feb 05 20:37:26.328505 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-461c35d4-3bd9-4732-814d-bf06adabd87b None None] Initializing RPC dependent components of volume driver RBDDriver (1.2.0) Feb 05 20:37:26.329699 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-461c35d4-3bd9-4732-814d-bf06adabd87b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:37:26.361342 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-461c35d4-3bd9-4732-814d-bf06adabd87b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:37:26.411684 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-461c35d4-3bd9-4732-814d-bf06adabd87b None None] Driver post RPC initialization completed successfully. Feb 05 20:38:52.415645 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 20:38:52.416416 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:38:52.438133 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:38:52.460005 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 20:39:52.416043 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 20:39:52.416723 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:39:52.438753 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:39:52.461351 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 20:40:52.416046 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 20:40:52.416770 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:40:52.438287 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:40:52.460508 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 20:41:52.415044 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 20:41:52.415752 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:41:52.436208 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:41:52.459718 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 20:42:52.414768 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 20:42:52.415515 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:42:52.437178 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:42:52.465400 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 20:43:52.411089 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 20:43:52.411833 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:43:52.437281 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:43:52.463784 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 20:44:52.409307 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 20:44:52.410003 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:44:52.432596 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:44:52.454477 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 20:45:52.408992 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 20:45:52.409754 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:45:52.433719 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:45:52.458535 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 20:46:52.414170 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 20:46:52.414993 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:46:52.489210 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:46:52.573202 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 20:47:52.415097 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 20:47:52.415816 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:47:52.439418 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:47:52.469052 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 20:48:17.487985 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-8787bb7b-59d4-4829-8e1d-b0a2ec30c4af tempest-LiveMigrationTest-1996259675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 20:48:17.499592 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-8787bb7b-59d4-4829-8e1d-b0a2ec30c4af tempest-LiveMigrationTest-1996259675 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 20:48:17.505235 ncdv-master-1 cinder-volume[122683]: INFO cinder.rpc [None req-8787bb7b-59d4-4829-8e1d-b0a2ec30c4af tempest-LiveMigrationTest-1996259675 None] Automatically selected cinder-backup objects version 1.39 as minimum service version. Feb 05 20:48:17.509373 ncdv-master-1 cinder-volume[122683]: INFO cinder.rpc [None req-8787bb7b-59d4-4829-8e1d-b0a2ec30c4af tempest-LiveMigrationTest-1996259675 None] Automatically selected cinder-backup RPC version 2.3 as minimum service version. Feb 05 20:48:17.510529 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-8787bb7b-59d4-4829-8e1d-b0a2ec30c4af tempest-LiveMigrationTest-1996259675 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 20:48:17.511075 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-8787bb7b-59d4-4829-8e1d-b0a2ec30c4af tempest-LiveMigrationTest-1996259675 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 20:48:17.554726 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8787bb7b-59d4-4829-8e1d-b0a2ec30c4af tempest-LiveMigrationTest-1996259675 None] Flow 'volume_create_manager' (568c80fc-b970-483b-b337-e1b0630f2889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 20:48:17.560719 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8787bb7b-59d4-4829-8e1d-b0a2ec30c4af tempest-LiveMigrationTest-1996259675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5db3f62d-e186-483d-b4ef-2ff2aa6a274d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:48:17.568413 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-8787bb7b-59d4-4829-8e1d-b0a2ec30c4af tempest-LiveMigrationTest-1996259675 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 20:48:17.612726 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8787bb7b-59d4-4829-8e1d-b0a2ec30c4af tempest-LiveMigrationTest-1996259675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5db3f62d-e186-483d-b4ef-2ff2aa6a274d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T20:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveMigrationTest-volume-1982311966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=bb7c14e5-2e62-497c-88ad-58ffc5b820ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee5ceeb66aa4167b6492470edbad369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T20:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T20:48:17Z,use_quota=True,user_id='fbc2b85d6662472aa6a28563d2820c53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:48:17.617614 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8787bb7b-59d4-4829-8e1d-b0a2ec30c4af tempest-LiveMigrationTest-1996259675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8263280f-87d0-49ea-9eb1-58e6940a0016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:48:17.621413 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8787bb7b-59d4-4829-8e1d-b0a2ec30c4af tempest-LiveMigrationTest-1996259675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8263280f-87d0-49ea-9eb1-58e6940a0016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:48:17.625946 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8787bb7b-59d4-4829-8e1d-b0a2ec30c4af tempest-LiveMigrationTest-1996259675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (035bf1d5-563b-4945-b74a-d04ce8814194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:48:17.630439 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8787bb7b-59d4-4829-8e1d-b0a2ec30c4af tempest-LiveMigrationTest-1996259675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (035bf1d5-563b-4945-b74a-d04ce8814194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb7c14e5-2e62-497c-88ad-58ffc5b820ad', 'volume_name': 'volume-bb7c14e5-2e62-497c-88ad-58ffc5b820ad', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:48:17.634881 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8787bb7b-59d4-4829-8e1d-b0a2ec30c4af tempest-LiveMigrationTest-1996259675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef3fe3e2-9f43-41db-93df-1a835e6fc71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:48:17.638622 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8787bb7b-59d4-4829-8e1d-b0a2ec30c4af tempest-LiveMigrationTest-1996259675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef3fe3e2-9f43-41db-93df-1a835e6fc71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:48:17.642979 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8787bb7b-59d4-4829-8e1d-b0a2ec30c4af tempest-LiveMigrationTest-1996259675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e501c9f-8a7a-47a8-96da-f1c159ac843f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:48:17.644035 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-8787bb7b-59d4-4829-8e1d-b0a2ec30c4af tempest-LiveMigrationTest-1996259675 None] Volume bb7c14e5-2e62-497c-88ad-58ffc5b820ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb7c14e5-2e62-497c-88ad-58ffc5b820ad', 'volume_size': 1} Feb 05 20:48:17.644445 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8787bb7b-59d4-4829-8e1d-b0a2ec30c4af tempest-LiveMigrationTest-1996259675 None] creating volume 'volume-bb7c14e5-2e62-497c-88ad-58ffc5b820ad' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 20:48:17.645496 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8787bb7b-59d4-4829-8e1d-b0a2ec30c4af tempest-LiveMigrationTest-1996259675 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:48:17.827951 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8787bb7b-59d4-4829-8e1d-b0a2ec30c4af tempest-LiveMigrationTest-1996259675 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 20:48:17.828601 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8787bb7b-59d4-4829-8e1d-b0a2ec30c4af tempest-LiveMigrationTest-1996259675 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 20:48:17.832509 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8787bb7b-59d4-4829-8e1d-b0a2ec30c4af tempest-LiveMigrationTest-1996259675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e501c9f-8a7a-47a8-96da-f1c159ac843f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb7c14e5-2e62-497c-88ad-58ffc5b820ad', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:48:17.837297 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8787bb7b-59d4-4829-8e1d-b0a2ec30c4af tempest-LiveMigrationTest-1996259675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ac69d42-48ba-47fd-be9c-5ab34c486286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:48:17.847510 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-8787bb7b-59d4-4829-8e1d-b0a2ec30c4af tempest-LiveMigrationTest-1996259675 None] Volume volume-bb7c14e5-2e62-497c-88ad-58ffc5b820ad (bb7c14e5-2e62-497c-88ad-58ffc5b820ad): created successfully Feb 05 20:48:17.851403 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8787bb7b-59d4-4829-8e1d-b0a2ec30c4af tempest-LiveMigrationTest-1996259675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ac69d42-48ba-47fd-be9c-5ab34c486286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:48:17.856769 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8787bb7b-59d4-4829-8e1d-b0a2ec30c4af tempest-LiveMigrationTest-1996259675 None] Flow 'volume_create_manager' (568c80fc-b970-483b-b337-e1b0630f2889) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 20:48:17.866724 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-8787bb7b-59d4-4829-8e1d-b0a2ec30c4af tempest-LiveMigrationTest-1996259675 None] Created volume successfully. Feb 05 20:48:19.078566 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-c6f3d376-6cbe-4f27-bcbd-36af8171da77 req-0c100a71-55c8-41d2-8289-a1f7edee4ce6 tempest-LiveMigrationTest-1996259675 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 20:48:19.744460 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-c6f3d376-6cbe-4f27-bcbd-36af8171da77 req-0c100a71-55c8-41d2-8289-a1f7edee4ce6 tempest-LiveMigrationTest-1996259675 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.666s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 20:48:19.745431 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-c6f3d376-6cbe-4f27-bcbd-36af8171da77 req-0c100a71-55c8-41d2-8289-a1f7edee4ce6 tempest-LiveMigrationTest-1996259675 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-bb7c14e5-2e62-497c-88ad-58ffc5b820ad', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': 'bb7c14e5-2e62-497c-88ad-58ffc5b820ad', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 20:48:19.796420 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-c6f3d376-6cbe-4f27-bcbd-36af8171da77 req-0c100a71-55c8-41d2-8289-a1f7edee4ce6 tempest-LiveMigrationTest-1996259675 None] Connection info returned from driver {'name': 'volumes/volume-bb7c14e5-2e62-497c-88ad-58ffc5b820ad', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'bb7c14e5-2e62-497c-88ad-58ffc5b820ad', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '2ff755ac-8a8f-4a13-9c5f-13c50e03e139'} {{(pid=122683) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 05 20:48:19.888257 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-c6f3d376-6cbe-4f27-bcbd-36af8171da77 req-0c100a71-55c8-41d2-8289-a1f7edee4ce6 tempest-LiveMigrationTest-1996259675 None] attachment_update completed successfully. Feb 05 20:48:32.073424 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-515d1532-d65b-4c28-a991-df8c87bba44b req-82213a9d-6b2c-465e-b91f-4a0f08cb2dc5 tempest-LiveMigrationTest-1855252981 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 20:48:32.774209 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-515d1532-d65b-4c28-a991-df8c87bba44b req-82213a9d-6b2c-465e-b91f-4a0f08cb2dc5 tempest-LiveMigrationTest-1855252981 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.701s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 20:48:32.775032 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-515d1532-d65b-4c28-a991-df8c87bba44b req-82213a9d-6b2c-465e-b91f-4a0f08cb2dc5 tempest-LiveMigrationTest-1855252981 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-bb7c14e5-2e62-497c-88ad-58ffc5b820ad', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': 'bb7c14e5-2e62-497c-88ad-58ffc5b820ad', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 20:48:32.804857 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-515d1532-d65b-4c28-a991-df8c87bba44b req-82213a9d-6b2c-465e-b91f-4a0f08cb2dc5 tempest-LiveMigrationTest-1855252981 None] Connection info returned from driver {'name': 'volumes/volume-bb7c14e5-2e62-497c-88ad-58ffc5b820ad', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'bb7c14e5-2e62-497c-88ad-58ffc5b820ad', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'dffaed68-6c97-44cf-9fe8-361af63d545e'} {{(pid=122683) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 05 20:48:32.889067 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-515d1532-d65b-4c28-a991-df8c87bba44b req-82213a9d-6b2c-465e-b91f-4a0f08cb2dc5 tempest-LiveMigrationTest-1855252981 None] attachment_update completed successfully. Feb 05 20:48:52.414331 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 20:48:52.416027 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:48:52.473685 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:48:52.542080 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 20:48:54.725676 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-515d1532-d65b-4c28-a991-df8c87bba44b req-a820d725-9648-46ed-9330-37c65731290f tempest-LiveMigrationTest-1855252981 None] Terminate volume connection completed successfully. Feb 05 20:48:54.726859 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-515d1532-d65b-4c28-a991-df8c87bba44b req-a820d725-9648-46ed-9330-37c65731290f tempest-LiveMigrationTest-1855252981 None] Deleting attachment 2ff755ac-8a8f-4a13-9c5f-13c50e03e139. {{(pid=122683) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 05 20:48:59.653446 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-d393aa27-8733-430b-abf7-2502f6329fbe tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 20:48:59.657485 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-d393aa27-8733-430b-abf7-2502f6329fbe tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 20:48:59.657917 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-d393aa27-8733-430b-abf7-2502f6329fbe tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 20:48:59.678716 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d393aa27-8733-430b-abf7-2502f6329fbe tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Flow 'volume_create_manager' (79481643-3155-4fdf-98c1-35745ebadeaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 20:48:59.687277 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d393aa27-8733-430b-abf7-2502f6329fbe tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84a714db-fa5a-4613-b6b3-6aa01b9bc550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:48:59.694981 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-d393aa27-8733-430b-abf7-2502f6329fbe tempest-LiveAutoBlockMigrationV225Test-1583891558 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 20:48:59.711505 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d393aa27-8733-430b-abf7-2502f6329fbe tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84a714db-fa5a-4613-b6b3-6aa01b9bc550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T20:48:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveAutoBlockMigrationV225Test-volume-1722033623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f50f8deb-cde1-4de6-b473-b0fdcc2d3e59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e4e31092ef641efbf6eaf54cfa40d67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T20:49:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T20:49:00Z,use_quota=True,user_id='ecf60934d79e4ae89c65c1fdd6086fe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:48:59.717475 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d393aa27-8733-430b-abf7-2502f6329fbe tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9352a43b-af76-4c81-9f9d-ce18b1d2d35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:48:59.721899 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d393aa27-8733-430b-abf7-2502f6329fbe tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9352a43b-af76-4c81-9f9d-ce18b1d2d35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:48:59.730449 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d393aa27-8733-430b-abf7-2502f6329fbe tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fea80e6-ca7c-45e5-8e3f-3ac81f982226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:48:59.742708 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d393aa27-8733-430b-abf7-2502f6329fbe tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fea80e6-ca7c-45e5-8e3f-3ac81f982226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f50f8deb-cde1-4de6-b473-b0fdcc2d3e59', 'volume_name': 'volume-f50f8deb-cde1-4de6-b473-b0fdcc2d3e59', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:48:59.747715 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d393aa27-8733-430b-abf7-2502f6329fbe tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d565834f-1ee0-45b8-90ab-7a001852b6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:48:59.753343 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d393aa27-8733-430b-abf7-2502f6329fbe tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d565834f-1ee0-45b8-90ab-7a001852b6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:48:59.759174 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d393aa27-8733-430b-abf7-2502f6329fbe tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26663759-eaac-4b6e-8e69-101c43216f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:48:59.760393 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-d393aa27-8733-430b-abf7-2502f6329fbe tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Volume f50f8deb-cde1-4de6-b473-b0fdcc2d3e59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f50f8deb-cde1-4de6-b473-b0fdcc2d3e59', 'volume_size': 1} Feb 05 20:48:59.760804 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-d393aa27-8733-430b-abf7-2502f6329fbe tempest-LiveAutoBlockMigrationV225Test-1583891558 None] creating volume 'volume-f50f8deb-cde1-4de6-b473-b0fdcc2d3e59' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 20:48:59.761806 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-d393aa27-8733-430b-abf7-2502f6329fbe tempest-LiveAutoBlockMigrationV225Test-1583891558 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:48:59.843904 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-d393aa27-8733-430b-abf7-2502f6329fbe tempest-LiveAutoBlockMigrationV225Test-1583891558 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 20:48:59.844552 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-d393aa27-8733-430b-abf7-2502f6329fbe tempest-LiveAutoBlockMigrationV225Test-1583891558 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 20:48:59.848663 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d393aa27-8733-430b-abf7-2502f6329fbe tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26663759-eaac-4b6e-8e69-101c43216f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f50f8deb-cde1-4de6-b473-b0fdcc2d3e59', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:48:59.853232 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d393aa27-8733-430b-abf7-2502f6329fbe tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (227ce670-52cd-47ea-8a8c-e6cf82fb8a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:48:59.862975 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-d393aa27-8733-430b-abf7-2502f6329fbe tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Volume volume-f50f8deb-cde1-4de6-b473-b0fdcc2d3e59 (f50f8deb-cde1-4de6-b473-b0fdcc2d3e59): created successfully Feb 05 20:48:59.866732 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d393aa27-8733-430b-abf7-2502f6329fbe tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (227ce670-52cd-47ea-8a8c-e6cf82fb8a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:48:59.872187 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d393aa27-8733-430b-abf7-2502f6329fbe tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Flow 'volume_create_manager' (79481643-3155-4fdf-98c1-35745ebadeaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 20:48:59.881585 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-d393aa27-8733-430b-abf7-2502f6329fbe tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Created volume successfully. Feb 05 20:49:03.256602 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-9c34c6ab-02c6-44de-9c06-33843fdfff25 req-f556fb6c-5911-4dc4-97a6-8ba183517058 tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 20:49:04.314711 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-9c34c6ab-02c6-44de-9c06-33843fdfff25 req-f556fb6c-5911-4dc4-97a6-8ba183517058 tempest-LiveAutoBlockMigrationV225Test-1583891558 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.058s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 20:49:04.315551 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-9c34c6ab-02c6-44de-9c06-33843fdfff25 req-f556fb6c-5911-4dc4-97a6-8ba183517058 tempest-LiveAutoBlockMigrationV225Test-1583891558 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f50f8deb-cde1-4de6-b473-b0fdcc2d3e59', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': 'f50f8deb-cde1-4de6-b473-b0fdcc2d3e59', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 20:49:04.350587 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-9c34c6ab-02c6-44de-9c06-33843fdfff25 req-f556fb6c-5911-4dc4-97a6-8ba183517058 tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Connection info returned from driver {'name': 'volumes/volume-f50f8deb-cde1-4de6-b473-b0fdcc2d3e59', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f50f8deb-cde1-4de6-b473-b0fdcc2d3e59', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '62f1a9c8-ae10-49ff-9e69-d13491f65448'} {{(pid=122683) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 05 20:49:04.416196 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-9c34c6ab-02c6-44de-9c06-33843fdfff25 req-f556fb6c-5911-4dc4-97a6-8ba183517058 tempest-LiveAutoBlockMigrationV225Test-1583891558 None] attachment_update completed successfully. Feb 05 20:49:07.681910 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-b0cf6cec-38f0-4659-a40a-18bccc0596b5 req-334489e8-e304-49be-8af4-3f9531fa069e tempest-LiveMigrationTest-1996259675 None] Terminate volume connection completed successfully. Feb 05 20:49:07.682598 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-b0cf6cec-38f0-4659-a40a-18bccc0596b5 req-334489e8-e304-49be-8af4-3f9531fa069e tempest-LiveMigrationTest-1996259675 None] Deleting attachment dffaed68-6c97-44cf-9fe8-361af63d545e. {{(pid=122683) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 05 20:49:10.007223 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 20:49:10.016240 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 20:49:10.017138 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 20:49:10.044666 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Flow 'volume_create_manager' (30bdf9ce-8675-4e62-97f9-52484745ee28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 20:49:10.052491 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa7158f-1ac6-4dc6-8695-215848c1332c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:49:10.059194 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 20:49:10.076654 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa7158f-1ac6-4dc6-8695-215848c1332c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T20:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-356569794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=35445a36-a76c-48db-a9c5-3b58646c1e7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee5ceeb66aa4167b6492470edbad369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T20:49:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T20:49:10Z,use_quota=True,user_id='fbc2b85d6662472aa6a28563d2820c53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:49:10.082280 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (314621cd-38bf-4554-80a4-6b576e5b3687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:49:10.088109 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (314621cd-38bf-4554-80a4-6b576e5b3687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:49:10.095627 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aef96b33-2afd-4d33-901b-54dd5324eae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:49:10.220791 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aef96b33-2afd-4d33-901b-54dd5324eae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '35445a36-a76c-48db-a9c5-3b58646c1e7b', 'volume_name': 'volume-35445a36-a76c-48db-a9c5-3b58646c1e7b', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:49:10.226145 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb12739f-7e3e-4864-a160-e5e5276bd3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:49:10.231220 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb12739f-7e3e-4864-a160-e5e5276bd3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:49:10.236895 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a30d666-506e-414d-831a-4371252f2df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:49:10.238449 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Volume 35445a36-a76c-48db-a9c5-3b58646c1e7b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-35445a36-a76c-48db-a9c5-3b58646c1e7b', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 05 20:49:10.239108 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Cloning 35445a36-a76c-48db-a9c5-3b58646c1e7b from image e66a3a3b-d2f9-4d5d-8021-a6001dff419f at location (None, None). {{(pid=122683) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 05 20:49:10.248734 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Lock "b'cinder-e66a3a3b-d2f9-4d5d-8021-a6001dff419f'" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 20:49:10.257866 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Preparing cache entry for image = e66a3a3b-d2f9-4d5d-8021-a6001dff419f on host ncdv-master-1@ceph#ceph. {{(pid=122683) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Feb 05 20:49:10.259002 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Attempting to retrieve cache entry for image = e66a3a3b-d2f9-4d5d-8021-a6001dff419f on host ncdv-master-1@ceph#ceph. {{(pid=122683) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 05 20:49:11.175411 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-88790a7c-9ad7-4c71-a0ee-ef361ebfa57d req-b9f40794-2942-439c-adf2-6a0ce982fefc tempest-LiveAutoBlockMigrationV225Test-619588607 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 20:49:12.388873 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-88790a7c-9ad7-4c71-a0ee-ef361ebfa57d req-b9f40794-2942-439c-adf2-6a0ce982fefc tempest-LiveAutoBlockMigrationV225Test-619588607 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.213s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 20:49:12.397082 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-88790a7c-9ad7-4c71-a0ee-ef361ebfa57d req-b9f40794-2942-439c-adf2-6a0ce982fefc tempest-LiveAutoBlockMigrationV225Test-619588607 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f50f8deb-cde1-4de6-b473-b0fdcc2d3e59', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': 'f50f8deb-cde1-4de6-b473-b0fdcc2d3e59', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 20:49:12.462466 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-88790a7c-9ad7-4c71-a0ee-ef361ebfa57d req-b9f40794-2942-439c-adf2-6a0ce982fefc tempest-LiveAutoBlockMigrationV225Test-619588607 None] Connection info returned from driver {'name': 'volumes/volume-f50f8deb-cde1-4de6-b473-b0fdcc2d3e59', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f50f8deb-cde1-4de6-b473-b0fdcc2d3e59', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'e9f73039-36e9-483e-b943-803c38fc6f0a'} {{(pid=122683) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 05 20:49:12.542332 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-88790a7c-9ad7-4c71-a0ee-ef361ebfa57d req-b9f40794-2942-439c-adf2-6a0ce982fefc tempest-LiveAutoBlockMigrationV225Test-619588607 None] attachment_update completed successfully. Feb 05 20:49:27.522105 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-88790a7c-9ad7-4c71-a0ee-ef361ebfa57d req-52de7c62-a629-4978-8cb9-b80e1f663570 tempest-LiveAutoBlockMigrationV225Test-619588607 None] Terminate volume connection completed successfully. Feb 05 20:49:27.523580 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-88790a7c-9ad7-4c71-a0ee-ef361ebfa57d req-52de7c62-a629-4978-8cb9-b80e1f663570 tempest-LiveAutoBlockMigrationV225Test-619588607 None] Deleting attachment 62f1a9c8-ae10-49ff-9e69-d13491f65448. {{(pid=122683) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 05 20:49:28.596336 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.image_utils [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e66a3a3b-d2f9-4d5d-8021-a6001dff419f_6srg4b7qncdv-master-1@ceph, size 616.00 MB, duration 18.33 sec {{(pid=122683) fetch /opt/stack/cinder/cinder/image/image_utils.py:580}} Feb 05 20:49:28.597391 ncdv-master-1 cinder-volume[122683]: INFO cinder.image.image_utils [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Image download 616.00 MB at 33.60 MB/s Feb 05 20:49:28.649899 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_e66a3a3b-d2f9-4d5d-8021-a6001dff419f_6srg4b7qncdv-master-1@ceph {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 20:49:28.805892 ncdv-master-1 sudo[132275]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_e66a3a3b-d2f9-4d5d-8021-a6001dff419f_6srg4b7qncdv-master-1@ceph Feb 05 20:49:28.807141 ncdv-master-1 sudo[132275]: pam_unix(sudo:session): session opened for user root by (uid=0) Feb 05 20:49:30.874605 ncdv-master-1 sudo[132275]: pam_unix(sudo:session): session closed for user root Feb 05 20:49:30.877772 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_e66a3a3b-d2f9-4d5d-8021-a6001dff419f_6srg4b7qncdv-master-1@ceph" returned: 0 in 2.228s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 20:49:30.884469 ncdv-master-1 cinder-volume[122683]: WARNING py.warnings [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Feb 05 20:49:30.884469 ncdv-master-1 cinder-volume[122683]: debtcollector.deprecate( Feb 05 20:49:30.884469 ncdv-master-1 cinder-volume[122683]: Feb 05 20:49:30.885558 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.image_utils [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Temporary image e66a3a3b-d2f9-4d5d-8021-a6001dff419f is fetched for user fbc2b85d6662472aa6a28563d2820c53. {{(pid=122683) fetch /opt/stack/cinder/cinder/image/image_utils.py:1088}} Feb 05 20:49:30.973033 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_e66a3a3b-d2f9-4d5d-8021-a6001dff419f_6srg4b7qncdv-master-1@ceph {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 20:49:31.241918 ncdv-master-1 sudo[132354]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_e66a3a3b-d2f9-4d5d-8021-a6001dff419f_6srg4b7qncdv-master-1@ceph Feb 05 20:49:31.244413 ncdv-master-1 sudo[132354]: pam_unix(sudo:session): session opened for user root by (uid=0) Feb 05 20:49:33.088444 ncdv-master-1 sudo[132354]: pam_unix(sudo:session): session closed for user root Feb 05 20:49:33.091164 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_e66a3a3b-d2f9-4d5d-8021-a6001dff419f_6srg4b7qncdv-master-1@ceph" returned: 0 in 2.118s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 20:49:33.092226 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] creating volume 'volume-35445a36-a76c-48db-a9c5-3b58646c1e7b' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 20:49:33.095760 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:49:33.224806 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 20:49:33.225445 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 20:49:33.258840 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.volume_utils [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Attempting download of e66a3a3b-d2f9-4d5d-8021-a6001dff419f ((None, None)) to volume 35445a36-a76c-48db-a9c5-3b58646c1e7b. {{(pid=122683) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1228}} Feb 05 20:49:33.324974 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_e66a3a3b-d2f9-4d5d-8021-a6001dff419f_64w958v3 {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 20:49:33.526575 ncdv-master-1 sudo[132402]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_e66a3a3b-d2f9-4d5d-8021-a6001dff419f_64w958v3 Feb 05 20:49:33.528931 ncdv-master-1 sudo[132402]: pam_unix(sudo:session): session opened for user root by (uid=0) Feb 05 20:49:35.712378 ncdv-master-1 sudo[132402]: pam_unix(sudo:session): session closed for user root Feb 05 20:49:35.714739 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_e66a3a3b-d2f9-4d5d-8021-a6001dff419f_64w958v3" returned: 0 in 2.389s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 20:49:35.717238 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_e66a3a3b-d2f9-4d5d-8021-a6001dff419f_6srg4b7qncdv-master-1@ceph {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 20:49:35.843651 ncdv-master-1 sudo[132466]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_e66a3a3b-d2f9-4d5d-8021-a6001dff419f_6srg4b7qncdv-master-1@ceph Feb 05 20:49:35.845257 ncdv-master-1 sudo[132466]: pam_unix(sudo:session): session opened for user root by (uid=0) Feb 05 20:49:37.263516 ncdv-master-1 sudo[132466]: pam_unix(sudo:session): session closed for user root Feb 05 20:49:37.266587 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_e66a3a3b-d2f9-4d5d-8021-a6001dff419f_6srg4b7qncdv-master-1@ceph" returned: 0 in 1.549s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 20:49:37.268159 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.image_utils [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] e66a3a3b-d2f9-4d5d-8021-a6001dff419f was vhdx, converting to raw {{(pid=122683) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:793}} Feb 05 20:49:37.269454 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_e66a3a3b-d2f9-4d5d-8021-a6001dff419f_6srg4b7qncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpqrs6ijqq {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 20:49:37.292689 ncdv-master-1 sudo[132533]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_e66a3a3b-d2f9-4d5d-8021-a6001dff419f_6srg4b7qncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpqrs6ijqq Feb 05 20:49:37.294223 ncdv-master-1 sudo[132533]: pam_unix(sudo:session): session opened for user root by (uid=0) Feb 05 20:49:39.989705 ncdv-master-1 sudo[132533]: pam_unix(sudo:session): session closed for user root Feb 05 20:49:39.992003 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_e66a3a3b-d2f9-4d5d-8021-a6001dff419f_6srg4b7qncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpqrs6ijqq" returned: 0 in 2.722s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 20:49:39.993090 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_e66a3a3b-d2f9-4d5d-8021-a6001dff419f_6srg4b7qncdv-master-1@ceph {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 20:49:40.176613 ncdv-master-1 sudo[132583]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_e66a3a3b-d2f9-4d5d-8021-a6001dff419f_6srg4b7qncdv-master-1@ceph Feb 05 20:49:40.177494 ncdv-master-1 sudo[132583]: pam_unix(sudo:session): session opened for user root by (uid=0) Feb 05 20:49:41.954728 ncdv-master-1 sudo[132583]: pam_unix(sudo:session): session closed for user root Feb 05 20:49:41.957085 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_e66a3a3b-d2f9-4d5d-8021-a6001dff419f_6srg4b7qncdv-master-1@ceph" returned: 0 in 1.963s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 20:49:41.957751 ncdv-master-1 cinder-volume[122683]: WARNING py.warnings [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Feb 05 20:49:41.957751 ncdv-master-1 cinder-volume[122683]: debtcollector.deprecate( Feb 05 20:49:41.957751 ncdv-master-1 cinder-volume[122683]: Feb 05 20:49:41.958341 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.image_utils [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e66a3a3b-d2f9-4d5d-8021-a6001dff419f_6srg4b7qncdv-master-1@ceph, size 700.00 MB, duration 2.72 sec, destination /opt/stack/data/cinder/conversion/tmpqrs6ijqq {{(pid=122683) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:412}} Feb 05 20:49:41.958736 ncdv-master-1 cinder-volume[122683]: INFO cinder.image.image_utils [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Converted 700.00 MB image at 257.03 MB/s Feb 05 20:49:41.961427 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:49:42.100410 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 20:49:42.107808 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Volume volume-35445a36-a76c-48db-a9c5-3b58646c1e7b is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 20:49:42.130558 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] deleting rbd volume volume-35445a36-a76c-48db-a9c5-3b58646c1e7b {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 20:49:42.402145 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Running cmd (subprocess): rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmpqrs6ijqq volume-35445a36-a76c-48db-a9c5-3b58646c1e7b --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 20:49:47.473570 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] CMD "rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmpqrs6ijqq volume-35445a36-a76c-48db-a9c5-3b58646c1e7b --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 5.071s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 20:49:47.723903 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:49:47.864548 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 20:49:47.865082 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 20:49:47.865633 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.volume_utils [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Downloaded image e66a3a3b-d2f9-4d5d-8021-a6001dff419f ((None, None)) to volume 35445a36-a76c-48db-a9c5-3b58646c1e7b successfully. {{(pid=122683) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1268}} Feb 05 20:49:48.001271 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.image_utils [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Temporary image e66a3a3b-d2f9-4d5d-8021-a6001dff419f for user fbc2b85d6662472aa6a28563d2820c53 is deleted. {{(pid=122683) fetch /opt/stack/cinder/cinder/image/image_utils.py:1092}} Feb 05 20:49:48.087378 ncdv-master-1 cinder-volume[122683]: WARNING cinder.quota [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Deprecated: Default quota for resource: volumes_ceph is set by the default quota flag: quota_volumes_ceph, it is now deprecated. Please use the default quota class for default quota. Feb 05 20:49:48.088563 ncdv-master-1 cinder-volume[122683]: WARNING cinder.quota [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Deprecated: Default quota for resource: gigabytes_ceph is set by the default quota flag: quota_gigabytes_ceph, it is now deprecated. Please use the default quota class for default quota. Feb 05 20:49:48.210232 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Created reservations ['cacccb3a-2a51-413d-856d-735ca5a795ff', '1091eacb-a184-4640-8edc-5743da335851', 'fd975f20-bc75-44df-89dc-25e79cea3781', '4d8b2652-7e3a-4cd9-bf76-a1063e657db2'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 20:49:48.225259 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Creating image volume entry: {'provider_auth': None, 'metadata': {}, 'shared_targets': True, 'deleted': False, 'scheduled_at': datetime.datetime(2022, 2, 5, 20, 49, 10, tzinfo=datetime.timezone.utc), 'host': 'ncdv-master-1@ceph#ceph', 'cluster_name': None, 'project_id': '2f8b5d83bc3c46ed989f17b6ea4e7019', 'multiattach': False, 'volume_admin_metadata': [], 'display_description': None, 'replication_status': None, 'size': 1, 'provider_geometry': None, 'replication_extended_status': None, 'replication_driver_data': None, 'availability_zone': 'nova', 'provider_location': None, 'consistencygroup_id': None, 'volume_type_id': 'bd918ba1-430e-470e-856c-c1338a4b69f9', 'terminated_at': None, 'group_id': None, 'service_uuid': None, 'provider_id': None, 'bootable': False, 'volume_metadata': [], 'previous_status': None, 'updated_at': datetime.datetime(2022, 2, 5, 20, 49, 10, tzinfo=datetime.timezone.utc), 'display_name': 'image-e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'launched_at': None, 'ec2_id': None, 'volume_glance_metadata': [{'key': 'signature_verified', 'value': 'False'}], 'deleted_at': None, 'created_at': datetime.datetime(2022, 2, 5, 20, 49, 10, tzinfo=datetime.timezone.utc), 'user_id': 'fbc2b85d6662472aa6a28563d2820c53', 'encryption_key_id': None, 'attach_status': 'detached', 'status': 'creating', 'source_volid': '35445a36-a76c-48db-a9c5-3b58646c1e7b'}. {{(pid=122683) _clone_image_volume /opt/stack/cinder/cinder/volume/manager.py:1616}} Feb 05 20:49:48.308989 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Volume reschedule parameters: False retry: None {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 20:49:48.314051 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 20:49:48.314817 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 20:49:48.337048 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Flow 'volume_create_manager' (57ff2bbd-6472-4207-9374-632e8f3587fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 20:49:48.344389 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (740df9e4-97db-41b5-b4b0-370d43a4a4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:49:48.350685 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 20:49:48.367968 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (740df9e4-97db-41b5-b4b0-370d43a4a4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T20:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='image-e66a3a3b-d2f9-4d5d-8021-a6001dff419f',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=311ef4be-45fd-4167-a3ad-6251d56550a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f8b5d83bc3c46ed989f17b6ea4e7019',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T20:49:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=35445a36-a76c-48db-a9c5-3b58646c1e7b,status='creating',terminated_at=None,updated_at=2022-02-05T20:49:10Z,use_quota=True,user_id='fbc2b85d6662472aa6a28563d2820c53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:49:48.373682 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44d35bda-85a9-4dfe-b763-8c27fb86d7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:49:48.378191 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44d35bda-85a9-4dfe-b763-8c27fb86d7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:49:48.383654 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (722f98fe-645f-4f04-83f9-31d860bd0d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:49:48.400494 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (722f98fe-645f-4f04-83f9-31d860bd0d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '311ef4be-45fd-4167-a3ad-6251d56550a7', 'volume_name': 'volume-311ef4be-45fd-4167-a3ad-6251d56550a7', 'volume_size': 1, 'source_volid': '35445a36-a76c-48db-a9c5-3b58646c1e7b', 'source_volstatus': 'downloading'}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:49:48.407267 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28440911-5a80-407c-85d6-db0f13e09d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:49:48.410772 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28440911-5a80-407c-85d6-db0f13e09d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:49:48.415765 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46034d90-2ce5-4353-8f7a-72f3238726d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:49:48.416794 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Volume 311ef4be-45fd-4167-a3ad-6251d56550a7: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-311ef4be-45fd-4167-a3ad-6251d56550a7', 'volume_size': 1, 'source_volid': '35445a36-a76c-48db-a9c5-3b58646c1e7b', 'source_volstatus': 'downloading'} Feb 05 20:49:48.429038 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:49:48.489684 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] creating snapshot='volume-311ef4be-45fd-4167-a3ad-6251d56550a7.clone_snap' {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 05 20:49:48.653975 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] cloning 'volume-35445a36-a76c-48db-a9c5-3b58646c1e7b@volume-311ef4be-45fd-4167-a3ad-6251d56550a7.clone_snap' to 'volume-311ef4be-45fd-4167-a3ad-6251d56550a7' {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 05 20:49:48.792720 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Volume volume-35445a36-a76c-48db-a9c5-3b58646c1e7b is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 20:49:48.794439 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 20:49:48.794885 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 20:49:48.818720 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] clone created successfully {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 05 20:49:48.823626 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46034d90-2ce5-4353-8f7a-72f3238726d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-311ef4be-45fd-4167-a3ad-6251d56550a7', 'volume_size': 1, 'source_volid': '35445a36-a76c-48db-a9c5-3b58646c1e7b', 'source_volstatus': 'downloading'}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:49:48.830557 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dafbd88-963b-4061-863b-54d14c05ebf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:49:48.842679 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Volume volume-311ef4be-45fd-4167-a3ad-6251d56550a7 (311ef4be-45fd-4167-a3ad-6251d56550a7): created successfully Feb 05 20:49:48.847569 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dafbd88-963b-4061-863b-54d14c05ebf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:49:48.854082 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Flow 'volume_create_manager' (57ff2bbd-6472-4207-9374-632e8f3587fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 20:49:48.864294 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Created volume successfully. Feb 05 20:49:48.969685 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Creating new image-volume cache entry for image e66a3a3b-d2f9-4d5d-8021-a6001dff419f on ncdv-master-1@ceph#ceph {{(pid=122683) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:104}} Feb 05 20:49:48.985102 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] New image-volume cache entry created: {'id': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'volume_id': '311ef4be-45fd-4167-a3ad-6251d56550a7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57), 'last_used': datetime.datetime(2022, 2, 5, 20, 49, 48, 975825)}. {{(pid=122683) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:129}} Feb 05 20:49:48.992609 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Lock "b'cinder-e66a3a3b-d2f9-4d5d-8021-a6001dff419f'" released by "_prepare_image_cache_entry" :: held 38.744s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 20:49:48.993412 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.volume_utils [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Marking volume 35445a36-a76c-48db-a9c5-3b58646c1e7b as bootable. {{(pid=122683) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Feb 05 20:49:49.006597 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Copying metadata from image e66a3a3b-d2f9-4d5d-8021-a6001dff419f to 35445a36-a76c-48db-a9c5-3b58646c1e7b. {{(pid=122683) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 05 20:49:49.007287 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Creating volume glance metadata for volume 35445a36-a76c-48db-a9c5-3b58646c1e7b backed by image e66a3a3b-d2f9-4d5d-8021-a6001dff419f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=122683) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 05 20:49:49.097383 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a30d666-506e-414d-831a-4371252f2df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35445a36-a76c-48db-a9c5-3b58646c1e7b', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:49:49.114085 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aec3e97a-4636-4592-a2da-c38d92b800a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:49:49.133307 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Volume volume-35445a36-a76c-48db-a9c5-3b58646c1e7b (35445a36-a76c-48db-a9c5-3b58646c1e7b): created successfully Feb 05 20:49:49.137412 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aec3e97a-4636-4592-a2da-c38d92b800a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:49:49.160468 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Flow 'volume_create_manager' (30bdf9ce-8675-4e62-97f9-52484745ee28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 20:49:49.191194 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-1b02e64c-0c1e-4dac-8969-a147d8eac39f tempest-LiveMigrationTest-1996259675 None] Created volume successfully. Feb 05 20:49:50.094876 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-26c5b73f-d0a9-4146-849b-cbc96f42abb4 req-60827f8a-56cd-4019-a0c5-3363cc6f604c tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Terminate volume connection completed successfully. Feb 05 20:49:50.095605 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-26c5b73f-d0a9-4146-849b-cbc96f42abb4 req-60827f8a-56cd-4019-a0c5-3363cc6f604c tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Deleting attachment e9f73039-36e9-483e-b943-803c38fc6f0a. {{(pid=122683) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 05 20:49:52.417719 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 20:49:52.418638 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:49:52.483368 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:49:52.550168 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 20:49:53.426197 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-61faeeda-58e8-4fac-b895-a73d5835889c tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 20:49:53.431941 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-61faeeda-58e8-4fac-b895-a73d5835889c tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 20:49:53.432713 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-61faeeda-58e8-4fac-b895-a73d5835889c tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 20:49:53.468840 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-61faeeda-58e8-4fac-b895-a73d5835889c tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Flow 'volume_create_manager' (16ed5672-db89-407b-833f-8508789e58f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 20:49:53.478014 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-61faeeda-58e8-4fac-b895-a73d5835889c tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49e19040-c35f-4568-9b11-8c28d1d1d71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:49:53.494027 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-61faeeda-58e8-4fac-b895-a73d5835889c tempest-LiveAutoBlockMigrationV225Test-1583891558 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 20:49:53.510262 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-61faeeda-58e8-4fac-b895-a73d5835889c tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49e19040-c35f-4568-9b11-8c28d1d1d71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T20:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1142990273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9ddefd89-33c8-46af-8473-0e609beafe6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e4e31092ef641efbf6eaf54cfa40d67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T20:49:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T20:49:53Z,use_quota=True,user_id='ecf60934d79e4ae89c65c1fdd6086fe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:49:53.518903 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-61faeeda-58e8-4fac-b895-a73d5835889c tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab24a501-46a1-418d-b7e8-dbb260b11518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:49:53.525064 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-61faeeda-58e8-4fac-b895-a73d5835889c tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab24a501-46a1-418d-b7e8-dbb260b11518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:49:53.534722 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-61faeeda-58e8-4fac-b895-a73d5835889c tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7c1d39a-cc9e-4ba6-bf15-08e9ba0158c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:49:53.649524 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-61faeeda-58e8-4fac-b895-a73d5835889c tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7c1d39a-cc9e-4ba6-bf15-08e9ba0158c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9ddefd89-33c8-46af-8473-0e609beafe6f', 'volume_name': 'volume-9ddefd89-33c8-46af-8473-0e609beafe6f', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:49:53.679082 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-61faeeda-58e8-4fac-b895-a73d5835889c tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97a2621b-a960-429a-b4e5-8fd0b603af85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:49:53.705189 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-61faeeda-58e8-4fac-b895-a73d5835889c tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97a2621b-a960-429a-b4e5-8fd0b603af85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:49:53.723558 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-61faeeda-58e8-4fac-b895-a73d5835889c tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (596a4974-67db-454e-8507-6d90eb2c7dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:49:53.724769 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-61faeeda-58e8-4fac-b895-a73d5835889c tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Volume 9ddefd89-33c8-46af-8473-0e609beafe6f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9ddefd89-33c8-46af-8473-0e609beafe6f', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 05 20:49:53.725344 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-61faeeda-58e8-4fac-b895-a73d5835889c tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Cloning 9ddefd89-33c8-46af-8473-0e609beafe6f from image e66a3a3b-d2f9-4d5d-8021-a6001dff419f at location (None, None). {{(pid=122683) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 05 20:49:53.763215 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-61faeeda-58e8-4fac-b895-a73d5835889c tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Lock "b'cinder-e66a3a3b-d2f9-4d5d-8021-a6001dff419f'" acquired by "_prepare_image_cache_entry" :: waited 0.037s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 20:49:53.783785 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-61faeeda-58e8-4fac-b895-a73d5835889c tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'volume_id': '311ef4be-45fd-4167-a3ad-6251d56550a7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57), 'last_used': datetime.datetime(2022, 2, 5, 20, 49, 53, 775278)}. {{(pid=122683) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 05 20:49:53.784532 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-61faeeda-58e8-4fac-b895-a73d5835889c tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Image-volume cache entry image_update_at = 2022-02-05 20:37:57+00:00, requested image updated_at = 2022-02-05 20:37:57+00:00. {{(pid=122683) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 05 20:49:53.785096 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-61faeeda-58e8-4fac-b895-a73d5835889c tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Found cache entry for image = e66a3a3b-d2f9-4d5d-8021-a6001dff419f on host ncdv-master-1@ceph#ceph. {{(pid=122683) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Feb 05 20:49:53.790605 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-61faeeda-58e8-4fac-b895-a73d5835889c tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Lock "b'cinder-e66a3a3b-d2f9-4d5d-8021-a6001dff419f'" released by "_prepare_image_cache_entry" :: held 0.027s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 20:49:53.791863 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-61faeeda-58e8-4fac-b895-a73d5835889c tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Attempting to retrieve cache entry for image = e66a3a3b-d2f9-4d5d-8021-a6001dff419f on host ncdv-master-1@ceph#ceph. {{(pid=122683) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 05 20:49:53.806875 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-61faeeda-58e8-4fac-b895-a73d5835889c tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'volume_id': '311ef4be-45fd-4167-a3ad-6251d56550a7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57), 'last_used': datetime.datetime(2022, 2, 5, 20, 49, 53, 803886)}. {{(pid=122683) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 05 20:49:53.808327 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-61faeeda-58e8-4fac-b895-a73d5835889c tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Image-volume cache entry image_update_at = 2022-02-05 20:37:57+00:00, requested image updated_at = 2022-02-05 20:37:57+00:00. {{(pid=122683) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 05 20:49:53.809082 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-61faeeda-58e8-4fac-b895-a73d5835889c tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Creating from source image-volume 311ef4be-45fd-4167-a3ad-6251d56550a7 {{(pid=122683) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Feb 05 20:49:53.831144 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-61faeeda-58e8-4fac-b895-a73d5835889c tempest-LiveAutoBlockMigrationV225Test-1583891558 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:49:53.967591 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-61faeeda-58e8-4fac-b895-a73d5835889c tempest-LiveAutoBlockMigrationV225Test-1583891558 None] creating snapshot='volume-9ddefd89-33c8-46af-8473-0e609beafe6f.clone_snap' {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 05 20:49:54.973764 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-61faeeda-58e8-4fac-b895-a73d5835889c tempest-LiveAutoBlockMigrationV225Test-1583891558 None] cloning 'volume-311ef4be-45fd-4167-a3ad-6251d56550a7@volume-9ddefd89-33c8-46af-8473-0e609beafe6f.clone_snap' to 'volume-9ddefd89-33c8-46af-8473-0e609beafe6f' {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 05 20:49:55.023426 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-8f346416-6461-4417-93e1-0dec6ab39733 req-05995a5f-54d2-4070-a7ef-ec67ced9fcb6 tempest-LiveMigrationTest-1996259675 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 20:49:55.189528 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-61faeeda-58e8-4fac-b895-a73d5835889c tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Volume volume-35445a36-a76c-48db-a9c5-3b58646c1e7b is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 20:49:55.190882 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-61faeeda-58e8-4fac-b895-a73d5835889c tempest-LiveAutoBlockMigrationV225Test-1583891558 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 20:49:55.191720 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-61faeeda-58e8-4fac-b895-a73d5835889c tempest-LiveAutoBlockMigrationV225Test-1583891558 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 20:49:55.243898 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-61faeeda-58e8-4fac-b895-a73d5835889c tempest-LiveAutoBlockMigrationV225Test-1583891558 None] clone created successfully {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 05 20:49:55.245463 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.volume_utils [None req-61faeeda-58e8-4fac-b895-a73d5835889c tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Marking volume 9ddefd89-33c8-46af-8473-0e609beafe6f as bootable. {{(pid=122683) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Feb 05 20:49:55.265664 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-61faeeda-58e8-4fac-b895-a73d5835889c tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Copying metadata from image e66a3a3b-d2f9-4d5d-8021-a6001dff419f to 9ddefd89-33c8-46af-8473-0e609beafe6f. {{(pid=122683) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 05 20:49:55.266469 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-61faeeda-58e8-4fac-b895-a73d5835889c tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Creating volume glance metadata for volume 9ddefd89-33c8-46af-8473-0e609beafe6f backed by image e66a3a3b-d2f9-4d5d-8021-a6001dff419f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=122683) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 05 20:49:55.356667 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-61faeeda-58e8-4fac-b895-a73d5835889c tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (596a4974-67db-454e-8507-6d90eb2c7dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ddefd89-33c8-46af-8473-0e609beafe6f', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:49:55.368725 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-61faeeda-58e8-4fac-b895-a73d5835889c tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (899c4c87-d264-4954-8cae-d61555a6e2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:49:55.382072 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-61faeeda-58e8-4fac-b895-a73d5835889c tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Volume volume-9ddefd89-33c8-46af-8473-0e609beafe6f (9ddefd89-33c8-46af-8473-0e609beafe6f): created successfully Feb 05 20:49:55.386711 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-61faeeda-58e8-4fac-b895-a73d5835889c tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (899c4c87-d264-4954-8cae-d61555a6e2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:49:55.393776 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-61faeeda-58e8-4fac-b895-a73d5835889c tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Flow 'volume_create_manager' (16ed5672-db89-407b-833f-8508789e58f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 20:49:55.406520 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-61faeeda-58e8-4fac-b895-a73d5835889c tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Created volume successfully. Feb 05 20:49:55.996426 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-8f346416-6461-4417-93e1-0dec6ab39733 req-05995a5f-54d2-4070-a7ef-ec67ced9fcb6 tempest-LiveMigrationTest-1996259675 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.973s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 20:49:55.997085 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-8f346416-6461-4417-93e1-0dec6ab39733 req-05995a5f-54d2-4070-a7ef-ec67ced9fcb6 tempest-LiveMigrationTest-1996259675 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-35445a36-a76c-48db-a9c5-3b58646c1e7b', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': '35445a36-a76c-48db-a9c5-3b58646c1e7b', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 20:49:56.038933 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-8f346416-6461-4417-93e1-0dec6ab39733 req-05995a5f-54d2-4070-a7ef-ec67ced9fcb6 tempest-LiveMigrationTest-1996259675 None] Connection info returned from driver {'name': 'volumes/volume-35445a36-a76c-48db-a9c5-3b58646c1e7b', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '35445a36-a76c-48db-a9c5-3b58646c1e7b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '842d5e3c-ed9b-4935-85c3-48cad70a8547'} {{(pid=122683) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 05 20:49:56.125135 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-8f346416-6461-4417-93e1-0dec6ab39733 req-05995a5f-54d2-4070-a7ef-ec67ced9fcb6 tempest-LiveMigrationTest-1996259675 None] attachment_update completed successfully. Feb 05 20:50:00.711778 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-49dedbf4-315b-4926-b90e-a7f8ed6746ac req-589aeac3-794e-44c3-bafc-32f312565462 tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 20:50:02.005450 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-49dedbf4-315b-4926-b90e-a7f8ed6746ac req-589aeac3-794e-44c3-bafc-32f312565462 tempest-LiveAutoBlockMigrationV225Test-1583891558 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.294s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 20:50:02.007250 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-49dedbf4-315b-4926-b90e-a7f8ed6746ac req-589aeac3-794e-44c3-bafc-32f312565462 tempest-LiveAutoBlockMigrationV225Test-1583891558 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9ddefd89-33c8-46af-8473-0e609beafe6f', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': '9ddefd89-33c8-46af-8473-0e609beafe6f', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 20:50:02.050752 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-49dedbf4-315b-4926-b90e-a7f8ed6746ac req-589aeac3-794e-44c3-bafc-32f312565462 tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Connection info returned from driver {'name': 'volumes/volume-9ddefd89-33c8-46af-8473-0e609beafe6f', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '9ddefd89-33c8-46af-8473-0e609beafe6f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ec7dd3be-8f88-466d-af15-06986643ade6'} {{(pid=122683) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 05 20:50:02.169828 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-49dedbf4-315b-4926-b90e-a7f8ed6746ac req-589aeac3-794e-44c3-bafc-32f312565462 tempest-LiveAutoBlockMigrationV225Test-1583891558 None] attachment_update completed successfully. Feb 05 20:50:23.480160 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-7bd7c46f-6460-4f57-80ce-b616bc22656d req-905e41ed-583f-475d-b838-5a2a0976707a tempest-LiveMigrationTest-1855252981 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 20:50:24.330355 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-7bd7c46f-6460-4f57-80ce-b616bc22656d req-905e41ed-583f-475d-b838-5a2a0976707a tempest-LiveMigrationTest-1855252981 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.849s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 20:50:24.331679 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-7bd7c46f-6460-4f57-80ce-b616bc22656d req-905e41ed-583f-475d-b838-5a2a0976707a tempest-LiveMigrationTest-1855252981 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-35445a36-a76c-48db-a9c5-3b58646c1e7b', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': '35445a36-a76c-48db-a9c5-3b58646c1e7b', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 20:50:24.370059 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-7bd7c46f-6460-4f57-80ce-b616bc22656d req-905e41ed-583f-475d-b838-5a2a0976707a tempest-LiveMigrationTest-1855252981 None] Connection info returned from driver {'name': 'volumes/volume-35445a36-a76c-48db-a9c5-3b58646c1e7b', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '35445a36-a76c-48db-a9c5-3b58646c1e7b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f164ffa8-5287-422c-bfd2-d42119d349d4'} {{(pid=122683) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 05 20:50:24.439293 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-7bd7c46f-6460-4f57-80ce-b616bc22656d req-905e41ed-583f-475d-b838-5a2a0976707a tempest-LiveMigrationTest-1855252981 None] attachment_update completed successfully. Feb 05 20:50:29.744771 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-31d3f5ba-6873-4d30-8bc2-e8997369aaef req-07f72053-310a-4472-896c-2868a75936c1 tempest-LiveAutoBlockMigrationV225Test-619588607 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 20:50:30.476542 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-31d3f5ba-6873-4d30-8bc2-e8997369aaef req-07f72053-310a-4472-896c-2868a75936c1 tempest-LiveAutoBlockMigrationV225Test-619588607 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.731s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 20:50:30.477803 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-31d3f5ba-6873-4d30-8bc2-e8997369aaef req-07f72053-310a-4472-896c-2868a75936c1 tempest-LiveAutoBlockMigrationV225Test-619588607 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9ddefd89-33c8-46af-8473-0e609beafe6f', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': '9ddefd89-33c8-46af-8473-0e609beafe6f', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 20:50:30.500167 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-31d3f5ba-6873-4d30-8bc2-e8997369aaef req-07f72053-310a-4472-896c-2868a75936c1 tempest-LiveAutoBlockMigrationV225Test-619588607 None] Connection info returned from driver {'name': 'volumes/volume-9ddefd89-33c8-46af-8473-0e609beafe6f', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '9ddefd89-33c8-46af-8473-0e609beafe6f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '82dd6c82-2ce2-4c04-ac7c-e7e4015d4e01'} {{(pid=122683) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 05 20:50:30.553397 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-31d3f5ba-6873-4d30-8bc2-e8997369aaef req-07f72053-310a-4472-896c-2868a75936c1 tempest-LiveAutoBlockMigrationV225Test-619588607 None] attachment_update completed successfully. Feb 05 20:50:33.487899 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-7bd7c46f-6460-4f57-80ce-b616bc22656d req-ea6dc18e-2271-4a94-a5d8-645d429c02c5 tempest-LiveMigrationTest-1855252981 None] Terminate volume connection completed successfully. Feb 05 20:50:33.489197 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-7bd7c46f-6460-4f57-80ce-b616bc22656d req-ea6dc18e-2271-4a94-a5d8-645d429c02c5 tempest-LiveMigrationTest-1855252981 None] Deleting attachment 842d5e3c-ed9b-4935-85c3-48cad70a8547. {{(pid=122683) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 05 20:50:38.726191 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1a8cab1-0449-46a7-af90-4ec36c2ad80d tempest-DeleteServersTestJSON-1701972944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 20:50:38.730728 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-b1a8cab1-0449-46a7-af90-4ec36c2ad80d tempest-DeleteServersTestJSON-1701972944 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 20:50:38.731279 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-b1a8cab1-0449-46a7-af90-4ec36c2ad80d tempest-DeleteServersTestJSON-1701972944 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 20:50:38.754865 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b1a8cab1-0449-46a7-af90-4ec36c2ad80d tempest-DeleteServersTestJSON-1701972944 None] Flow 'volume_create_manager' (344fa7f5-9ebd-48f6-8c23-64136f7ac3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 20:50:38.762190 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b1a8cab1-0449-46a7-af90-4ec36c2ad80d tempest-DeleteServersTestJSON-1701972944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7525eec6-ac5c-4fb9-9256-e610fe7bdd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:50:38.769055 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-b1a8cab1-0449-46a7-af90-4ec36c2ad80d tempest-DeleteServersTestJSON-1701972944 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 20:50:38.784224 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b1a8cab1-0449-46a7-af90-4ec36c2ad80d tempest-DeleteServersTestJSON-1701972944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7525eec6-ac5c-4fb9-9256-e610fe7bdd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T20:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1193677583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a1062aa8-5581-42b7-baba-7502c9bd2044,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d100b9cbd5c471aa5036a7a90989a49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T20:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T20:50:39Z,use_quota=True,user_id='35fcf28dd7f84217abbbd39fb1ebd51d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:50:38.789835 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b1a8cab1-0449-46a7-af90-4ec36c2ad80d tempest-DeleteServersTestJSON-1701972944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2770bafb-34ec-40e7-ad8c-761f8d05824b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:50:38.794753 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b1a8cab1-0449-46a7-af90-4ec36c2ad80d tempest-DeleteServersTestJSON-1701972944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2770bafb-34ec-40e7-ad8c-761f8d05824b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:50:38.800644 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b1a8cab1-0449-46a7-af90-4ec36c2ad80d tempest-DeleteServersTestJSON-1701972944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96a4c711-cb08-46f5-bde5-9243012519f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:50:38.805024 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b1a8cab1-0449-46a7-af90-4ec36c2ad80d tempest-DeleteServersTestJSON-1701972944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96a4c711-cb08-46f5-bde5-9243012519f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1062aa8-5581-42b7-baba-7502c9bd2044', 'volume_name': 'volume-a1062aa8-5581-42b7-baba-7502c9bd2044', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:50:38.812086 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b1a8cab1-0449-46a7-af90-4ec36c2ad80d tempest-DeleteServersTestJSON-1701972944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (579a8660-c9ec-4e3c-9ffc-da6224c9808f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:50:38.816685 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b1a8cab1-0449-46a7-af90-4ec36c2ad80d tempest-DeleteServersTestJSON-1701972944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (579a8660-c9ec-4e3c-9ffc-da6224c9808f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:50:38.822213 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b1a8cab1-0449-46a7-af90-4ec36c2ad80d tempest-DeleteServersTestJSON-1701972944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8b4f311-ffee-4da0-a7f5-2160e5d812d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:50:38.823427 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-b1a8cab1-0449-46a7-af90-4ec36c2ad80d tempest-DeleteServersTestJSON-1701972944 None] Volume a1062aa8-5581-42b7-baba-7502c9bd2044: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1062aa8-5581-42b7-baba-7502c9bd2044', 'volume_size': 1} Feb 05 20:50:38.823948 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-b1a8cab1-0449-46a7-af90-4ec36c2ad80d tempest-DeleteServersTestJSON-1701972944 None] creating volume 'volume-a1062aa8-5581-42b7-baba-7502c9bd2044' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 20:50:38.825283 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-b1a8cab1-0449-46a7-af90-4ec36c2ad80d tempest-DeleteServersTestJSON-1701972944 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:50:38.900264 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-b1a8cab1-0449-46a7-af90-4ec36c2ad80d tempest-DeleteServersTestJSON-1701972944 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 20:50:38.900651 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-b1a8cab1-0449-46a7-af90-4ec36c2ad80d tempest-DeleteServersTestJSON-1701972944 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 20:50:38.904446 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b1a8cab1-0449-46a7-af90-4ec36c2ad80d tempest-DeleteServersTestJSON-1701972944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8b4f311-ffee-4da0-a7f5-2160e5d812d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1062aa8-5581-42b7-baba-7502c9bd2044', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:50:38.909130 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b1a8cab1-0449-46a7-af90-4ec36c2ad80d tempest-DeleteServersTestJSON-1701972944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11f0e87d-1b56-466b-a8fc-d9afbeb3a475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:50:38.920423 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-b1a8cab1-0449-46a7-af90-4ec36c2ad80d tempest-DeleteServersTestJSON-1701972944 None] Volume volume-a1062aa8-5581-42b7-baba-7502c9bd2044 (a1062aa8-5581-42b7-baba-7502c9bd2044): created successfully Feb 05 20:50:38.927626 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b1a8cab1-0449-46a7-af90-4ec36c2ad80d tempest-DeleteServersTestJSON-1701972944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11f0e87d-1b56-466b-a8fc-d9afbeb3a475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:50:38.934677 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b1a8cab1-0449-46a7-af90-4ec36c2ad80d tempest-DeleteServersTestJSON-1701972944 None] Flow 'volume_create_manager' (344fa7f5-9ebd-48f6-8c23-64136f7ac3d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 20:50:38.952641 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-b1a8cab1-0449-46a7-af90-4ec36c2ad80d tempest-DeleteServersTestJSON-1701972944 None] Created volume successfully. Feb 05 20:50:40.238789 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-4e6795c7-d1f9-4c6c-866a-105f2a2b9904 req-06b32dc0-d05d-4980-a97a-1e9d97e03911 tempest-DeleteServersTestJSON-1701972944 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 20:50:40.915072 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-4e6795c7-d1f9-4c6c-866a-105f2a2b9904 req-06b32dc0-d05d-4980-a97a-1e9d97e03911 tempest-DeleteServersTestJSON-1701972944 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.676s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 20:50:40.916154 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-4e6795c7-d1f9-4c6c-866a-105f2a2b9904 req-06b32dc0-d05d-4980-a97a-1e9d97e03911 tempest-DeleteServersTestJSON-1701972944 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a1062aa8-5581-42b7-baba-7502c9bd2044', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': 'a1062aa8-5581-42b7-baba-7502c9bd2044', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 20:50:40.940503 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-4e6795c7-d1f9-4c6c-866a-105f2a2b9904 req-06b32dc0-d05d-4980-a97a-1e9d97e03911 tempest-DeleteServersTestJSON-1701972944 None] Connection info returned from driver {'name': 'volumes/volume-a1062aa8-5581-42b7-baba-7502c9bd2044', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a1062aa8-5581-42b7-baba-7502c9bd2044', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '9df5c72f-1106-450a-9082-314eda60e4a7'} {{(pid=122683) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 05 20:50:41.001171 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-4e6795c7-d1f9-4c6c-866a-105f2a2b9904 req-06b32dc0-d05d-4980-a97a-1e9d97e03911 tempest-DeleteServersTestJSON-1701972944 None] attachment_update completed successfully. Feb 05 20:50:41.465768 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-75b59a51-6f43-47d9-b9bf-3dda1a384f1d req-f0e37f9f-7acb-428c-af8f-9b8120f271c5 tempest-LiveMigrationTest-1996259675 None] Terminate volume connection completed successfully. Feb 05 20:50:41.466456 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-75b59a51-6f43-47d9-b9bf-3dda1a384f1d req-f0e37f9f-7acb-428c-af8f-9b8120f271c5 tempest-LiveMigrationTest-1996259675 None] Deleting attachment f164ffa8-5287-422c-bfd2-d42119d349d4. {{(pid=122683) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 05 20:50:41.626438 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [req-75b59a51-6f43-47d9-b9bf-3dda1a384f1d req-b1067487-de99-4888-a2dc-ae36ccb639e0 tempest-LiveMigrationTest-1996259675 None] Lock "b'cinder-35445a36-a76c-48db-a9c5-3b58646c1e7b-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 20:50:41.660983 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-75b59a51-6f43-47d9-b9bf-3dda1a384f1d req-b1067487-de99-4888-a2dc-ae36ccb639e0 tempest-LiveMigrationTest-1996259675 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:50:41.731393 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-75b59a51-6f43-47d9-b9bf-3dda1a384f1d req-b1067487-de99-4888-a2dc-ae36ccb639e0 tempest-LiveMigrationTest-1996259675 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 20:50:41.731775 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-75b59a51-6f43-47d9-b9bf-3dda1a384f1d req-b1067487-de99-4888-a2dc-ae36ccb639e0 tempest-LiveMigrationTest-1996259675 None] volume has clone snapshot(s) {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1208}} Feb 05 20:50:41.738927 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-75b59a51-6f43-47d9-b9bf-3dda1a384f1d req-b1067487-de99-4888-a2dc-ae36ccb639e0 tempest-LiveMigrationTest-1996259675 None] Volume volume-35445a36-a76c-48db-a9c5-3b58646c1e7b is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 20:50:41.877143 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [req-75b59a51-6f43-47d9-b9bf-3dda1a384f1d req-b1067487-de99-4888-a2dc-ae36ccb639e0 tempest-LiveMigrationTest-1996259675 None] Created reservations ['9995e7bb-516d-4a94-a454-bb4eda27e827', '917243f4-0816-4978-9040-e1222585367a', '76060d9d-3bff-46be-8d28-750edeb6f2c5', '5c4045eb-63a4-4f73-8300-d9dda04a808e'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 20:50:41.937700 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-75b59a51-6f43-47d9-b9bf-3dda1a384f1d req-b1067487-de99-4888-a2dc-ae36ccb639e0 tempest-LiveMigrationTest-1996259675 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:50:41.962426 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-75b59a51-6f43-47d9-b9bf-3dda1a384f1d req-b1067487-de99-4888-a2dc-ae36ccb639e0 tempest-LiveMigrationTest-1996259675 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:50:41.988480 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [req-75b59a51-6f43-47d9-b9bf-3dda1a384f1d req-b1067487-de99-4888-a2dc-ae36ccb639e0 tempest-LiveMigrationTest-1996259675 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 20:50:41.992841 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-75b59a51-6f43-47d9-b9bf-3dda1a384f1d req-b1067487-de99-4888-a2dc-ae36ccb639e0 tempest-LiveMigrationTest-1996259675 None] Deleted volume successfully. Feb 05 20:50:42.015701 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [req-75b59a51-6f43-47d9-b9bf-3dda1a384f1d req-b1067487-de99-4888-a2dc-ae36ccb639e0 tempest-LiveMigrationTest-1996259675 None] Lock "b'cinder-35445a36-a76c-48db-a9c5-3b58646c1e7b-delete_volume'" released by "delete_volume" :: held 0.389s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 20:50:42.099533 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-cd5a0a7d-b1be-4d11-b91c-b9f8e488f7c9 tempest-LiveMigrationTest-1996259675 None] Lock "b'cinder-bb7c14e5-2e62-497c-88ad-58ffc5b820ad-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 20:50:42.131923 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-cd5a0a7d-b1be-4d11-b91c-b9f8e488f7c9 tempest-LiveMigrationTest-1996259675 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:50:42.175766 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-cd5a0a7d-b1be-4d11-b91c-b9f8e488f7c9 tempest-LiveMigrationTest-1996259675 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 20:50:42.176221 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-cd5a0a7d-b1be-4d11-b91c-b9f8e488f7c9 tempest-LiveMigrationTest-1996259675 None] Volume volume-bb7c14e5-2e62-497c-88ad-58ffc5b820ad is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 20:50:42.181592 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-cd5a0a7d-b1be-4d11-b91c-b9f8e488f7c9 tempest-LiveMigrationTest-1996259675 None] deleting rbd volume volume-bb7c14e5-2e62-497c-88ad-58ffc5b820ad {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 20:50:42.404670 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-cd5a0a7d-b1be-4d11-b91c-b9f8e488f7c9 tempest-LiveMigrationTest-1996259675 None] Created reservations ['8ec64fc2-1405-43fc-b157-9cee463a791d', '26653335-60ce-41f2-bfd4-9569000e3dcb', 'd75d9239-efd4-448e-b11b-0765d9635b3e', '38ed28ec-9255-4c4c-8fee-7129eb08dbe9'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 20:50:42.445862 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-cd5a0a7d-b1be-4d11-b91c-b9f8e488f7c9 tempest-LiveMigrationTest-1996259675 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:50:42.476922 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-cd5a0a7d-b1be-4d11-b91c-b9f8e488f7c9 tempest-LiveMigrationTest-1996259675 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:50:42.502772 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-cd5a0a7d-b1be-4d11-b91c-b9f8e488f7c9 tempest-LiveMigrationTest-1996259675 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 20:50:42.507275 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-cd5a0a7d-b1be-4d11-b91c-b9f8e488f7c9 tempest-LiveMigrationTest-1996259675 None] Deleted volume successfully. Feb 05 20:50:42.519195 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-cd5a0a7d-b1be-4d11-b91c-b9f8e488f7c9 tempest-LiveMigrationTest-1996259675 None] Lock "b'cinder-bb7c14e5-2e62-497c-88ad-58ffc5b820ad-delete_volume'" released by "delete_volume" :: held 0.420s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 20:50:48.466844 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-34ded208-50cf-4637-8a8a-07d10000d26d req-ab77ea78-e5b7-4de8-99ea-063e4dd00009 tempest-DeleteServersTestJSON-1701972944 None] Terminate volume connection completed successfully. Feb 05 20:50:48.467500 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-34ded208-50cf-4637-8a8a-07d10000d26d req-ab77ea78-e5b7-4de8-99ea-063e4dd00009 tempest-DeleteServersTestJSON-1701972944 None] Deleting attachment 9df5c72f-1106-450a-9082-314eda60e4a7. {{(pid=122683) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 05 20:50:52.418497 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 20:50:52.419797 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:50:52.443868 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:50:52.470173 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 20:51:01.296501 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-31d3f5ba-6873-4d30-8bc2-e8997369aaef req-3cf26b8c-6102-4ebd-8d88-3a0d4eb2b0d4 tempest-LiveAutoBlockMigrationV225Test-619588607 None] Terminate volume connection completed successfully. Feb 05 20:51:01.297251 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-31d3f5ba-6873-4d30-8bc2-e8997369aaef req-3cf26b8c-6102-4ebd-8d88-3a0d4eb2b0d4 tempest-LiveAutoBlockMigrationV225Test-619588607 None] Deleting attachment 82dd6c82-2ce2-4c04-ac7c-e7e4015d4e01. {{(pid=122683) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 05 20:51:10.319380 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-1b0d32ce-630a-4daf-9bf5-bfde0d8b1006 req-55e4944f-5a7b-4b2f-8590-cd4639feddec tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Terminate volume connection completed successfully. Feb 05 20:51:10.320675 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-1b0d32ce-630a-4daf-9bf5-bfde0d8b1006 req-55e4944f-5a7b-4b2f-8590-cd4639feddec tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Deleting attachment ec7dd3be-8f88-466d-af15-06986643ade6. {{(pid=122683) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 05 20:51:10.546700 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [req-1b0d32ce-630a-4daf-9bf5-bfde0d8b1006 req-4c8f460f-edc3-4399-8031-7e3c9052e307 tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Lock "b'cinder-9ddefd89-33c8-46af-8473-0e609beafe6f-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 20:51:10.643036 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-1b0d32ce-630a-4daf-9bf5-bfde0d8b1006 req-4c8f460f-edc3-4399-8031-7e3c9052e307 tempest-LiveAutoBlockMigrationV225Test-1583891558 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:51:10.777708 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-1b0d32ce-630a-4daf-9bf5-bfde0d8b1006 req-4c8f460f-edc3-4399-8031-7e3c9052e307 tempest-LiveAutoBlockMigrationV225Test-1583891558 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 20:51:10.798510 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-1b0d32ce-630a-4daf-9bf5-bfde0d8b1006 req-4c8f460f-edc3-4399-8031-7e3c9052e307 tempest-LiveAutoBlockMigrationV225Test-1583891558 None] deleting rbd volume volume-9ddefd89-33c8-46af-8473-0e609beafe6f {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 20:51:11.189468 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-1b0d32ce-630a-4daf-9bf5-bfde0d8b1006 req-4c8f460f-edc3-4399-8031-7e3c9052e307 tempest-LiveAutoBlockMigrationV225Test-1583891558 None] volume is a clone so cleaning references {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 05 20:51:11.223033 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-1b0d32ce-630a-4daf-9bf5-bfde0d8b1006 req-4c8f460f-edc3-4399-8031-7e3c9052e307 tempest-LiveAutoBlockMigrationV225Test-1583891558 None] deleting parent snapshot volume-9ddefd89-33c8-46af-8473-0e609beafe6f.clone_snap {{(pid=122683) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 05 20:51:11.994835 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-05eb8b4a-6acd-4fb5-a0a9-e7b7d04093f6 tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Lock "b'cinder-f50f8deb-cde1-4de6-b473-b0fdcc2d3e59-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 20:51:12.064661 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-05eb8b4a-6acd-4fb5-a0a9-e7b7d04093f6 tempest-LiveAutoBlockMigrationV225Test-1583891558 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:51:12.139034 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-05eb8b4a-6acd-4fb5-a0a9-e7b7d04093f6 tempest-LiveAutoBlockMigrationV225Test-1583891558 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 20:51:12.139602 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-05eb8b4a-6acd-4fb5-a0a9-e7b7d04093f6 tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Volume volume-f50f8deb-cde1-4de6-b473-b0fdcc2d3e59 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 20:51:12.156190 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-05eb8b4a-6acd-4fb5-a0a9-e7b7d04093f6 tempest-LiveAutoBlockMigrationV225Test-1583891558 None] deleting rbd volume volume-f50f8deb-cde1-4de6-b473-b0fdcc2d3e59 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 20:51:12.178156 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [req-1b0d32ce-630a-4daf-9bf5-bfde0d8b1006 req-4c8f460f-edc3-4399-8031-7e3c9052e307 tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Created reservations ['2ce2ea34-43ff-4234-8dca-103ca125cd92', '713e4680-c0ea-422c-af20-452ee53d8a1b', 'a3b5d220-22db-4fb0-9de8-4d175299363e', '3741861e-c699-4177-a264-e8c170742722'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 20:51:12.299631 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-1b0d32ce-630a-4daf-9bf5-bfde0d8b1006 req-4c8f460f-edc3-4399-8031-7e3c9052e307 tempest-LiveAutoBlockMigrationV225Test-1583891558 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:51:12.364569 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-1b0d32ce-630a-4daf-9bf5-bfde0d8b1006 req-4c8f460f-edc3-4399-8031-7e3c9052e307 tempest-LiveAutoBlockMigrationV225Test-1583891558 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:51:12.424671 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [req-1b0d32ce-630a-4daf-9bf5-bfde0d8b1006 req-4c8f460f-edc3-4399-8031-7e3c9052e307 tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 20:51:12.432930 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-1b0d32ce-630a-4daf-9bf5-bfde0d8b1006 req-4c8f460f-edc3-4399-8031-7e3c9052e307 tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Deleted volume successfully. Feb 05 20:51:12.451431 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [req-1b0d32ce-630a-4daf-9bf5-bfde0d8b1006 req-4c8f460f-edc3-4399-8031-7e3c9052e307 tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Lock "b'cinder-9ddefd89-33c8-46af-8473-0e609beafe6f-delete_volume'" released by "delete_volume" :: held 1.905s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 20:51:12.534274 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-05eb8b4a-6acd-4fb5-a0a9-e7b7d04093f6 tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Created reservations ['c4ee54ea-d7a9-4635-b667-95055409e10e', '9e3e18a1-ebaa-456b-8fab-e8d7837d72a9', 'd5bd1ebe-e960-4c7e-8f19-1950c33813e8', 'c44050a8-f73d-40d0-9e96-e4d64d25151a'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 20:51:12.609445 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-05eb8b4a-6acd-4fb5-a0a9-e7b7d04093f6 tempest-LiveAutoBlockMigrationV225Test-1583891558 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:51:12.668222 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-05eb8b4a-6acd-4fb5-a0a9-e7b7d04093f6 tempest-LiveAutoBlockMigrationV225Test-1583891558 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:51:12.737794 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-05eb8b4a-6acd-4fb5-a0a9-e7b7d04093f6 tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 20:51:12.742396 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-05eb8b4a-6acd-4fb5-a0a9-e7b7d04093f6 tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Deleted volume successfully. Feb 05 20:51:12.759163 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-05eb8b4a-6acd-4fb5-a0a9-e7b7d04093f6 tempest-LiveAutoBlockMigrationV225Test-1583891558 None] Lock "b'cinder-f50f8deb-cde1-4de6-b473-b0fdcc2d3e59-delete_volume'" released by "delete_volume" :: held 0.765s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 20:51:19.422098 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfacb07a-b3da-4e25-8022-2282633fbf31 tempest-VolumesAdminNegativeTest-731920572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 20:51:19.427279 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-bfacb07a-b3da-4e25-8022-2282633fbf31 tempest-VolumesAdminNegativeTest-731920572 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 20:51:19.428009 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-bfacb07a-b3da-4e25-8022-2282633fbf31 tempest-VolumesAdminNegativeTest-731920572 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 20:51:19.453706 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-bfacb07a-b3da-4e25-8022-2282633fbf31 tempest-VolumesAdminNegativeTest-731920572 None] Flow 'volume_create_manager' (c91ab115-fbb0-4ff9-b384-c4ea8ad45b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 20:51:19.462735 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-bfacb07a-b3da-4e25-8022-2282633fbf31 tempest-VolumesAdminNegativeTest-731920572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b401dc91-aef5-48f8-806f-ad9be5d27739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:51:19.470321 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-bfacb07a-b3da-4e25-8022-2282633fbf31 tempest-VolumesAdminNegativeTest-731920572 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 20:51:19.490745 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-bfacb07a-b3da-4e25-8022-2282633fbf31 tempest-VolumesAdminNegativeTest-731920572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b401dc91-aef5-48f8-806f-ad9be5d27739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T20:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2105203314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ff7e8c93-ce48-45ed-8306-18e0dfbbf28a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e778204a87854520b801e3c26fe7140c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T20:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T20:51:19Z,use_quota=True,user_id='1e5062a0253f4f16b0d40786f1b2c1b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:51:19.497811 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-bfacb07a-b3da-4e25-8022-2282633fbf31 tempest-VolumesAdminNegativeTest-731920572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67b7456b-b6ce-45b0-b173-9da715cb68bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:51:19.503966 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-bfacb07a-b3da-4e25-8022-2282633fbf31 tempest-VolumesAdminNegativeTest-731920572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67b7456b-b6ce-45b0-b173-9da715cb68bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:51:19.511146 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-bfacb07a-b3da-4e25-8022-2282633fbf31 tempest-VolumesAdminNegativeTest-731920572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71b69832-739c-40c6-b5b0-38ada0fa1ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:51:19.516859 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-bfacb07a-b3da-4e25-8022-2282633fbf31 tempest-VolumesAdminNegativeTest-731920572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71b69832-739c-40c6-b5b0-38ada0fa1ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff7e8c93-ce48-45ed-8306-18e0dfbbf28a', 'volume_name': 'volume-ff7e8c93-ce48-45ed-8306-18e0dfbbf28a', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:51:19.523616 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-bfacb07a-b3da-4e25-8022-2282633fbf31 tempest-VolumesAdminNegativeTest-731920572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca4169f-6367-4c97-9a39-448e4f1d16dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:51:19.530042 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-bfacb07a-b3da-4e25-8022-2282633fbf31 tempest-VolumesAdminNegativeTest-731920572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca4169f-6367-4c97-9a39-448e4f1d16dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:51:19.535811 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-bfacb07a-b3da-4e25-8022-2282633fbf31 tempest-VolumesAdminNegativeTest-731920572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b2b777-2d81-42f3-9a44-9ecaf0ba8ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:51:19.537074 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-bfacb07a-b3da-4e25-8022-2282633fbf31 tempest-VolumesAdminNegativeTest-731920572 None] Volume ff7e8c93-ce48-45ed-8306-18e0dfbbf28a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff7e8c93-ce48-45ed-8306-18e0dfbbf28a', 'volume_size': 1} Feb 05 20:51:19.538243 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-bfacb07a-b3da-4e25-8022-2282633fbf31 tempest-VolumesAdminNegativeTest-731920572 None] creating volume 'volume-ff7e8c93-ce48-45ed-8306-18e0dfbbf28a' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 20:51:19.539382 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-bfacb07a-b3da-4e25-8022-2282633fbf31 tempest-VolumesAdminNegativeTest-731920572 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:51:19.601154 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-bfacb07a-b3da-4e25-8022-2282633fbf31 tempest-VolumesAdminNegativeTest-731920572 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 20:51:19.602184 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-bfacb07a-b3da-4e25-8022-2282633fbf31 tempest-VolumesAdminNegativeTest-731920572 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 20:51:19.607349 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-bfacb07a-b3da-4e25-8022-2282633fbf31 tempest-VolumesAdminNegativeTest-731920572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b2b777-2d81-42f3-9a44-9ecaf0ba8ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff7e8c93-ce48-45ed-8306-18e0dfbbf28a', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:51:19.614764 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-bfacb07a-b3da-4e25-8022-2282633fbf31 tempest-VolumesAdminNegativeTest-731920572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61a58e02-38ca-4daf-8fa2-a1b3ed52f338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:51:19.627599 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-bfacb07a-b3da-4e25-8022-2282633fbf31 tempest-VolumesAdminNegativeTest-731920572 None] Volume volume-ff7e8c93-ce48-45ed-8306-18e0dfbbf28a (ff7e8c93-ce48-45ed-8306-18e0dfbbf28a): created successfully Feb 05 20:51:19.632471 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-bfacb07a-b3da-4e25-8022-2282633fbf31 tempest-VolumesAdminNegativeTest-731920572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61a58e02-38ca-4daf-8fa2-a1b3ed52f338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:51:19.639250 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-bfacb07a-b3da-4e25-8022-2282633fbf31 tempest-VolumesAdminNegativeTest-731920572 None] Flow 'volume_create_manager' (c91ab115-fbb0-4ff9-b384-c4ea8ad45b96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 20:51:19.651115 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-bfacb07a-b3da-4e25-8022-2282633fbf31 tempest-VolumesAdminNegativeTest-731920572 None] Created volume successfully. Feb 05 20:51:21.675236 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-f1633d7a-a049-476c-9641-6ec968280b73 req-2df2bb7b-8888-41d0-a69d-eb0b2be99f00 tempest-VolumesAdminNegativeTest-731920572 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 20:51:22.500977 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-f1633d7a-a049-476c-9641-6ec968280b73 req-2df2bb7b-8888-41d0-a69d-eb0b2be99f00 tempest-VolumesAdminNegativeTest-731920572 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.821s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 20:51:22.500977 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-f1633d7a-a049-476c-9641-6ec968280b73 req-2df2bb7b-8888-41d0-a69d-eb0b2be99f00 tempest-VolumesAdminNegativeTest-731920572 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ff7e8c93-ce48-45ed-8306-18e0dfbbf28a', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': 'ff7e8c93-ce48-45ed-8306-18e0dfbbf28a', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 20:51:22.525557 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-f1633d7a-a049-476c-9641-6ec968280b73 req-2df2bb7b-8888-41d0-a69d-eb0b2be99f00 tempest-VolumesAdminNegativeTest-731920572 None] Connection info returned from driver {'name': 'volumes/volume-ff7e8c93-ce48-45ed-8306-18e0dfbbf28a', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ff7e8c93-ce48-45ed-8306-18e0dfbbf28a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '122f981f-e4bc-4c27-9c47-126c64cf0753'} {{(pid=122683) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 05 20:51:22.571150 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-f1633d7a-a049-476c-9641-6ec968280b73 req-2df2bb7b-8888-41d0-a69d-eb0b2be99f00 tempest-VolumesAdminNegativeTest-731920572 None] attachment_update completed successfully. Feb 05 20:51:26.549124 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-7996f891-5543-46ad-b23e-431ea4383d8a req-48fc2a95-248a-489d-aa79-0a871ba11b66 tempest-VolumesAdminNegativeTest-731920572 None] Terminate volume connection completed successfully. Feb 05 20:51:26.552633 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-7996f891-5543-46ad-b23e-431ea4383d8a req-48fc2a95-248a-489d-aa79-0a871ba11b66 tempest-VolumesAdminNegativeTest-731920572 None] Deleting attachment 122f981f-e4bc-4c27-9c47-126c64cf0753. {{(pid=122683) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 05 20:51:27.604464 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-adcbdbb3-fea5-40c6-aea3-f7abed13847f tempest-VolumesAdminNegativeTest-731920572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 20:51:27.614185 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-adcbdbb3-fea5-40c6-aea3-f7abed13847f tempest-VolumesAdminNegativeTest-731920572 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 20:51:27.617142 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-adcbdbb3-fea5-40c6-aea3-f7abed13847f tempest-VolumesAdminNegativeTest-731920572 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 20:51:27.678517 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-adcbdbb3-fea5-40c6-aea3-f7abed13847f tempest-VolumesAdminNegativeTest-731920572 None] Flow 'volume_create_manager' (294377b4-9c1c-4e36-a4ab-46402d96b86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 20:51:27.694597 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-adcbdbb3-fea5-40c6-aea3-f7abed13847f tempest-VolumesAdminNegativeTest-731920572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3a5d2fe-3feb-4b9d-84e5-85cca20c3d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:51:27.708811 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-adcbdbb3-fea5-40c6-aea3-f7abed13847f tempest-VolumesAdminNegativeTest-731920572 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 20:51:27.729381 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-adcbdbb3-fea5-40c6-aea3-f7abed13847f tempest-VolumesAdminNegativeTest-731920572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3a5d2fe-3feb-4b9d-84e5-85cca20c3d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T20:51:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1472387948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=dac38fd2-8e47-479d-b6cd-f5617f544977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e778204a87854520b801e3c26fe7140c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T20:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T20:51:28Z,use_quota=True,user_id='1e5062a0253f4f16b0d40786f1b2c1b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:51:27.737115 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-adcbdbb3-fea5-40c6-aea3-f7abed13847f tempest-VolumesAdminNegativeTest-731920572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae8cea0d-399a-4b51-adfa-f034e8c7e150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:51:27.741261 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-adcbdbb3-fea5-40c6-aea3-f7abed13847f tempest-VolumesAdminNegativeTest-731920572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae8cea0d-399a-4b51-adfa-f034e8c7e150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:51:27.747322 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-adcbdbb3-fea5-40c6-aea3-f7abed13847f tempest-VolumesAdminNegativeTest-731920572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d1569a8-2e66-4f87-9237-f9aca6e77d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:51:27.751811 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-adcbdbb3-fea5-40c6-aea3-f7abed13847f tempest-VolumesAdminNegativeTest-731920572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d1569a8-2e66-4f87-9237-f9aca6e77d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dac38fd2-8e47-479d-b6cd-f5617f544977', 'volume_name': 'volume-dac38fd2-8e47-479d-b6cd-f5617f544977', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:51:27.756730 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-adcbdbb3-fea5-40c6-aea3-f7abed13847f tempest-VolumesAdminNegativeTest-731920572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e485f2f9-0f30-43ca-880c-ea33f7a37eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:51:27.762234 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-adcbdbb3-fea5-40c6-aea3-f7abed13847f tempest-VolumesAdminNegativeTest-731920572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e485f2f9-0f30-43ca-880c-ea33f7a37eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:51:27.767853 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-adcbdbb3-fea5-40c6-aea3-f7abed13847f tempest-VolumesAdminNegativeTest-731920572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a59bf1fe-40fb-49f7-b14f-3b6a51783abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:51:27.768997 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-adcbdbb3-fea5-40c6-aea3-f7abed13847f tempest-VolumesAdminNegativeTest-731920572 None] Volume dac38fd2-8e47-479d-b6cd-f5617f544977: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dac38fd2-8e47-479d-b6cd-f5617f544977', 'volume_size': 1} Feb 05 20:51:27.769436 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-adcbdbb3-fea5-40c6-aea3-f7abed13847f tempest-VolumesAdminNegativeTest-731920572 None] creating volume 'volume-dac38fd2-8e47-479d-b6cd-f5617f544977' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 20:51:27.770582 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-adcbdbb3-fea5-40c6-aea3-f7abed13847f tempest-VolumesAdminNegativeTest-731920572 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:51:27.872473 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-adcbdbb3-fea5-40c6-aea3-f7abed13847f tempest-VolumesAdminNegativeTest-731920572 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 20:51:27.872990 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-adcbdbb3-fea5-40c6-aea3-f7abed13847f tempest-VolumesAdminNegativeTest-731920572 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 20:51:27.879093 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-adcbdbb3-fea5-40c6-aea3-f7abed13847f tempest-VolumesAdminNegativeTest-731920572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a59bf1fe-40fb-49f7-b14f-3b6a51783abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dac38fd2-8e47-479d-b6cd-f5617f544977', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:51:27.886712 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-adcbdbb3-fea5-40c6-aea3-f7abed13847f tempest-VolumesAdminNegativeTest-731920572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e85870fb-76b0-4226-a5c7-2fc4ced10b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:51:27.900127 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-adcbdbb3-fea5-40c6-aea3-f7abed13847f tempest-VolumesAdminNegativeTest-731920572 None] Volume volume-dac38fd2-8e47-479d-b6cd-f5617f544977 (dac38fd2-8e47-479d-b6cd-f5617f544977): created successfully Feb 05 20:51:27.908989 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-adcbdbb3-fea5-40c6-aea3-f7abed13847f tempest-VolumesAdminNegativeTest-731920572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e85870fb-76b0-4226-a5c7-2fc4ced10b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:51:27.919384 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-adcbdbb3-fea5-40c6-aea3-f7abed13847f tempest-VolumesAdminNegativeTest-731920572 None] Flow 'volume_create_manager' (294377b4-9c1c-4e36-a4ab-46402d96b86b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 20:51:27.935227 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-adcbdbb3-fea5-40c6-aea3-f7abed13847f tempest-VolumesAdminNegativeTest-731920572 None] Created volume successfully. Feb 05 20:51:28.978762 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-5724b08c-a2fb-4697-81bf-2e0385e41d9f tempest-VolumesAdminNegativeTest-731920572 None] Lock "b'cinder-dac38fd2-8e47-479d-b6cd-f5617f544977-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 20:51:29.048366 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5724b08c-a2fb-4697-81bf-2e0385e41d9f tempest-VolumesAdminNegativeTest-731920572 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:51:29.117164 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5724b08c-a2fb-4697-81bf-2e0385e41d9f tempest-VolumesAdminNegativeTest-731920572 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 20:51:29.117904 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5724b08c-a2fb-4697-81bf-2e0385e41d9f tempest-VolumesAdminNegativeTest-731920572 None] Volume volume-dac38fd2-8e47-479d-b6cd-f5617f544977 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 20:51:29.126299 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5724b08c-a2fb-4697-81bf-2e0385e41d9f tempest-VolumesAdminNegativeTest-731920572 None] deleting rbd volume volume-dac38fd2-8e47-479d-b6cd-f5617f544977 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 20:51:29.431518 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-5724b08c-a2fb-4697-81bf-2e0385e41d9f tempest-VolumesAdminNegativeTest-731920572 None] Created reservations ['c44c9e2e-3da0-4eb7-b5b3-bea88fec8426', '8e9aecee-0d55-465a-b4da-9fbc7f6bc921', '9a01b8b5-571d-473c-81a1-5bb0c23fe1da', 'a99785a2-9c40-41d7-a0f4-9930a4928749'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 20:51:29.475761 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5724b08c-a2fb-4697-81bf-2e0385e41d9f tempest-VolumesAdminNegativeTest-731920572 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:51:29.522072 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5724b08c-a2fb-4697-81bf-2e0385e41d9f tempest-VolumesAdminNegativeTest-731920572 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:51:29.600011 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-5724b08c-a2fb-4697-81bf-2e0385e41d9f tempest-VolumesAdminNegativeTest-731920572 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 20:51:29.605477 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-5724b08c-a2fb-4697-81bf-2e0385e41d9f tempest-VolumesAdminNegativeTest-731920572 None] Deleted volume successfully. Feb 05 20:51:29.625793 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-5724b08c-a2fb-4697-81bf-2e0385e41d9f tempest-VolumesAdminNegativeTest-731920572 None] Lock "b'cinder-dac38fd2-8e47-479d-b6cd-f5617f544977-delete_volume'" released by "delete_volume" :: held 0.647s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 20:51:30.199560 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-f38d0116-cef4-4c88-9658-8ee9978dac79 tempest-VolumesAdminNegativeTest-731920572 None] Lock "b'cinder-ff7e8c93-ce48-45ed-8306-18e0dfbbf28a-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 20:51:30.275787 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-f38d0116-cef4-4c88-9658-8ee9978dac79 tempest-VolumesAdminNegativeTest-731920572 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:51:30.347978 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-f38d0116-cef4-4c88-9658-8ee9978dac79 tempest-VolumesAdminNegativeTest-731920572 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 20:51:30.348617 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-f38d0116-cef4-4c88-9658-8ee9978dac79 tempest-VolumesAdminNegativeTest-731920572 None] Volume volume-ff7e8c93-ce48-45ed-8306-18e0dfbbf28a is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 20:51:30.360244 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-f38d0116-cef4-4c88-9658-8ee9978dac79 tempest-VolumesAdminNegativeTest-731920572 None] deleting rbd volume volume-ff7e8c93-ce48-45ed-8306-18e0dfbbf28a {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 20:51:30.743345 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-f38d0116-cef4-4c88-9658-8ee9978dac79 tempest-VolumesAdminNegativeTest-731920572 None] Created reservations ['77fca2ba-7e8e-4945-8d31-86fcd3080c2c', 'fed766aa-d299-407f-ae2f-f429e3160ec2', '9f080500-295f-4a4b-8329-8e0caae40aec', '936873a1-315d-46b7-bd1c-a7745ac904cb'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 20:51:30.817470 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-f38d0116-cef4-4c88-9658-8ee9978dac79 tempest-VolumesAdminNegativeTest-731920572 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:51:30.884537 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-f38d0116-cef4-4c88-9658-8ee9978dac79 tempest-VolumesAdminNegativeTest-731920572 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:51:30.946758 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-f38d0116-cef4-4c88-9658-8ee9978dac79 tempest-VolumesAdminNegativeTest-731920572 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 20:51:30.950845 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-f38d0116-cef4-4c88-9658-8ee9978dac79 tempest-VolumesAdminNegativeTest-731920572 None] Deleted volume successfully. Feb 05 20:51:30.972167 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-f38d0116-cef4-4c88-9658-8ee9978dac79 tempest-VolumesAdminNegativeTest-731920572 None] Lock "b'cinder-ff7e8c93-ce48-45ed-8306-18e0dfbbf28a-delete_volume'" released by "delete_volume" :: held 0.773s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 20:51:52.415216 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 20:51:52.416128 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:51:52.508477 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:51:52.577470 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 20:52:52.417623 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 20:52:52.418456 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:52:52.553000 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:52:52.622552 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 20:53:10.393241 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-fef20845-f36c-45f5-805f-bea038ea631d tempest-TaggedBootDevicesTest_v242-1057228886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 20:53:10.401036 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-fef20845-f36c-45f5-805f-bea038ea631d tempest-TaggedBootDevicesTest_v242-1057228886 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 20:53:10.401460 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-fef20845-f36c-45f5-805f-bea038ea631d tempest-TaggedBootDevicesTest_v242-1057228886 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 20:53:10.453560 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-fef20845-f36c-45f5-805f-bea038ea631d tempest-TaggedBootDevicesTest_v242-1057228886 None] Flow 'volume_create_manager' (0c04073a-04c2-42a4-9e8d-2c9f38f53185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 20:53:10.488598 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-fef20845-f36c-45f5-805f-bea038ea631d tempest-TaggedBootDevicesTest_v242-1057228886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78883746-9dfa-4155-9fe0-21afa084849a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:53:10.500496 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-fef20845-f36c-45f5-805f-bea038ea631d tempest-TaggedBootDevicesTest_v242-1057228886 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 20:53:10.532523 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-fef20845-f36c-45f5-805f-bea038ea631d tempest-TaggedBootDevicesTest_v242-1057228886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78883746-9dfa-4155-9fe0-21afa084849a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T20:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-499531933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=353ce482-9628-4481-970d-bcb74adf4238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3256272f3c524d7fba9a4fb8f5eb011d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T20:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T20:53:10Z,use_quota=True,user_id='0e4dcb70d72f4212b2b0ab7659f99992',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:53:10.550581 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-fef20845-f36c-45f5-805f-bea038ea631d tempest-TaggedBootDevicesTest_v242-1057228886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b279e0f-c76e-465d-b167-4ff570e8ec98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:53:10.563181 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-fef20845-f36c-45f5-805f-bea038ea631d tempest-TaggedBootDevicesTest_v242-1057228886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b279e0f-c76e-465d-b167-4ff570e8ec98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:53:10.587634 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-fef20845-f36c-45f5-805f-bea038ea631d tempest-TaggedBootDevicesTest_v242-1057228886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (613dc092-9abf-4df2-91d9-60070187c29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:53:10.760525 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-fef20845-f36c-45f5-805f-bea038ea631d tempest-TaggedBootDevicesTest_v242-1057228886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (613dc092-9abf-4df2-91d9-60070187c29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '353ce482-9628-4481-970d-bcb74adf4238', 'volume_name': 'volume-353ce482-9628-4481-970d-bcb74adf4238', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:53:10.773492 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-fef20845-f36c-45f5-805f-bea038ea631d tempest-TaggedBootDevicesTest_v242-1057228886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b518cbca-6a0a-4710-a46a-75202744729e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:53:10.777953 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-fef20845-f36c-45f5-805f-bea038ea631d tempest-TaggedBootDevicesTest_v242-1057228886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b518cbca-6a0a-4710-a46a-75202744729e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:53:10.783841 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-fef20845-f36c-45f5-805f-bea038ea631d tempest-TaggedBootDevicesTest_v242-1057228886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0ec2af2-9573-495d-8155-52e436a766bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:53:10.785228 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-fef20845-f36c-45f5-805f-bea038ea631d tempest-TaggedBootDevicesTest_v242-1057228886 None] Volume 353ce482-9628-4481-970d-bcb74adf4238: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-353ce482-9628-4481-970d-bcb74adf4238', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 05 20:53:10.786225 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-fef20845-f36c-45f5-805f-bea038ea631d tempest-TaggedBootDevicesTest_v242-1057228886 None] Cloning 353ce482-9628-4481-970d-bcb74adf4238 from image e66a3a3b-d2f9-4d5d-8021-a6001dff419f at location (None, None). {{(pid=122683) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 05 20:53:10.807085 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-fef20845-f36c-45f5-805f-bea038ea631d tempest-TaggedBootDevicesTest_v242-1057228886 None] Lock "b'cinder-e66a3a3b-d2f9-4d5d-8021-a6001dff419f'" acquired by "_prepare_image_cache_entry" :: waited 0.020s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 20:53:10.822086 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-fef20845-f36c-45f5-805f-bea038ea631d tempest-TaggedBootDevicesTest_v242-1057228886 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'volume_id': '311ef4be-45fd-4167-a3ad-6251d56550a7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57), 'last_used': datetime.datetime(2022, 2, 5, 20, 53, 10, 812823)}. {{(pid=122683) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 05 20:53:10.824253 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-fef20845-f36c-45f5-805f-bea038ea631d tempest-TaggedBootDevicesTest_v242-1057228886 None] Image-volume cache entry image_update_at = 2022-02-05 20:37:57+00:00, requested image updated_at = 2022-02-05 20:37:57+00:00. {{(pid=122683) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 05 20:53:10.825539 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-fef20845-f36c-45f5-805f-bea038ea631d tempest-TaggedBootDevicesTest_v242-1057228886 None] Found cache entry for image = e66a3a3b-d2f9-4d5d-8021-a6001dff419f on host ncdv-master-1@ceph#ceph. {{(pid=122683) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Feb 05 20:53:10.833276 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-fef20845-f36c-45f5-805f-bea038ea631d tempest-TaggedBootDevicesTest_v242-1057228886 None] Lock "b'cinder-e66a3a3b-d2f9-4d5d-8021-a6001dff419f'" released by "_prepare_image_cache_entry" :: held 0.026s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 20:53:10.837255 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-fef20845-f36c-45f5-805f-bea038ea631d tempest-TaggedBootDevicesTest_v242-1057228886 None] Attempting to retrieve cache entry for image = e66a3a3b-d2f9-4d5d-8021-a6001dff419f on host ncdv-master-1@ceph#ceph. {{(pid=122683) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 05 20:53:10.849825 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-fef20845-f36c-45f5-805f-bea038ea631d tempest-TaggedBootDevicesTest_v242-1057228886 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'volume_id': '311ef4be-45fd-4167-a3ad-6251d56550a7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57), 'last_used': datetime.datetime(2022, 2, 5, 20, 53, 10, 843456)}. {{(pid=122683) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 05 20:53:10.852518 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-fef20845-f36c-45f5-805f-bea038ea631d tempest-TaggedBootDevicesTest_v242-1057228886 None] Image-volume cache entry image_update_at = 2022-02-05 20:37:57+00:00, requested image updated_at = 2022-02-05 20:37:57+00:00. {{(pid=122683) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 05 20:53:10.853144 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-fef20845-f36c-45f5-805f-bea038ea631d tempest-TaggedBootDevicesTest_v242-1057228886 None] Creating from source image-volume 311ef4be-45fd-4167-a3ad-6251d56550a7 {{(pid=122683) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Feb 05 20:53:10.891148 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-fef20845-f36c-45f5-805f-bea038ea631d tempest-TaggedBootDevicesTest_v242-1057228886 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:53:11.034230 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-fef20845-f36c-45f5-805f-bea038ea631d tempest-TaggedBootDevicesTest_v242-1057228886 None] creating snapshot='volume-353ce482-9628-4481-970d-bcb74adf4238.clone_snap' {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 05 20:53:11.996514 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-fef20845-f36c-45f5-805f-bea038ea631d tempest-TaggedBootDevicesTest_v242-1057228886 None] cloning 'volume-311ef4be-45fd-4167-a3ad-6251d56550a7@volume-353ce482-9628-4481-970d-bcb74adf4238.clone_snap' to 'volume-353ce482-9628-4481-970d-bcb74adf4238' {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 05 20:53:12.226775 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-fef20845-f36c-45f5-805f-bea038ea631d tempest-TaggedBootDevicesTest_v242-1057228886 None] Volume volume-35445a36-a76c-48db-a9c5-3b58646c1e7b.deleted is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 20:53:12.228390 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-fef20845-f36c-45f5-805f-bea038ea631d tempest-TaggedBootDevicesTest_v242-1057228886 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 20:53:12.229268 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-fef20845-f36c-45f5-805f-bea038ea631d tempest-TaggedBootDevicesTest_v242-1057228886 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 20:53:12.268810 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-fef20845-f36c-45f5-805f-bea038ea631d tempest-TaggedBootDevicesTest_v242-1057228886 None] clone created successfully {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 05 20:53:12.269574 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.volume_utils [None req-fef20845-f36c-45f5-805f-bea038ea631d tempest-TaggedBootDevicesTest_v242-1057228886 None] Marking volume 353ce482-9628-4481-970d-bcb74adf4238 as bootable. {{(pid=122683) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Feb 05 20:53:12.282945 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-fef20845-f36c-45f5-805f-bea038ea631d tempest-TaggedBootDevicesTest_v242-1057228886 None] Copying metadata from image e66a3a3b-d2f9-4d5d-8021-a6001dff419f to 353ce482-9628-4481-970d-bcb74adf4238. {{(pid=122683) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 05 20:53:12.283491 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-fef20845-f36c-45f5-805f-bea038ea631d tempest-TaggedBootDevicesTest_v242-1057228886 None] Creating volume glance metadata for volume 353ce482-9628-4481-970d-bcb74adf4238 backed by image e66a3a3b-d2f9-4d5d-8021-a6001dff419f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=122683) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 05 20:53:12.456258 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-fef20845-f36c-45f5-805f-bea038ea631d tempest-TaggedBootDevicesTest_v242-1057228886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0ec2af2-9573-495d-8155-52e436a766bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-353ce482-9628-4481-970d-bcb74adf4238', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:53:12.468904 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-fef20845-f36c-45f5-805f-bea038ea631d tempest-TaggedBootDevicesTest_v242-1057228886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bafbfcc7-47c3-4b1a-a9dd-737092b87f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:53:12.485898 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-fef20845-f36c-45f5-805f-bea038ea631d tempest-TaggedBootDevicesTest_v242-1057228886 None] Volume volume-353ce482-9628-4481-970d-bcb74adf4238 (353ce482-9628-4481-970d-bcb74adf4238): created successfully Feb 05 20:53:12.492547 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-fef20845-f36c-45f5-805f-bea038ea631d tempest-TaggedBootDevicesTest_v242-1057228886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bafbfcc7-47c3-4b1a-a9dd-737092b87f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:53:12.521113 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-fef20845-f36c-45f5-805f-bea038ea631d tempest-TaggedBootDevicesTest_v242-1057228886 None] Flow 'volume_create_manager' (0c04073a-04c2-42a4-9e8d-2c9f38f53185) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 20:53:12.539302 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-fef20845-f36c-45f5-805f-bea038ea631d tempest-TaggedBootDevicesTest_v242-1057228886 None] Created volume successfully. Feb 05 20:53:14.159643 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-474317c9-d34d-422f-b005-b65fbdbd030c tempest-TaggedBootDevicesTest_v242-1057228886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 20:53:14.167892 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-474317c9-d34d-422f-b005-b65fbdbd030c tempest-TaggedBootDevicesTest_v242-1057228886 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 20:53:14.170544 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-474317c9-d34d-422f-b005-b65fbdbd030c tempest-TaggedBootDevicesTest_v242-1057228886 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 20:53:14.208317 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-474317c9-d34d-422f-b005-b65fbdbd030c tempest-TaggedBootDevicesTest_v242-1057228886 None] Flow 'volume_create_manager' (d6b45c92-0643-4ddb-8004-ef15df13ebc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 20:53:14.226963 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-474317c9-d34d-422f-b005-b65fbdbd030c tempest-TaggedBootDevicesTest_v242-1057228886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5701f610-743d-48c2-9c58-24f1f5820a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:53:14.235138 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-474317c9-d34d-422f-b005-b65fbdbd030c tempest-TaggedBootDevicesTest_v242-1057228886 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 20:53:14.259952 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-474317c9-d34d-422f-b005-b65fbdbd030c tempest-TaggedBootDevicesTest_v242-1057228886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5701f610-743d-48c2-9c58-24f1f5820a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T20:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-147272625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3431439a-02b5-460c-b168-84a4fbb4a172,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3256272f3c524d7fba9a4fb8f5eb011d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T20:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T20:53:14Z,use_quota=True,user_id='0e4dcb70d72f4212b2b0ab7659f99992',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:53:14.268438 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-474317c9-d34d-422f-b005-b65fbdbd030c tempest-TaggedBootDevicesTest_v242-1057228886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df164445-66c1-4649-9553-f15d75b698e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:53:14.274716 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-474317c9-d34d-422f-b005-b65fbdbd030c tempest-TaggedBootDevicesTest_v242-1057228886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df164445-66c1-4649-9553-f15d75b698e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:53:14.280479 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-474317c9-d34d-422f-b005-b65fbdbd030c tempest-TaggedBootDevicesTest_v242-1057228886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (073b51d2-1a5c-4d47-bc4d-8f10261023fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:53:14.284867 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-474317c9-d34d-422f-b005-b65fbdbd030c tempest-TaggedBootDevicesTest_v242-1057228886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (073b51d2-1a5c-4d47-bc4d-8f10261023fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3431439a-02b5-460c-b168-84a4fbb4a172', 'volume_name': 'volume-3431439a-02b5-460c-b168-84a4fbb4a172', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:53:14.291570 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-474317c9-d34d-422f-b005-b65fbdbd030c tempest-TaggedBootDevicesTest_v242-1057228886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bed5449-1d55-47d8-aee3-3cf0df3db6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:53:14.295932 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-474317c9-d34d-422f-b005-b65fbdbd030c tempest-TaggedBootDevicesTest_v242-1057228886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bed5449-1d55-47d8-aee3-3cf0df3db6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:53:14.301886 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-474317c9-d34d-422f-b005-b65fbdbd030c tempest-TaggedBootDevicesTest_v242-1057228886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (319fb10d-db5a-4629-b6c8-f7d90440666b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:53:14.303038 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-474317c9-d34d-422f-b005-b65fbdbd030c tempest-TaggedBootDevicesTest_v242-1057228886 None] Volume 3431439a-02b5-460c-b168-84a4fbb4a172: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3431439a-02b5-460c-b168-84a4fbb4a172', 'volume_size': 1} Feb 05 20:53:14.303607 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-474317c9-d34d-422f-b005-b65fbdbd030c tempest-TaggedBootDevicesTest_v242-1057228886 None] creating volume 'volume-3431439a-02b5-460c-b168-84a4fbb4a172' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 20:53:14.305190 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-474317c9-d34d-422f-b005-b65fbdbd030c tempest-TaggedBootDevicesTest_v242-1057228886 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:53:14.422412 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-474317c9-d34d-422f-b005-b65fbdbd030c tempest-TaggedBootDevicesTest_v242-1057228886 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 20:53:14.422870 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-474317c9-d34d-422f-b005-b65fbdbd030c tempest-TaggedBootDevicesTest_v242-1057228886 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 20:53:14.427322 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-474317c9-d34d-422f-b005-b65fbdbd030c tempest-TaggedBootDevicesTest_v242-1057228886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (319fb10d-db5a-4629-b6c8-f7d90440666b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3431439a-02b5-460c-b168-84a4fbb4a172', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:53:14.435891 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-474317c9-d34d-422f-b005-b65fbdbd030c tempest-TaggedBootDevicesTest_v242-1057228886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277c4553-9cca-433a-8a05-cbdb7d8eaae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:53:14.447961 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-474317c9-d34d-422f-b005-b65fbdbd030c tempest-TaggedBootDevicesTest_v242-1057228886 None] Volume volume-3431439a-02b5-460c-b168-84a4fbb4a172 (3431439a-02b5-460c-b168-84a4fbb4a172): created successfully Feb 05 20:53:14.452674 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-474317c9-d34d-422f-b005-b65fbdbd030c tempest-TaggedBootDevicesTest_v242-1057228886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277c4553-9cca-433a-8a05-cbdb7d8eaae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:53:14.464931 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-474317c9-d34d-422f-b005-b65fbdbd030c tempest-TaggedBootDevicesTest_v242-1057228886 None] Flow 'volume_create_manager' (d6b45c92-0643-4ddb-8004-ef15df13ebc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 20:53:14.487825 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-474317c9-d34d-422f-b005-b65fbdbd030c tempest-TaggedBootDevicesTest_v242-1057228886 None] Created volume successfully. Feb 05 20:53:15.728390 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-caff769d-3241-4120-90e7-c6c5d2696338 tempest-TaggedBootDevicesTest_v242-1057228886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 20:53:15.734426 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-caff769d-3241-4120-90e7-c6c5d2696338 tempest-TaggedBootDevicesTest_v242-1057228886 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 20:53:15.735145 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-caff769d-3241-4120-90e7-c6c5d2696338 tempest-TaggedBootDevicesTest_v242-1057228886 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 20:53:15.796210 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-caff769d-3241-4120-90e7-c6c5d2696338 tempest-TaggedBootDevicesTest_v242-1057228886 None] Flow 'volume_create_manager' (b1f410f3-011d-45c4-85c7-2f39991395e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 20:53:15.823038 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-caff769d-3241-4120-90e7-c6c5d2696338 tempest-TaggedBootDevicesTest_v242-1057228886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bf28021-97af-4af6-923a-b750fc3dfc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:53:15.838241 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-caff769d-3241-4120-90e7-c6c5d2696338 tempest-TaggedBootDevicesTest_v242-1057228886 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 20:53:15.881411 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-caff769d-3241-4120-90e7-c6c5d2696338 tempest-TaggedBootDevicesTest_v242-1057228886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bf28021-97af-4af6-923a-b750fc3dfc1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T20:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1559065342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=10df4ddf-f452-44cb-a8d7-fd39e4ea5537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3256272f3c524d7fba9a4fb8f5eb011d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T20:53:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T20:53:16Z,use_quota=True,user_id='0e4dcb70d72f4212b2b0ab7659f99992',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:53:15.888168 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-caff769d-3241-4120-90e7-c6c5d2696338 tempest-TaggedBootDevicesTest_v242-1057228886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b72398df-d3ad-4704-9294-c4034290e5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:53:15.895989 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-caff769d-3241-4120-90e7-c6c5d2696338 tempest-TaggedBootDevicesTest_v242-1057228886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b72398df-d3ad-4704-9294-c4034290e5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:53:15.924229 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-caff769d-3241-4120-90e7-c6c5d2696338 tempest-TaggedBootDevicesTest_v242-1057228886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f3bb8aa-bf36-4d81-a66f-1c0a79bae4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:53:15.929709 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-caff769d-3241-4120-90e7-c6c5d2696338 tempest-TaggedBootDevicesTest_v242-1057228886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f3bb8aa-bf36-4d81-a66f-1c0a79bae4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10df4ddf-f452-44cb-a8d7-fd39e4ea5537', 'volume_name': 'volume-10df4ddf-f452-44cb-a8d7-fd39e4ea5537', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:53:15.937368 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-caff769d-3241-4120-90e7-c6c5d2696338 tempest-TaggedBootDevicesTest_v242-1057228886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b90a005-7c68-435d-a197-311ad6f052c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:53:15.944107 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-caff769d-3241-4120-90e7-c6c5d2696338 tempest-TaggedBootDevicesTest_v242-1057228886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b90a005-7c68-435d-a197-311ad6f052c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:53:15.964322 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-caff769d-3241-4120-90e7-c6c5d2696338 tempest-TaggedBootDevicesTest_v242-1057228886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (239348d1-9018-486a-9fb8-63fe744b6134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:53:15.966224 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-caff769d-3241-4120-90e7-c6c5d2696338 tempest-TaggedBootDevicesTest_v242-1057228886 None] Volume 10df4ddf-f452-44cb-a8d7-fd39e4ea5537: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10df4ddf-f452-44cb-a8d7-fd39e4ea5537', 'volume_size': 1} Feb 05 20:53:15.966940 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-caff769d-3241-4120-90e7-c6c5d2696338 tempest-TaggedBootDevicesTest_v242-1057228886 None] creating volume 'volume-10df4ddf-f452-44cb-a8d7-fd39e4ea5537' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 20:53:15.968275 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-caff769d-3241-4120-90e7-c6c5d2696338 tempest-TaggedBootDevicesTest_v242-1057228886 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:53:16.094922 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-caff769d-3241-4120-90e7-c6c5d2696338 tempest-TaggedBootDevicesTest_v242-1057228886 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 20:53:16.095312 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-caff769d-3241-4120-90e7-c6c5d2696338 tempest-TaggedBootDevicesTest_v242-1057228886 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 20:53:16.099121 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-caff769d-3241-4120-90e7-c6c5d2696338 tempest-TaggedBootDevicesTest_v242-1057228886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (239348d1-9018-486a-9fb8-63fe744b6134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10df4ddf-f452-44cb-a8d7-fd39e4ea5537', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:53:16.105184 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-caff769d-3241-4120-90e7-c6c5d2696338 tempest-TaggedBootDevicesTest_v242-1057228886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03675c89-d93f-4d38-8d01-d7a1cbc12771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:53:16.130484 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-caff769d-3241-4120-90e7-c6c5d2696338 tempest-TaggedBootDevicesTest_v242-1057228886 None] Volume volume-10df4ddf-f452-44cb-a8d7-fd39e4ea5537 (10df4ddf-f452-44cb-a8d7-fd39e4ea5537): created successfully Feb 05 20:53:16.135895 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-caff769d-3241-4120-90e7-c6c5d2696338 tempest-TaggedBootDevicesTest_v242-1057228886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03675c89-d93f-4d38-8d01-d7a1cbc12771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:53:16.144880 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-caff769d-3241-4120-90e7-c6c5d2696338 tempest-TaggedBootDevicesTest_v242-1057228886 None] Flow 'volume_create_manager' (b1f410f3-011d-45c4-85c7-2f39991395e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 20:53:16.160295 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-caff769d-3241-4120-90e7-c6c5d2696338 tempest-TaggedBootDevicesTest_v242-1057228886 None] Created volume successfully. Feb 05 20:53:40.812524 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-b7cdb1db-0ba5-4c20-9c0e-977a9a283d8e req-c6a1c06a-9edc-48b7-8087-6b49e70596cd tempest-TaggedBootDevicesTest_v242-1057228886 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 20:53:42.142625 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-b7cdb1db-0ba5-4c20-9c0e-977a9a283d8e req-c6a1c06a-9edc-48b7-8087-6b49e70596cd tempest-TaggedBootDevicesTest_v242-1057228886 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.330s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 20:53:42.144305 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-b7cdb1db-0ba5-4c20-9c0e-977a9a283d8e req-c6a1c06a-9edc-48b7-8087-6b49e70596cd tempest-TaggedBootDevicesTest_v242-1057228886 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-353ce482-9628-4481-970d-bcb74adf4238', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': '353ce482-9628-4481-970d-bcb74adf4238', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 20:53:42.206597 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-b7cdb1db-0ba5-4c20-9c0e-977a9a283d8e req-c6a1c06a-9edc-48b7-8087-6b49e70596cd tempest-TaggedBootDevicesTest_v242-1057228886 None] Connection info returned from driver {'name': 'volumes/volume-353ce482-9628-4481-970d-bcb74adf4238', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '353ce482-9628-4481-970d-bcb74adf4238', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'bde27437-3264-4994-8e59-68ce2c8a2800'} {{(pid=122683) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 05 20:53:42.291109 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-b7cdb1db-0ba5-4c20-9c0e-977a9a283d8e req-c6a1c06a-9edc-48b7-8087-6b49e70596cd tempest-TaggedBootDevicesTest_v242-1057228886 None] attachment_update completed successfully. Feb 05 20:53:42.849821 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-b7cdb1db-0ba5-4c20-9c0e-977a9a283d8e req-2ef36a70-b136-4a9a-b753-17fc7442d79c tempest-TaggedBootDevicesTest_v242-1057228886 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 20:53:44.185029 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-b7cdb1db-0ba5-4c20-9c0e-977a9a283d8e req-2ef36a70-b136-4a9a-b753-17fc7442d79c tempest-TaggedBootDevicesTest_v242-1057228886 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.335s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 20:53:44.187566 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-b7cdb1db-0ba5-4c20-9c0e-977a9a283d8e req-2ef36a70-b136-4a9a-b753-17fc7442d79c tempest-TaggedBootDevicesTest_v242-1057228886 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3431439a-02b5-460c-b168-84a4fbb4a172', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': '3431439a-02b5-460c-b168-84a4fbb4a172', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 20:53:44.233886 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-b7cdb1db-0ba5-4c20-9c0e-977a9a283d8e req-2ef36a70-b136-4a9a-b753-17fc7442d79c tempest-TaggedBootDevicesTest_v242-1057228886 None] Connection info returned from driver {'name': 'volumes/volume-3431439a-02b5-460c-b168-84a4fbb4a172', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '3431439a-02b5-460c-b168-84a4fbb4a172', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '794dec2a-d35b-4e01-a0cf-946f2b1fc321'} {{(pid=122683) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 05 20:53:44.297832 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-b7cdb1db-0ba5-4c20-9c0e-977a9a283d8e req-2ef36a70-b136-4a9a-b753-17fc7442d79c tempest-TaggedBootDevicesTest_v242-1057228886 None] attachment_update completed successfully. Feb 05 20:53:44.809644 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-b7cdb1db-0ba5-4c20-9c0e-977a9a283d8e req-9cfced2a-34c2-467f-bdff-148106df2a8c tempest-TaggedBootDevicesTest_v242-1057228886 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 20:53:45.917604 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-b7cdb1db-0ba5-4c20-9c0e-977a9a283d8e req-9cfced2a-34c2-467f-bdff-148106df2a8c tempest-TaggedBootDevicesTest_v242-1057228886 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.110s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 20:53:45.918426 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-b7cdb1db-0ba5-4c20-9c0e-977a9a283d8e req-9cfced2a-34c2-467f-bdff-148106df2a8c tempest-TaggedBootDevicesTest_v242-1057228886 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-10df4ddf-f452-44cb-a8d7-fd39e4ea5537', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': '10df4ddf-f452-44cb-a8d7-fd39e4ea5537', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 20:53:45.968043 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-b7cdb1db-0ba5-4c20-9c0e-977a9a283d8e req-9cfced2a-34c2-467f-bdff-148106df2a8c tempest-TaggedBootDevicesTest_v242-1057228886 None] Connection info returned from driver {'name': 'volumes/volume-10df4ddf-f452-44cb-a8d7-fd39e4ea5537', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '10df4ddf-f452-44cb-a8d7-fd39e4ea5537', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '4f9e0305-7a11-4104-82ef-1bc3684f8df8'} {{(pid=122683) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 05 20:53:46.061834 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-b7cdb1db-0ba5-4c20-9c0e-977a9a283d8e req-9cfced2a-34c2-467f-bdff-148106df2a8c tempest-TaggedBootDevicesTest_v242-1057228886 None] attachment_update completed successfully. Feb 05 20:53:52.444787 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 20:53:52.446120 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:53:52.608055 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:53:52.714912 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 20:54:49.511226 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-8bb11cc3-abed-4c08-9513-09b9b47de6c1 tempest-DeleteServersTestJSON-1701972944 None] Lock "b'cinder-a1062aa8-5581-42b7-baba-7502c9bd2044-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 20:54:49.567674 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8bb11cc3-abed-4c08-9513-09b9b47de6c1 tempest-DeleteServersTestJSON-1701972944 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:54:49.658104 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8bb11cc3-abed-4c08-9513-09b9b47de6c1 tempest-DeleteServersTestJSON-1701972944 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 20:54:49.658395 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8bb11cc3-abed-4c08-9513-09b9b47de6c1 tempest-DeleteServersTestJSON-1701972944 None] Volume volume-a1062aa8-5581-42b7-baba-7502c9bd2044 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 20:54:49.673154 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8bb11cc3-abed-4c08-9513-09b9b47de6c1 tempest-DeleteServersTestJSON-1701972944 None] deleting rbd volume volume-a1062aa8-5581-42b7-baba-7502c9bd2044 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 20:54:50.146516 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-8bb11cc3-abed-4c08-9513-09b9b47de6c1 tempest-DeleteServersTestJSON-1701972944 None] Created reservations ['f7bce9d1-6361-45ec-a358-36072dba20d2', '07aaf676-1add-4ed1-b677-48a62f81a38d', '7155a412-3a88-4973-a9b1-d66267f8afef', 'b5646f66-3777-4d64-97ca-003c8afa22ae'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 20:54:50.224198 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8bb11cc3-abed-4c08-9513-09b9b47de6c1 tempest-DeleteServersTestJSON-1701972944 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:54:50.282423 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8bb11cc3-abed-4c08-9513-09b9b47de6c1 tempest-DeleteServersTestJSON-1701972944 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:54:50.354742 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-8bb11cc3-abed-4c08-9513-09b9b47de6c1 tempest-DeleteServersTestJSON-1701972944 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 20:54:50.368690 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-8bb11cc3-abed-4c08-9513-09b9b47de6c1 tempest-DeleteServersTestJSON-1701972944 None] Deleted volume successfully. Feb 05 20:54:50.392030 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-8bb11cc3-abed-4c08-9513-09b9b47de6c1 tempest-DeleteServersTestJSON-1701972944 None] Lock "b'cinder-a1062aa8-5581-42b7-baba-7502c9bd2044-delete_volume'" released by "delete_volume" :: held 0.881s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 20:54:52.332520 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-92c24338-7741-4083-8ec5-d1c43dc89ed7 tempest-AttachSCSIVolumeTestJSON-1277213231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 20:54:52.347527 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-92c24338-7741-4083-8ec5-d1c43dc89ed7 tempest-AttachSCSIVolumeTestJSON-1277213231 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 20:54:52.348351 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-92c24338-7741-4083-8ec5-d1c43dc89ed7 tempest-AttachSCSIVolumeTestJSON-1277213231 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 20:54:52.406627 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-92c24338-7741-4083-8ec5-d1c43dc89ed7 tempest-AttachSCSIVolumeTestJSON-1277213231 None] Flow 'volume_create_manager' (67b635dc-40c0-494b-81da-22740c881bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 20:54:52.464232 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-92c24338-7741-4083-8ec5-d1c43dc89ed7 tempest-AttachSCSIVolumeTestJSON-1277213231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c96bea-d779-4fc7-872f-d7b38170e2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:54:52.479513 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-92c24338-7741-4083-8ec5-d1c43dc89ed7 tempest-AttachSCSIVolumeTestJSON-1277213231 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 20:54:52.571894 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 20:54:52.574107 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:54:52.673748 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:54:52.754666 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 20:54:52.764902 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-92c24338-7741-4083-8ec5-d1c43dc89ed7 tempest-AttachSCSIVolumeTestJSON-1277213231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c96bea-d779-4fc7-872f-d7b38170e2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T20:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-854536024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=dbd3ca32-d6db-483a-b608-ca7e893a8688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='339b42dac6c241a48a04f59918ef065e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T20:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T20:54:52Z,use_quota=True,user_id='1e5303c80c02478bb3a2bcec83ec6013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:54:52.771052 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-92c24338-7741-4083-8ec5-d1c43dc89ed7 tempest-AttachSCSIVolumeTestJSON-1277213231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69385fb6-19f4-4c63-8a71-ce9f3ff538d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:54:52.776015 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-92c24338-7741-4083-8ec5-d1c43dc89ed7 tempest-AttachSCSIVolumeTestJSON-1277213231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69385fb6-19f4-4c63-8a71-ce9f3ff538d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:54:52.782908 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-92c24338-7741-4083-8ec5-d1c43dc89ed7 tempest-AttachSCSIVolumeTestJSON-1277213231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6124a5b-f7e3-413b-beb2-3b3856f62999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:54:52.789339 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-92c24338-7741-4083-8ec5-d1c43dc89ed7 tempest-AttachSCSIVolumeTestJSON-1277213231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6124a5b-f7e3-413b-beb2-3b3856f62999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbd3ca32-d6db-483a-b608-ca7e893a8688', 'volume_name': 'volume-dbd3ca32-d6db-483a-b608-ca7e893a8688', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:54:52.795699 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-92c24338-7741-4083-8ec5-d1c43dc89ed7 tempest-AttachSCSIVolumeTestJSON-1277213231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5f9b353-2287-41a3-9ca4-a0e30108380e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:54:52.801552 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-92c24338-7741-4083-8ec5-d1c43dc89ed7 tempest-AttachSCSIVolumeTestJSON-1277213231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5f9b353-2287-41a3-9ca4-a0e30108380e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:54:52.809284 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-92c24338-7741-4083-8ec5-d1c43dc89ed7 tempest-AttachSCSIVolumeTestJSON-1277213231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e1d60ad-13e4-4fa0-9e4b-d0fdfff1a7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:54:52.811075 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-92c24338-7741-4083-8ec5-d1c43dc89ed7 tempest-AttachSCSIVolumeTestJSON-1277213231 None] Volume dbd3ca32-d6db-483a-b608-ca7e893a8688: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbd3ca32-d6db-483a-b608-ca7e893a8688', 'volume_size': 1} Feb 05 20:54:52.811665 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-92c24338-7741-4083-8ec5-d1c43dc89ed7 tempest-AttachSCSIVolumeTestJSON-1277213231 None] creating volume 'volume-dbd3ca32-d6db-483a-b608-ca7e893a8688' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 20:54:52.813574 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-92c24338-7741-4083-8ec5-d1c43dc89ed7 tempest-AttachSCSIVolumeTestJSON-1277213231 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:54:52.985044 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-92c24338-7741-4083-8ec5-d1c43dc89ed7 tempest-AttachSCSIVolumeTestJSON-1277213231 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 20:54:52.985437 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-92c24338-7741-4083-8ec5-d1c43dc89ed7 tempest-AttachSCSIVolumeTestJSON-1277213231 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 20:54:52.989209 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-92c24338-7741-4083-8ec5-d1c43dc89ed7 tempest-AttachSCSIVolumeTestJSON-1277213231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e1d60ad-13e4-4fa0-9e4b-d0fdfff1a7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbd3ca32-d6db-483a-b608-ca7e893a8688', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:54:52.999647 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-92c24338-7741-4083-8ec5-d1c43dc89ed7 tempest-AttachSCSIVolumeTestJSON-1277213231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33974dc0-406f-4cf1-9345-85afb72f3d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:54:53.018153 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-92c24338-7741-4083-8ec5-d1c43dc89ed7 tempest-AttachSCSIVolumeTestJSON-1277213231 None] Volume volume-dbd3ca32-d6db-483a-b608-ca7e893a8688 (dbd3ca32-d6db-483a-b608-ca7e893a8688): created successfully Feb 05 20:54:53.022592 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-92c24338-7741-4083-8ec5-d1c43dc89ed7 tempest-AttachSCSIVolumeTestJSON-1277213231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33974dc0-406f-4cf1-9345-85afb72f3d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:54:53.029282 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-92c24338-7741-4083-8ec5-d1c43dc89ed7 tempest-AttachSCSIVolumeTestJSON-1277213231 None] Flow 'volume_create_manager' (67b635dc-40c0-494b-81da-22740c881bf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 20:54:53.044312 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-92c24338-7741-4083-8ec5-d1c43dc89ed7 tempest-AttachSCSIVolumeTestJSON-1277213231 None] Created volume successfully. Feb 05 20:54:54.769892 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-39f92718-d9ee-4882-9f81-2514f6c1cee0 req-6d5638f5-acaa-41d7-9b83-a0db0dc39b80 tempest-AttachSCSIVolumeTestJSON-1277213231 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 20:54:55.030898 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [req-06eec1b1-cc50-4832-99df-760e07e99a8d req-d9b3c0b4-6da4-4394-989e-70b95e2f732e tempest-VolumesGetTestJSON-623409133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 20:54:55.035730 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [req-06eec1b1-cc50-4832-99df-760e07e99a8d req-d9b3c0b4-6da4-4394-989e-70b95e2f732e tempest-VolumesGetTestJSON-623409133 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 20:54:55.036245 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [req-06eec1b1-cc50-4832-99df-760e07e99a8d req-d9b3c0b4-6da4-4394-989e-70b95e2f732e tempest-VolumesGetTestJSON-623409133 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 20:54:55.098233 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-06eec1b1-cc50-4832-99df-760e07e99a8d req-d9b3c0b4-6da4-4394-989e-70b95e2f732e tempest-VolumesGetTestJSON-623409133 None] Flow 'volume_create_manager' (cbcf251f-a1ad-455c-b308-08a6fd8526dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 20:54:55.124494 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-06eec1b1-cc50-4832-99df-760e07e99a8d req-d9b3c0b4-6da4-4394-989e-70b95e2f732e tempest-VolumesGetTestJSON-623409133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b298e1f-f8c3-4ab8-9eea-66f1071a458c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:54:55.147473 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [req-06eec1b1-cc50-4832-99df-760e07e99a8d req-d9b3c0b4-6da4-4394-989e-70b95e2f732e tempest-VolumesGetTestJSON-623409133 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 20:54:55.168140 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-06eec1b1-cc50-4832-99df-760e07e99a8d req-d9b3c0b4-6da4-4394-989e-70b95e2f732e tempest-VolumesGetTestJSON-623409133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b298e1f-f8c3-4ab8-9eea-66f1071a458c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T20:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1897693244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3cf3f4af-f81c-4676-9a67-30f012118b17,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c04128ed5f364ba99a15c3fd01857ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T20:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T20:54:55Z,use_quota=True,user_id='ef8c3790f27043daa67920a13d095f4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:54:55.174078 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-06eec1b1-cc50-4832-99df-760e07e99a8d req-d9b3c0b4-6da4-4394-989e-70b95e2f732e tempest-VolumesGetTestJSON-623409133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91e2bce1-a0a3-4341-87c7-3451edaeba83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:54:55.184148 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-06eec1b1-cc50-4832-99df-760e07e99a8d req-d9b3c0b4-6da4-4394-989e-70b95e2f732e tempest-VolumesGetTestJSON-623409133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91e2bce1-a0a3-4341-87c7-3451edaeba83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:54:55.190638 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-06eec1b1-cc50-4832-99df-760e07e99a8d req-d9b3c0b4-6da4-4394-989e-70b95e2f732e tempest-VolumesGetTestJSON-623409133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2ed06c1-9ee4-48b2-8897-bc5fea8d789d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:54:55.196750 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-06eec1b1-cc50-4832-99df-760e07e99a8d req-d9b3c0b4-6da4-4394-989e-70b95e2f732e tempest-VolumesGetTestJSON-623409133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2ed06c1-9ee4-48b2-8897-bc5fea8d789d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cf3f4af-f81c-4676-9a67-30f012118b17', 'volume_name': 'volume-3cf3f4af-f81c-4676-9a67-30f012118b17', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:54:55.202595 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-06eec1b1-cc50-4832-99df-760e07e99a8d req-d9b3c0b4-6da4-4394-989e-70b95e2f732e tempest-VolumesGetTestJSON-623409133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94017c48-fbb6-47dd-b088-b4f47b11a22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:54:55.207114 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-06eec1b1-cc50-4832-99df-760e07e99a8d req-d9b3c0b4-6da4-4394-989e-70b95e2f732e tempest-VolumesGetTestJSON-623409133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94017c48-fbb6-47dd-b088-b4f47b11a22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:54:55.212760 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-06eec1b1-cc50-4832-99df-760e07e99a8d req-d9b3c0b4-6da4-4394-989e-70b95e2f732e tempest-VolumesGetTestJSON-623409133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (373dd015-99b7-4fdc-b69d-98a9fa3757a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:54:55.214126 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [req-06eec1b1-cc50-4832-99df-760e07e99a8d req-d9b3c0b4-6da4-4394-989e-70b95e2f732e tempest-VolumesGetTestJSON-623409133 None] Volume 3cf3f4af-f81c-4676-9a67-30f012118b17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cf3f4af-f81c-4676-9a67-30f012118b17', 'volume_size': 1} Feb 05 20:54:55.214752 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-06eec1b1-cc50-4832-99df-760e07e99a8d req-d9b3c0b4-6da4-4394-989e-70b95e2f732e tempest-VolumesGetTestJSON-623409133 None] creating volume 'volume-3cf3f4af-f81c-4676-9a67-30f012118b17' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 20:54:55.216105 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-06eec1b1-cc50-4832-99df-760e07e99a8d req-d9b3c0b4-6da4-4394-989e-70b95e2f732e tempest-VolumesGetTestJSON-623409133 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:54:55.337831 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-06eec1b1-cc50-4832-99df-760e07e99a8d req-d9b3c0b4-6da4-4394-989e-70b95e2f732e tempest-VolumesGetTestJSON-623409133 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 20:54:55.338222 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-06eec1b1-cc50-4832-99df-760e07e99a8d req-d9b3c0b4-6da4-4394-989e-70b95e2f732e tempest-VolumesGetTestJSON-623409133 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 20:54:55.346248 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-06eec1b1-cc50-4832-99df-760e07e99a8d req-d9b3c0b4-6da4-4394-989e-70b95e2f732e tempest-VolumesGetTestJSON-623409133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (373dd015-99b7-4fdc-b69d-98a9fa3757a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cf3f4af-f81c-4676-9a67-30f012118b17', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:54:55.353421 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-06eec1b1-cc50-4832-99df-760e07e99a8d req-d9b3c0b4-6da4-4394-989e-70b95e2f732e tempest-VolumesGetTestJSON-623409133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b394821c-e940-46fe-8fc9-9ff10704bcba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:54:55.398033 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [req-06eec1b1-cc50-4832-99df-760e07e99a8d req-d9b3c0b4-6da4-4394-989e-70b95e2f732e tempest-VolumesGetTestJSON-623409133 None] Volume volume-3cf3f4af-f81c-4676-9a67-30f012118b17 (3cf3f4af-f81c-4676-9a67-30f012118b17): created successfully Feb 05 20:54:55.408616 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-06eec1b1-cc50-4832-99df-760e07e99a8d req-d9b3c0b4-6da4-4394-989e-70b95e2f732e tempest-VolumesGetTestJSON-623409133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b394821c-e940-46fe-8fc9-9ff10704bcba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:54:55.429550 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-06eec1b1-cc50-4832-99df-760e07e99a8d req-d9b3c0b4-6da4-4394-989e-70b95e2f732e tempest-VolumesGetTestJSON-623409133 None] Flow 'volume_create_manager' (cbcf251f-a1ad-455c-b308-08a6fd8526dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 20:54:55.450042 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-06eec1b1-cc50-4832-99df-760e07e99a8d req-d9b3c0b4-6da4-4394-989e-70b95e2f732e tempest-VolumesGetTestJSON-623409133 None] Created volume successfully. Feb 05 20:54:55.887697 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-39f92718-d9ee-4882-9f81-2514f6c1cee0 req-6d5638f5-acaa-41d7-9b83-a0db0dc39b80 tempest-AttachSCSIVolumeTestJSON-1277213231 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.118s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 20:54:55.889261 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-39f92718-d9ee-4882-9f81-2514f6c1cee0 req-6d5638f5-acaa-41d7-9b83-a0db0dc39b80 tempest-AttachSCSIVolumeTestJSON-1277213231 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-dbd3ca32-d6db-483a-b608-ca7e893a8688', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': 'dbd3ca32-d6db-483a-b608-ca7e893a8688', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 20:54:55.926541 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-39f92718-d9ee-4882-9f81-2514f6c1cee0 req-6d5638f5-acaa-41d7-9b83-a0db0dc39b80 tempest-AttachSCSIVolumeTestJSON-1277213231 None] Connection info returned from driver {'name': 'volumes/volume-dbd3ca32-d6db-483a-b608-ca7e893a8688', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'dbd3ca32-d6db-483a-b608-ca7e893a8688', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '03b60dbe-a9de-4b7f-945e-b713964e2785'} {{(pid=122683) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 05 20:54:56.014525 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-39f92718-d9ee-4882-9f81-2514f6c1cee0 req-6d5638f5-acaa-41d7-9b83-a0db0dc39b80 tempest-AttachSCSIVolumeTestJSON-1277213231 None] attachment_update completed successfully. Feb 05 20:54:56.244987 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [req-161c11af-2aeb-4eb8-8e5a-61bc87eeb4dd req-7a28ef3b-e52b-463a-9b7f-6dc0658a41fc tempest-VolumesGetTestJSON-623409133 None] Lock "b'cinder-3cf3f4af-f81c-4676-9a67-30f012118b17-delete_volume'" acquired by "delete_volume" :: waited 0.032s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 20:54:56.292810 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-161c11af-2aeb-4eb8-8e5a-61bc87eeb4dd req-7a28ef3b-e52b-463a-9b7f-6dc0658a41fc tempest-VolumesGetTestJSON-623409133 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:54:56.341048 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-161c11af-2aeb-4eb8-8e5a-61bc87eeb4dd req-7a28ef3b-e52b-463a-9b7f-6dc0658a41fc tempest-VolumesGetTestJSON-623409133 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 20:54:56.341510 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-161c11af-2aeb-4eb8-8e5a-61bc87eeb4dd req-7a28ef3b-e52b-463a-9b7f-6dc0658a41fc tempest-VolumesGetTestJSON-623409133 None] Volume volume-3cf3f4af-f81c-4676-9a67-30f012118b17 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 20:54:56.359580 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-161c11af-2aeb-4eb8-8e5a-61bc87eeb4dd req-7a28ef3b-e52b-463a-9b7f-6dc0658a41fc tempest-VolumesGetTestJSON-623409133 None] deleting rbd volume volume-3cf3f4af-f81c-4676-9a67-30f012118b17 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 20:54:56.714542 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [req-161c11af-2aeb-4eb8-8e5a-61bc87eeb4dd req-7a28ef3b-e52b-463a-9b7f-6dc0658a41fc tempest-VolumesGetTestJSON-623409133 None] Created reservations ['a65272f8-44e2-4ad4-92a4-96066b3075b9', '182205ac-8d80-4718-88a1-acac21a1022d', '3b657ea9-4b9a-4a03-b2f9-2fd895383a11', 'de54aa3b-00de-4d87-b074-34a059692e04'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 20:54:56.780323 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-161c11af-2aeb-4eb8-8e5a-61bc87eeb4dd req-7a28ef3b-e52b-463a-9b7f-6dc0658a41fc tempest-VolumesGetTestJSON-623409133 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:54:56.822428 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-161c11af-2aeb-4eb8-8e5a-61bc87eeb4dd req-7a28ef3b-e52b-463a-9b7f-6dc0658a41fc tempest-VolumesGetTestJSON-623409133 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:54:56.862610 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [req-161c11af-2aeb-4eb8-8e5a-61bc87eeb4dd req-7a28ef3b-e52b-463a-9b7f-6dc0658a41fc tempest-VolumesGetTestJSON-623409133 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 20:54:56.868965 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-161c11af-2aeb-4eb8-8e5a-61bc87eeb4dd req-7a28ef3b-e52b-463a-9b7f-6dc0658a41fc tempest-VolumesGetTestJSON-623409133 None] Deleted volume successfully. Feb 05 20:54:56.907550 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [req-161c11af-2aeb-4eb8-8e5a-61bc87eeb4dd req-7a28ef3b-e52b-463a-9b7f-6dc0658a41fc tempest-VolumesGetTestJSON-623409133 None] Lock "b'cinder-3cf3f4af-f81c-4676-9a67-30f012118b17-delete_volume'" released by "delete_volume" :: held 0.663s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 20:55:00.120771 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-f64d73b4-bfca-4f04-9af1-bbcc71c29168 req-d6039778-0913-4ea8-b067-e9dea740f425 tempest-AttachSCSIVolumeTestJSON-1277213231 None] Terminate volume connection completed successfully. Feb 05 20:55:00.125976 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-f64d73b4-bfca-4f04-9af1-bbcc71c29168 req-d6039778-0913-4ea8-b067-e9dea740f425 tempest-AttachSCSIVolumeTestJSON-1277213231 None] Deleting attachment 03b60dbe-a9de-4b7f-945e-b713964e2785. {{(pid=122683) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 05 20:55:09.820700 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-feb8f314-8b3f-47c0-808c-97c055a7ef33 tempest-AttachSCSIVolumeTestJSON-1277213231 None] Lock "b'cinder-dbd3ca32-d6db-483a-b608-ca7e893a8688-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 20:55:09.968516 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-feb8f314-8b3f-47c0-808c-97c055a7ef33 tempest-AttachSCSIVolumeTestJSON-1277213231 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:55:10.106730 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-feb8f314-8b3f-47c0-808c-97c055a7ef33 tempest-AttachSCSIVolumeTestJSON-1277213231 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 20:55:10.107167 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-feb8f314-8b3f-47c0-808c-97c055a7ef33 tempest-AttachSCSIVolumeTestJSON-1277213231 None] Volume volume-dbd3ca32-d6db-483a-b608-ca7e893a8688 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 20:55:10.121055 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-feb8f314-8b3f-47c0-808c-97c055a7ef33 tempest-AttachSCSIVolumeTestJSON-1277213231 None] deleting rbd volume volume-dbd3ca32-d6db-483a-b608-ca7e893a8688 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 20:55:10.899816 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-feb8f314-8b3f-47c0-808c-97c055a7ef33 tempest-AttachSCSIVolumeTestJSON-1277213231 None] Created reservations ['0eb0e41e-572b-44ff-8450-d70f007d36e1', 'b7cca52e-12be-4f89-98d9-5ac607792b84', '08f08e77-db8a-4c5a-9703-a2af7553c964', 'ecf9240d-1522-4e0d-98e4-25be2b280cd3'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 20:55:11.025453 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-feb8f314-8b3f-47c0-808c-97c055a7ef33 tempest-AttachSCSIVolumeTestJSON-1277213231 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:55:11.148901 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-feb8f314-8b3f-47c0-808c-97c055a7ef33 tempest-AttachSCSIVolumeTestJSON-1277213231 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:55:11.282705 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-feb8f314-8b3f-47c0-808c-97c055a7ef33 tempest-AttachSCSIVolumeTestJSON-1277213231 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 20:55:11.287869 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-feb8f314-8b3f-47c0-808c-97c055a7ef33 tempest-AttachSCSIVolumeTestJSON-1277213231 None] Deleted volume successfully. Feb 05 20:55:11.339599 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-feb8f314-8b3f-47c0-808c-97c055a7ef33 tempest-AttachSCSIVolumeTestJSON-1277213231 None] Lock "b'cinder-dbd3ca32-d6db-483a-b608-ca7e893a8688-delete_volume'" released by "delete_volume" :: held 1.521s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 20:55:14.139708 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-8261622f-99cf-4c56-af51-4e266e193d57 tempest-TaggedBootDevicesTest-547170310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 20:55:14.152632 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-8261622f-99cf-4c56-af51-4e266e193d57 tempest-TaggedBootDevicesTest-547170310 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 20:55:14.153087 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-8261622f-99cf-4c56-af51-4e266e193d57 tempest-TaggedBootDevicesTest-547170310 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 20:55:14.205268 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8261622f-99cf-4c56-af51-4e266e193d57 tempest-TaggedBootDevicesTest-547170310 None] Flow 'volume_create_manager' (b3e2becb-3baa-48ae-af59-8c13562b8211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 20:55:14.290472 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8261622f-99cf-4c56-af51-4e266e193d57 tempest-TaggedBootDevicesTest-547170310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17f494f6-b576-4fc4-af8d-011cd6422621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:55:14.308618 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-8261622f-99cf-4c56-af51-4e266e193d57 tempest-TaggedBootDevicesTest-547170310 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 20:55:14.363343 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8261622f-99cf-4c56-af51-4e266e193d57 tempest-TaggedBootDevicesTest-547170310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17f494f6-b576-4fc4-af8d-011cd6422621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T20:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-43852430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b7715ffc-afa8-4753-b29c-82554a24d216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='451be3a617f64d6a97b8d18cee2426e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T20:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T20:55:14Z,use_quota=True,user_id='c71c192ebc864256aeeafa60a376aa7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:55:14.387817 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8261622f-99cf-4c56-af51-4e266e193d57 tempest-TaggedBootDevicesTest-547170310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (622e0bc1-362e-4ca4-bf96-4fa0e4a39ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:55:14.394232 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8261622f-99cf-4c56-af51-4e266e193d57 tempest-TaggedBootDevicesTest-547170310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (622e0bc1-362e-4ca4-bf96-4fa0e4a39ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:55:14.411277 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8261622f-99cf-4c56-af51-4e266e193d57 tempest-TaggedBootDevicesTest-547170310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d49e0b5b-b724-44ac-b98b-dd33364cf980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:55:14.621948 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8261622f-99cf-4c56-af51-4e266e193d57 tempest-TaggedBootDevicesTest-547170310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d49e0b5b-b724-44ac-b98b-dd33364cf980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b7715ffc-afa8-4753-b29c-82554a24d216', 'volume_name': 'volume-b7715ffc-afa8-4753-b29c-82554a24d216', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:55:14.629944 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8261622f-99cf-4c56-af51-4e266e193d57 tempest-TaggedBootDevicesTest-547170310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (268d9cba-ecb6-4978-89c8-6c7833c06a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:55:14.645392 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8261622f-99cf-4c56-af51-4e266e193d57 tempest-TaggedBootDevicesTest-547170310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (268d9cba-ecb6-4978-89c8-6c7833c06a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:55:14.654772 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8261622f-99cf-4c56-af51-4e266e193d57 tempest-TaggedBootDevicesTest-547170310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a11e4acd-7484-4458-8311-f59765efdc77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:55:14.656295 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-8261622f-99cf-4c56-af51-4e266e193d57 tempest-TaggedBootDevicesTest-547170310 None] Volume b7715ffc-afa8-4753-b29c-82554a24d216: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b7715ffc-afa8-4753-b29c-82554a24d216', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 05 20:55:14.657235 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-8261622f-99cf-4c56-af51-4e266e193d57 tempest-TaggedBootDevicesTest-547170310 None] Cloning b7715ffc-afa8-4753-b29c-82554a24d216 from image e66a3a3b-d2f9-4d5d-8021-a6001dff419f at location (None, None). {{(pid=122683) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 05 20:55:14.680813 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-8261622f-99cf-4c56-af51-4e266e193d57 tempest-TaggedBootDevicesTest-547170310 None] Lock "b'cinder-e66a3a3b-d2f9-4d5d-8021-a6001dff419f'" acquired by "_prepare_image_cache_entry" :: waited 0.022s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 20:55:14.722221 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-8261622f-99cf-4c56-af51-4e266e193d57 tempest-TaggedBootDevicesTest-547170310 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'volume_id': '311ef4be-45fd-4167-a3ad-6251d56550a7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57), 'last_used': datetime.datetime(2022, 2, 5, 20, 55, 14, 686972)}. {{(pid=122683) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 05 20:55:14.722989 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-8261622f-99cf-4c56-af51-4e266e193d57 tempest-TaggedBootDevicesTest-547170310 None] Image-volume cache entry image_update_at = 2022-02-05 20:37:57+00:00, requested image updated_at = 2022-02-05 20:37:57+00:00. {{(pid=122683) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 05 20:55:14.723870 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-8261622f-99cf-4c56-af51-4e266e193d57 tempest-TaggedBootDevicesTest-547170310 None] Found cache entry for image = e66a3a3b-d2f9-4d5d-8021-a6001dff419f on host ncdv-master-1@ceph#ceph. {{(pid=122683) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Feb 05 20:55:14.754845 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-8261622f-99cf-4c56-af51-4e266e193d57 tempest-TaggedBootDevicesTest-547170310 None] Lock "b'cinder-e66a3a3b-d2f9-4d5d-8021-a6001dff419f'" released by "_prepare_image_cache_entry" :: held 0.074s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 20:55:14.758967 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-8261622f-99cf-4c56-af51-4e266e193d57 tempest-TaggedBootDevicesTest-547170310 None] Attempting to retrieve cache entry for image = e66a3a3b-d2f9-4d5d-8021-a6001dff419f on host ncdv-master-1@ceph#ceph. {{(pid=122683) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 05 20:55:14.775251 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-8261622f-99cf-4c56-af51-4e266e193d57 tempest-TaggedBootDevicesTest-547170310 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'volume_id': '311ef4be-45fd-4167-a3ad-6251d56550a7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57), 'last_used': datetime.datetime(2022, 2, 5, 20, 55, 14, 767135)}. {{(pid=122683) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 05 20:55:14.777729 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-8261622f-99cf-4c56-af51-4e266e193d57 tempest-TaggedBootDevicesTest-547170310 None] Image-volume cache entry image_update_at = 2022-02-05 20:37:57+00:00, requested image updated_at = 2022-02-05 20:37:57+00:00. {{(pid=122683) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 05 20:55:14.778199 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-8261622f-99cf-4c56-af51-4e266e193d57 tempest-TaggedBootDevicesTest-547170310 None] Creating from source image-volume 311ef4be-45fd-4167-a3ad-6251d56550a7 {{(pid=122683) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Feb 05 20:55:14.809672 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8261622f-99cf-4c56-af51-4e266e193d57 tempest-TaggedBootDevicesTest-547170310 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:55:14.912829 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8261622f-99cf-4c56-af51-4e266e193d57 tempest-TaggedBootDevicesTest-547170310 None] creating snapshot='volume-b7715ffc-afa8-4753-b29c-82554a24d216.clone_snap' {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 05 20:55:15.167011 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8261622f-99cf-4c56-af51-4e266e193d57 tempest-TaggedBootDevicesTest-547170310 None] cloning 'volume-311ef4be-45fd-4167-a3ad-6251d56550a7@volume-b7715ffc-afa8-4753-b29c-82554a24d216.clone_snap' to 'volume-b7715ffc-afa8-4753-b29c-82554a24d216' {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 05 20:55:15.587378 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8261622f-99cf-4c56-af51-4e266e193d57 tempest-TaggedBootDevicesTest-547170310 None] Volume volume-35445a36-a76c-48db-a9c5-3b58646c1e7b.deleted is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 20:55:15.589177 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8261622f-99cf-4c56-af51-4e266e193d57 tempest-TaggedBootDevicesTest-547170310 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 20:55:15.589876 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8261622f-99cf-4c56-af51-4e266e193d57 tempest-TaggedBootDevicesTest-547170310 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 20:55:15.624816 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8261622f-99cf-4c56-af51-4e266e193d57 tempest-TaggedBootDevicesTest-547170310 None] clone created successfully {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 05 20:55:15.625447 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.volume_utils [None req-8261622f-99cf-4c56-af51-4e266e193d57 tempest-TaggedBootDevicesTest-547170310 None] Marking volume b7715ffc-afa8-4753-b29c-82554a24d216 as bootable. {{(pid=122683) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Feb 05 20:55:15.652953 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-8261622f-99cf-4c56-af51-4e266e193d57 tempest-TaggedBootDevicesTest-547170310 None] Copying metadata from image e66a3a3b-d2f9-4d5d-8021-a6001dff419f to b7715ffc-afa8-4753-b29c-82554a24d216. {{(pid=122683) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 05 20:55:15.656756 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-8261622f-99cf-4c56-af51-4e266e193d57 tempest-TaggedBootDevicesTest-547170310 None] Creating volume glance metadata for volume b7715ffc-afa8-4753-b29c-82554a24d216 backed by image e66a3a3b-d2f9-4d5d-8021-a6001dff419f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=122683) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 05 20:55:15.817910 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8261622f-99cf-4c56-af51-4e266e193d57 tempest-TaggedBootDevicesTest-547170310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a11e4acd-7484-4458-8311-f59765efdc77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7715ffc-afa8-4753-b29c-82554a24d216', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:55:15.829260 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8261622f-99cf-4c56-af51-4e266e193d57 tempest-TaggedBootDevicesTest-547170310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23f4c607-65d4-4ceb-b245-6c461bfded1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:55:15.856957 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-8261622f-99cf-4c56-af51-4e266e193d57 tempest-TaggedBootDevicesTest-547170310 None] Volume volume-b7715ffc-afa8-4753-b29c-82554a24d216 (b7715ffc-afa8-4753-b29c-82554a24d216): created successfully Feb 05 20:55:15.867338 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8261622f-99cf-4c56-af51-4e266e193d57 tempest-TaggedBootDevicesTest-547170310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23f4c607-65d4-4ceb-b245-6c461bfded1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:55:15.890036 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8261622f-99cf-4c56-af51-4e266e193d57 tempest-TaggedBootDevicesTest-547170310 None] Flow 'volume_create_manager' (b3e2becb-3baa-48ae-af59-8c13562b8211) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 20:55:15.904540 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-8261622f-99cf-4c56-af51-4e266e193d57 tempest-TaggedBootDevicesTest-547170310 None] Created volume successfully. Feb 05 20:55:16.913500 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-11e6e9c7-f3b6-45f7-8c77-6a4c19ab4f6e tempest-TaggedBootDevicesTest-547170310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 20:55:16.917352 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-11e6e9c7-f3b6-45f7-8c77-6a4c19ab4f6e tempest-TaggedBootDevicesTest-547170310 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 20:55:16.917865 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-11e6e9c7-f3b6-45f7-8c77-6a4c19ab4f6e tempest-TaggedBootDevicesTest-547170310 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 20:55:16.963380 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-11e6e9c7-f3b6-45f7-8c77-6a4c19ab4f6e tempest-TaggedBootDevicesTest-547170310 None] Flow 'volume_create_manager' (753adb1a-e375-42aa-bdc1-cde335778c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 20:55:16.978470 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-11e6e9c7-f3b6-45f7-8c77-6a4c19ab4f6e tempest-TaggedBootDevicesTest-547170310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efbca0d6-7baf-49a6-858a-8ebbcd601014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:55:16.999170 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-11e6e9c7-f3b6-45f7-8c77-6a4c19ab4f6e tempest-TaggedBootDevicesTest-547170310 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 20:55:17.046105 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-11e6e9c7-f3b6-45f7-8c77-6a4c19ab4f6e tempest-TaggedBootDevicesTest-547170310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efbca0d6-7baf-49a6-858a-8ebbcd601014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T20:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-479569899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=94129f58-a380-4835-a6c7-7999a4d49a8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='451be3a617f64d6a97b8d18cee2426e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T20:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T20:55:17Z,use_quota=True,user_id='c71c192ebc864256aeeafa60a376aa7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:55:17.059079 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-11e6e9c7-f3b6-45f7-8c77-6a4c19ab4f6e tempest-TaggedBootDevicesTest-547170310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1790f015-ef8f-4b87-bfa1-0d23e56065df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:55:17.068039 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-11e6e9c7-f3b6-45f7-8c77-6a4c19ab4f6e tempest-TaggedBootDevicesTest-547170310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1790f015-ef8f-4b87-bfa1-0d23e56065df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:55:17.074012 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-11e6e9c7-f3b6-45f7-8c77-6a4c19ab4f6e tempest-TaggedBootDevicesTest-547170310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91d7bd70-cb7c-485b-a4d0-1bd0c3911f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:55:17.091163 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-11e6e9c7-f3b6-45f7-8c77-6a4c19ab4f6e tempest-TaggedBootDevicesTest-547170310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91d7bd70-cb7c-485b-a4d0-1bd0c3911f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94129f58-a380-4835-a6c7-7999a4d49a8b', 'volume_name': 'volume-94129f58-a380-4835-a6c7-7999a4d49a8b', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:55:17.097548 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-11e6e9c7-f3b6-45f7-8c77-6a4c19ab4f6e tempest-TaggedBootDevicesTest-547170310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7da2d8a-176c-48dd-b65e-c31f00cdafd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:55:17.103470 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-11e6e9c7-f3b6-45f7-8c77-6a4c19ab4f6e tempest-TaggedBootDevicesTest-547170310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7da2d8a-176c-48dd-b65e-c31f00cdafd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:55:17.110019 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-11e6e9c7-f3b6-45f7-8c77-6a4c19ab4f6e tempest-TaggedBootDevicesTest-547170310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57638042-743c-4bf2-8014-e64f4cbdd1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:55:17.111408 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-11e6e9c7-f3b6-45f7-8c77-6a4c19ab4f6e tempest-TaggedBootDevicesTest-547170310 None] Volume 94129f58-a380-4835-a6c7-7999a4d49a8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94129f58-a380-4835-a6c7-7999a4d49a8b', 'volume_size': 1} Feb 05 20:55:17.112039 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-11e6e9c7-f3b6-45f7-8c77-6a4c19ab4f6e tempest-TaggedBootDevicesTest-547170310 None] creating volume 'volume-94129f58-a380-4835-a6c7-7999a4d49a8b' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 20:55:17.113374 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-11e6e9c7-f3b6-45f7-8c77-6a4c19ab4f6e tempest-TaggedBootDevicesTest-547170310 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:55:17.279833 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-11e6e9c7-f3b6-45f7-8c77-6a4c19ab4f6e tempest-TaggedBootDevicesTest-547170310 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 20:55:17.280841 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-11e6e9c7-f3b6-45f7-8c77-6a4c19ab4f6e tempest-TaggedBootDevicesTest-547170310 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 20:55:17.291942 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-11e6e9c7-f3b6-45f7-8c77-6a4c19ab4f6e tempest-TaggedBootDevicesTest-547170310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57638042-743c-4bf2-8014-e64f4cbdd1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94129f58-a380-4835-a6c7-7999a4d49a8b', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:55:17.318796 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-11e6e9c7-f3b6-45f7-8c77-6a4c19ab4f6e tempest-TaggedBootDevicesTest-547170310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5a67406-c088-4c11-bee6-0bc322e51e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:55:17.347596 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-11e6e9c7-f3b6-45f7-8c77-6a4c19ab4f6e tempest-TaggedBootDevicesTest-547170310 None] Volume volume-94129f58-a380-4835-a6c7-7999a4d49a8b (94129f58-a380-4835-a6c7-7999a4d49a8b): created successfully Feb 05 20:55:17.356558 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-11e6e9c7-f3b6-45f7-8c77-6a4c19ab4f6e tempest-TaggedBootDevicesTest-547170310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5a67406-c088-4c11-bee6-0bc322e51e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:55:17.367194 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-11e6e9c7-f3b6-45f7-8c77-6a4c19ab4f6e tempest-TaggedBootDevicesTest-547170310 None] Flow 'volume_create_manager' (753adb1a-e375-42aa-bdc1-cde335778c3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 20:55:17.386290 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-11e6e9c7-f3b6-45f7-8c77-6a4c19ab4f6e tempest-TaggedBootDevicesTest-547170310 None] Created volume successfully. Feb 05 20:55:18.937783 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-20841805-ce2b-48d4-8c7e-e574b684978b tempest-TaggedBootDevicesTest-547170310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 20:55:18.944351 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-20841805-ce2b-48d4-8c7e-e574b684978b tempest-TaggedBootDevicesTest-547170310 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 20:55:18.945184 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-20841805-ce2b-48d4-8c7e-e574b684978b tempest-TaggedBootDevicesTest-547170310 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 20:55:18.992501 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-20841805-ce2b-48d4-8c7e-e574b684978b tempest-TaggedBootDevicesTest-547170310 None] Flow 'volume_create_manager' (83683bd1-8f8d-4ee5-b50c-75080d3a84d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 20:55:19.002447 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-20841805-ce2b-48d4-8c7e-e574b684978b tempest-TaggedBootDevicesTest-547170310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (452dd39d-5039-440f-9c8e-d961a85f3f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:55:19.014712 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-20841805-ce2b-48d4-8c7e-e574b684978b tempest-TaggedBootDevicesTest-547170310 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 20:55:19.039320 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-20841805-ce2b-48d4-8c7e-e574b684978b tempest-TaggedBootDevicesTest-547170310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (452dd39d-5039-440f-9c8e-d961a85f3f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T20:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1370499725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=88be82bc-6eec-4de5-8baa-fb763d3170ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='451be3a617f64d6a97b8d18cee2426e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T20:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T20:55:19Z,use_quota=True,user_id='c71c192ebc864256aeeafa60a376aa7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:55:19.047098 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-20841805-ce2b-48d4-8c7e-e574b684978b tempest-TaggedBootDevicesTest-547170310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bf74bcd-afa9-4cf9-9431-5fe22c5fa10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:55:19.052538 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-20841805-ce2b-48d4-8c7e-e574b684978b tempest-TaggedBootDevicesTest-547170310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bf74bcd-afa9-4cf9-9431-5fe22c5fa10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:55:19.063076 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-20841805-ce2b-48d4-8c7e-e574b684978b tempest-TaggedBootDevicesTest-547170310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (029e932e-54c3-4f57-a84e-3d40c4f390bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:55:19.072410 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-20841805-ce2b-48d4-8c7e-e574b684978b tempest-TaggedBootDevicesTest-547170310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (029e932e-54c3-4f57-a84e-3d40c4f390bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88be82bc-6eec-4de5-8baa-fb763d3170ad', 'volume_name': 'volume-88be82bc-6eec-4de5-8baa-fb763d3170ad', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:55:19.078784 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-20841805-ce2b-48d4-8c7e-e574b684978b tempest-TaggedBootDevicesTest-547170310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d7403df-8671-451c-9bdf-70ee0b689366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:55:19.086191 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-20841805-ce2b-48d4-8c7e-e574b684978b tempest-TaggedBootDevicesTest-547170310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d7403df-8671-451c-9bdf-70ee0b689366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:55:19.093505 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-20841805-ce2b-48d4-8c7e-e574b684978b tempest-TaggedBootDevicesTest-547170310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b557c6b6-333a-4725-8fec-d0e2d79178a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:55:19.095336 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-20841805-ce2b-48d4-8c7e-e574b684978b tempest-TaggedBootDevicesTest-547170310 None] Volume 88be82bc-6eec-4de5-8baa-fb763d3170ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88be82bc-6eec-4de5-8baa-fb763d3170ad', 'volume_size': 1} Feb 05 20:55:19.096092 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-20841805-ce2b-48d4-8c7e-e574b684978b tempest-TaggedBootDevicesTest-547170310 None] creating volume 'volume-88be82bc-6eec-4de5-8baa-fb763d3170ad' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 20:55:19.100896 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-20841805-ce2b-48d4-8c7e-e574b684978b tempest-TaggedBootDevicesTest-547170310 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:55:19.352414 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-20841805-ce2b-48d4-8c7e-e574b684978b tempest-TaggedBootDevicesTest-547170310 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 20:55:19.352799 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-20841805-ce2b-48d4-8c7e-e574b684978b tempest-TaggedBootDevicesTest-547170310 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 20:55:19.356561 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-20841805-ce2b-48d4-8c7e-e574b684978b tempest-TaggedBootDevicesTest-547170310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b557c6b6-333a-4725-8fec-d0e2d79178a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88be82bc-6eec-4de5-8baa-fb763d3170ad', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:55:19.361408 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-20841805-ce2b-48d4-8c7e-e574b684978b tempest-TaggedBootDevicesTest-547170310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfe97a7f-1c33-498e-97ce-a8ad4c9a60fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:55:19.383689 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-20841805-ce2b-48d4-8c7e-e574b684978b tempest-TaggedBootDevicesTest-547170310 None] Volume volume-88be82bc-6eec-4de5-8baa-fb763d3170ad (88be82bc-6eec-4de5-8baa-fb763d3170ad): created successfully Feb 05 20:55:19.388142 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-20841805-ce2b-48d4-8c7e-e574b684978b tempest-TaggedBootDevicesTest-547170310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfe97a7f-1c33-498e-97ce-a8ad4c9a60fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:55:19.400495 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-20841805-ce2b-48d4-8c7e-e574b684978b tempest-TaggedBootDevicesTest-547170310 None] Flow 'volume_create_manager' (83683bd1-8f8d-4ee5-b50c-75080d3a84d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 20:55:19.427128 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-20841805-ce2b-48d4-8c7e-e574b684978b tempest-TaggedBootDevicesTest-547170310 None] Created volume successfully. Feb 05 20:55:45.154849 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-e2e4a37c-589a-4d24-8ba8-ba402b7fbed3 req-c55858c6-6ff2-4dac-92bf-309b1872a3dc tempest-TaggedBootDevicesTest-547170310 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 20:55:46.121221 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-e2e4a37c-589a-4d24-8ba8-ba402b7fbed3 req-c55858c6-6ff2-4dac-92bf-309b1872a3dc tempest-TaggedBootDevicesTest-547170310 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.960s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 20:55:46.125231 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-e2e4a37c-589a-4d24-8ba8-ba402b7fbed3 req-c55858c6-6ff2-4dac-92bf-309b1872a3dc tempest-TaggedBootDevicesTest-547170310 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b7715ffc-afa8-4753-b29c-82554a24d216', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': 'b7715ffc-afa8-4753-b29c-82554a24d216', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 20:55:46.187806 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-e2e4a37c-589a-4d24-8ba8-ba402b7fbed3 req-c55858c6-6ff2-4dac-92bf-309b1872a3dc tempest-TaggedBootDevicesTest-547170310 None] Connection info returned from driver {'name': 'volumes/volume-b7715ffc-afa8-4753-b29c-82554a24d216', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'b7715ffc-afa8-4753-b29c-82554a24d216', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '833ec444-71ca-4c59-a723-44a07c4bb2c3'} {{(pid=122683) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 05 20:55:46.337994 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-e2e4a37c-589a-4d24-8ba8-ba402b7fbed3 req-c55858c6-6ff2-4dac-92bf-309b1872a3dc tempest-TaggedBootDevicesTest-547170310 None] attachment_update completed successfully. Feb 05 20:55:46.861398 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-e2e4a37c-589a-4d24-8ba8-ba402b7fbed3 req-b7b0b4d2-29e4-41ab-b618-09c5d5ae2b04 tempest-TaggedBootDevicesTest-547170310 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 20:55:48.171956 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-e2e4a37c-589a-4d24-8ba8-ba402b7fbed3 req-b7b0b4d2-29e4-41ab-b618-09c5d5ae2b04 tempest-TaggedBootDevicesTest-547170310 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.312s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 20:55:48.173174 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-e2e4a37c-589a-4d24-8ba8-ba402b7fbed3 req-b7b0b4d2-29e4-41ab-b618-09c5d5ae2b04 tempest-TaggedBootDevicesTest-547170310 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-94129f58-a380-4835-a6c7-7999a4d49a8b', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': '94129f58-a380-4835-a6c7-7999a4d49a8b', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 20:55:48.228411 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-e2e4a37c-589a-4d24-8ba8-ba402b7fbed3 req-b7b0b4d2-29e4-41ab-b618-09c5d5ae2b04 tempest-TaggedBootDevicesTest-547170310 None] Connection info returned from driver {'name': 'volumes/volume-94129f58-a380-4835-a6c7-7999a4d49a8b', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '94129f58-a380-4835-a6c7-7999a4d49a8b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'cf088e53-489e-4511-82c8-a7f0807e6bb6'} {{(pid=122683) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 05 20:55:48.316455 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-e2e4a37c-589a-4d24-8ba8-ba402b7fbed3 req-b7b0b4d2-29e4-41ab-b618-09c5d5ae2b04 tempest-TaggedBootDevicesTest-547170310 None] attachment_update completed successfully. Feb 05 20:55:48.772702 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-e2e4a37c-589a-4d24-8ba8-ba402b7fbed3 req-fcb29280-231c-4822-a467-9f51a4421fa7 tempest-TaggedBootDevicesTest-547170310 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 20:55:50.483236 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-e2e4a37c-589a-4d24-8ba8-ba402b7fbed3 req-fcb29280-231c-4822-a467-9f51a4421fa7 tempest-TaggedBootDevicesTest-547170310 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.710s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 20:55:50.484028 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-e2e4a37c-589a-4d24-8ba8-ba402b7fbed3 req-fcb29280-231c-4822-a467-9f51a4421fa7 tempest-TaggedBootDevicesTest-547170310 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-88be82bc-6eec-4de5-8baa-fb763d3170ad', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': '88be82bc-6eec-4de5-8baa-fb763d3170ad', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 20:55:50.531089 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-e2e4a37c-589a-4d24-8ba8-ba402b7fbed3 req-fcb29280-231c-4822-a467-9f51a4421fa7 tempest-TaggedBootDevicesTest-547170310 None] Connection info returned from driver {'name': 'volumes/volume-88be82bc-6eec-4de5-8baa-fb763d3170ad', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '88be82bc-6eec-4de5-8baa-fb763d3170ad', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '31f2b19b-8b03-4962-95e6-c044ecdf94d4'} {{(pid=122683) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 05 20:55:50.611340 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-e2e4a37c-589a-4d24-8ba8-ba402b7fbed3 req-fcb29280-231c-4822-a467-9f51a4421fa7 tempest-TaggedBootDevicesTest-547170310 None] attachment_update completed successfully. Feb 05 20:55:52.563719 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 20:55:52.564976 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:55:52.632034 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:55:52.713098 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 20:56:52.563499 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 20:56:52.564835 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:56:52.689654 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:56:52.747760 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 20:57:08.740648 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cd782a8-20a3-416a-acb6-0d3c5e677437 tempest-ServersTestBootFromVolume-671315418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 20:57:08.747173 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-5cd782a8-20a3-416a-acb6-0d3c5e677437 tempest-ServersTestBootFromVolume-671315418 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 20:57:08.747870 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-5cd782a8-20a3-416a-acb6-0d3c5e677437 tempest-ServersTestBootFromVolume-671315418 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 20:57:08.780720 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5cd782a8-20a3-416a-acb6-0d3c5e677437 tempest-ServersTestBootFromVolume-671315418 None] Flow 'volume_create_manager' (f8eaaa41-0001-4d27-918d-cb6292315caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 20:57:08.793898 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5cd782a8-20a3-416a-acb6-0d3c5e677437 tempest-ServersTestBootFromVolume-671315418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (044d694e-f03a-428d-9613-f1bb2855e1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:57:08.815506 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-5cd782a8-20a3-416a-acb6-0d3c5e677437 tempest-ServersTestBootFromVolume-671315418 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 20:57:08.843367 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5cd782a8-20a3-416a-acb6-0d3c5e677437 tempest-ServersTestBootFromVolume-671315418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (044d694e-f03a-428d-9613-f1bb2855e1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T20:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-416971001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=82def447-c2dd-457a-86e8-abafcb636ae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60a31152c92648bfb27496f9e1d342d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T20:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T20:57:09Z,use_quota=True,user_id='edaeaa779a83409ea7204aa58c108638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:57:08.850288 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5cd782a8-20a3-416a-acb6-0d3c5e677437 tempest-ServersTestBootFromVolume-671315418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59bda7de-8268-407e-90ec-5980696ef60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:57:08.857240 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5cd782a8-20a3-416a-acb6-0d3c5e677437 tempest-ServersTestBootFromVolume-671315418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59bda7de-8268-407e-90ec-5980696ef60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:57:08.864858 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5cd782a8-20a3-416a-acb6-0d3c5e677437 tempest-ServersTestBootFromVolume-671315418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac5ad1ae-493f-49ce-9115-de7f9ab51120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:57:08.995417 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5cd782a8-20a3-416a-acb6-0d3c5e677437 tempest-ServersTestBootFromVolume-671315418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac5ad1ae-493f-49ce-9115-de7f9ab51120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '82def447-c2dd-457a-86e8-abafcb636ae0', 'volume_name': 'volume-82def447-c2dd-457a-86e8-abafcb636ae0', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:57:09.007282 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5cd782a8-20a3-416a-acb6-0d3c5e677437 tempest-ServersTestBootFromVolume-671315418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f94cacf0-1841-4f92-a8d3-80cfbaa7a117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:57:09.016760 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5cd782a8-20a3-416a-acb6-0d3c5e677437 tempest-ServersTestBootFromVolume-671315418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f94cacf0-1841-4f92-a8d3-80cfbaa7a117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:57:09.028498 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5cd782a8-20a3-416a-acb6-0d3c5e677437 tempest-ServersTestBootFromVolume-671315418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55cb2291-9f4b-4e00-80ac-ca596afae687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:57:09.036086 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-5cd782a8-20a3-416a-acb6-0d3c5e677437 tempest-ServersTestBootFromVolume-671315418 None] Volume 82def447-c2dd-457a-86e8-abafcb636ae0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-82def447-c2dd-457a-86e8-abafcb636ae0', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 05 20:57:09.037003 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cd782a8-20a3-416a-acb6-0d3c5e677437 tempest-ServersTestBootFromVolume-671315418 None] Cloning 82def447-c2dd-457a-86e8-abafcb636ae0 from image e66a3a3b-d2f9-4d5d-8021-a6001dff419f at location (None, None). {{(pid=122683) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 05 20:57:09.053728 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-5cd782a8-20a3-416a-acb6-0d3c5e677437 tempest-ServersTestBootFromVolume-671315418 None] Lock "b'cinder-e66a3a3b-d2f9-4d5d-8021-a6001dff419f'" acquired by "_prepare_image_cache_entry" :: waited 0.015s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 20:57:09.078112 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-5cd782a8-20a3-416a-acb6-0d3c5e677437 tempest-ServersTestBootFromVolume-671315418 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'volume_id': '311ef4be-45fd-4167-a3ad-6251d56550a7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57), 'last_used': datetime.datetime(2022, 2, 5, 20, 57, 9, 65276)}. {{(pid=122683) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 05 20:57:09.078790 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-5cd782a8-20a3-416a-acb6-0d3c5e677437 tempest-ServersTestBootFromVolume-671315418 None] Image-volume cache entry image_update_at = 2022-02-05 20:37:57+00:00, requested image updated_at = 2022-02-05 20:37:57+00:00. {{(pid=122683) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 05 20:57:09.079342 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cd782a8-20a3-416a-acb6-0d3c5e677437 tempest-ServersTestBootFromVolume-671315418 None] Found cache entry for image = e66a3a3b-d2f9-4d5d-8021-a6001dff419f on host ncdv-master-1@ceph#ceph. {{(pid=122683) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Feb 05 20:57:09.093470 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-5cd782a8-20a3-416a-acb6-0d3c5e677437 tempest-ServersTestBootFromVolume-671315418 None] Lock "b'cinder-e66a3a3b-d2f9-4d5d-8021-a6001dff419f'" released by "_prepare_image_cache_entry" :: held 0.039s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 20:57:09.103024 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cd782a8-20a3-416a-acb6-0d3c5e677437 tempest-ServersTestBootFromVolume-671315418 None] Attempting to retrieve cache entry for image = e66a3a3b-d2f9-4d5d-8021-a6001dff419f on host ncdv-master-1@ceph#ceph. {{(pid=122683) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 05 20:57:09.163641 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-5cd782a8-20a3-416a-acb6-0d3c5e677437 tempest-ServersTestBootFromVolume-671315418 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'volume_id': '311ef4be-45fd-4167-a3ad-6251d56550a7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57), 'last_used': datetime.datetime(2022, 2, 5, 20, 57, 9, 145084)}. {{(pid=122683) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 05 20:57:09.173147 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-5cd782a8-20a3-416a-acb6-0d3c5e677437 tempest-ServersTestBootFromVolume-671315418 None] Image-volume cache entry image_update_at = 2022-02-05 20:37:57+00:00, requested image updated_at = 2022-02-05 20:37:57+00:00. {{(pid=122683) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 05 20:57:09.176545 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cd782a8-20a3-416a-acb6-0d3c5e677437 tempest-ServersTestBootFromVolume-671315418 None] Creating from source image-volume 311ef4be-45fd-4167-a3ad-6251d56550a7 {{(pid=122683) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Feb 05 20:57:09.220614 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5cd782a8-20a3-416a-acb6-0d3c5e677437 tempest-ServersTestBootFromVolume-671315418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:57:09.352236 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5cd782a8-20a3-416a-acb6-0d3c5e677437 tempest-ServersTestBootFromVolume-671315418 None] creating snapshot='volume-82def447-c2dd-457a-86e8-abafcb636ae0.clone_snap' {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 05 20:57:10.400515 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5cd782a8-20a3-416a-acb6-0d3c5e677437 tempest-ServersTestBootFromVolume-671315418 None] cloning 'volume-311ef4be-45fd-4167-a3ad-6251d56550a7@volume-82def447-c2dd-457a-86e8-abafcb636ae0.clone_snap' to 'volume-82def447-c2dd-457a-86e8-abafcb636ae0' {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 05 20:57:10.594007 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5cd782a8-20a3-416a-acb6-0d3c5e677437 tempest-ServersTestBootFromVolume-671315418 None] Volume volume-35445a36-a76c-48db-a9c5-3b58646c1e7b.deleted is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 20:57:10.595440 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5cd782a8-20a3-416a-acb6-0d3c5e677437 tempest-ServersTestBootFromVolume-671315418 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 20:57:10.595847 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5cd782a8-20a3-416a-acb6-0d3c5e677437 tempest-ServersTestBootFromVolume-671315418 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 20:57:10.624122 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5cd782a8-20a3-416a-acb6-0d3c5e677437 tempest-ServersTestBootFromVolume-671315418 None] clone created successfully {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 05 20:57:10.626074 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.volume_utils [None req-5cd782a8-20a3-416a-acb6-0d3c5e677437 tempest-ServersTestBootFromVolume-671315418 None] Marking volume 82def447-c2dd-457a-86e8-abafcb636ae0 as bootable. {{(pid=122683) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Feb 05 20:57:10.637021 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cd782a8-20a3-416a-acb6-0d3c5e677437 tempest-ServersTestBootFromVolume-671315418 None] Copying metadata from image e66a3a3b-d2f9-4d5d-8021-a6001dff419f to 82def447-c2dd-457a-86e8-abafcb636ae0. {{(pid=122683) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 05 20:57:10.637465 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cd782a8-20a3-416a-acb6-0d3c5e677437 tempest-ServersTestBootFromVolume-671315418 None] Creating volume glance metadata for volume 82def447-c2dd-457a-86e8-abafcb636ae0 backed by image e66a3a3b-d2f9-4d5d-8021-a6001dff419f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=122683) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 05 20:57:10.712787 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5cd782a8-20a3-416a-acb6-0d3c5e677437 tempest-ServersTestBootFromVolume-671315418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55cb2291-9f4b-4e00-80ac-ca596afae687) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82def447-c2dd-457a-86e8-abafcb636ae0', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:57:10.727030 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5cd782a8-20a3-416a-acb6-0d3c5e677437 tempest-ServersTestBootFromVolume-671315418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b13d4054-5925-4ea6-a290-01c28870eebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:57:10.745155 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-5cd782a8-20a3-416a-acb6-0d3c5e677437 tempest-ServersTestBootFromVolume-671315418 None] Volume volume-82def447-c2dd-457a-86e8-abafcb636ae0 (82def447-c2dd-457a-86e8-abafcb636ae0): created successfully Feb 05 20:57:10.750694 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5cd782a8-20a3-416a-acb6-0d3c5e677437 tempest-ServersTestBootFromVolume-671315418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b13d4054-5925-4ea6-a290-01c28870eebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:57:10.758496 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5cd782a8-20a3-416a-acb6-0d3c5e677437 tempest-ServersTestBootFromVolume-671315418 None] Flow 'volume_create_manager' (f8eaaa41-0001-4d27-918d-cb6292315caa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 20:57:10.772378 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-5cd782a8-20a3-416a-acb6-0d3c5e677437 tempest-ServersTestBootFromVolume-671315418 None] Created volume successfully. Feb 05 20:57:16.348968 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-a8814a5b-77d8-481e-bded-da1b1e00795a req-6e745db3-960f-4d43-b505-6b715ec10550 tempest-ServersTestBootFromVolume-671315418 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 20:57:17.442221 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-a8814a5b-77d8-481e-bded-da1b1e00795a req-6e745db3-960f-4d43-b505-6b715ec10550 tempest-ServersTestBootFromVolume-671315418 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.093s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 20:57:17.443134 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-a8814a5b-77d8-481e-bded-da1b1e00795a req-6e745db3-960f-4d43-b505-6b715ec10550 tempest-ServersTestBootFromVolume-671315418 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-82def447-c2dd-457a-86e8-abafcb636ae0', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': '82def447-c2dd-457a-86e8-abafcb636ae0', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 20:57:17.479078 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-a8814a5b-77d8-481e-bded-da1b1e00795a req-6e745db3-960f-4d43-b505-6b715ec10550 tempest-ServersTestBootFromVolume-671315418 None] Connection info returned from driver {'name': 'volumes/volume-82def447-c2dd-457a-86e8-abafcb636ae0', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '82def447-c2dd-457a-86e8-abafcb636ae0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b373b80d-8336-454b-8283-c5c1262c59b8'} {{(pid=122683) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 05 20:57:17.544159 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-a8814a5b-77d8-481e-bded-da1b1e00795a req-6e745db3-960f-4d43-b505-6b715ec10550 tempest-ServersTestBootFromVolume-671315418 None] attachment_update completed successfully. Feb 05 20:57:52.562776 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 20:57:52.564287 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:57:52.628558 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:57:52.678584 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 20:58:13.816943 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [req-4d705567-c445-4573-971a-e2141a593f95 req-9b55098c-0a87-4b26-ac4e-b83f79d16ba5 tempest-VolumesSnapshotsTestJSON-1768912343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 20:58:13.823912 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [req-4d705567-c445-4573-971a-e2141a593f95 req-9b55098c-0a87-4b26-ac4e-b83f79d16ba5 tempest-VolumesSnapshotsTestJSON-1768912343 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 20:58:13.824588 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [req-4d705567-c445-4573-971a-e2141a593f95 req-9b55098c-0a87-4b26-ac4e-b83f79d16ba5 tempest-VolumesSnapshotsTestJSON-1768912343 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 20:58:13.851495 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-4d705567-c445-4573-971a-e2141a593f95 req-9b55098c-0a87-4b26-ac4e-b83f79d16ba5 tempest-VolumesSnapshotsTestJSON-1768912343 None] Flow 'volume_create_manager' (827ddd1a-b43e-4a7e-8955-93ff13834944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 20:58:13.860095 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-4d705567-c445-4573-971a-e2141a593f95 req-9b55098c-0a87-4b26-ac4e-b83f79d16ba5 tempest-VolumesSnapshotsTestJSON-1768912343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7453953e-fc19-4253-8210-fed559358765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:58:13.869464 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [req-4d705567-c445-4573-971a-e2141a593f95 req-9b55098c-0a87-4b26-ac4e-b83f79d16ba5 tempest-VolumesSnapshotsTestJSON-1768912343 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 20:58:13.899428 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-4d705567-c445-4573-971a-e2141a593f95 req-9b55098c-0a87-4b26-ac4e-b83f79d16ba5 tempest-VolumesSnapshotsTestJSON-1768912343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7453953e-fc19-4253-8210-fed559358765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T20:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1636710124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=795f287b-e8fd-40f2-affb-61de6a37bc8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96171903b9834f2bbcffb9f2c154dce6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T20:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T20:58:14Z,use_quota=True,user_id='6789e21fd5194fd1bbcba0d2651ad28e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:58:13.906754 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-4d705567-c445-4573-971a-e2141a593f95 req-9b55098c-0a87-4b26-ac4e-b83f79d16ba5 tempest-VolumesSnapshotsTestJSON-1768912343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0022765-aa74-4073-bba7-387557d6138f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:58:13.913606 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-4d705567-c445-4573-971a-e2141a593f95 req-9b55098c-0a87-4b26-ac4e-b83f79d16ba5 tempest-VolumesSnapshotsTestJSON-1768912343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0022765-aa74-4073-bba7-387557d6138f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:58:13.919885 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-4d705567-c445-4573-971a-e2141a593f95 req-9b55098c-0a87-4b26-ac4e-b83f79d16ba5 tempest-VolumesSnapshotsTestJSON-1768912343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d27eb93-042c-477e-8e45-6034865cb4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:58:13.925584 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-4d705567-c445-4573-971a-e2141a593f95 req-9b55098c-0a87-4b26-ac4e-b83f79d16ba5 tempest-VolumesSnapshotsTestJSON-1768912343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d27eb93-042c-477e-8e45-6034865cb4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '795f287b-e8fd-40f2-affb-61de6a37bc8b', 'volume_name': 'volume-795f287b-e8fd-40f2-affb-61de6a37bc8b', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:58:13.932143 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-4d705567-c445-4573-971a-e2141a593f95 req-9b55098c-0a87-4b26-ac4e-b83f79d16ba5 tempest-VolumesSnapshotsTestJSON-1768912343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df39f961-dc86-41d4-9434-0d2e23b2ad82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:58:13.937877 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-4d705567-c445-4573-971a-e2141a593f95 req-9b55098c-0a87-4b26-ac4e-b83f79d16ba5 tempest-VolumesSnapshotsTestJSON-1768912343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df39f961-dc86-41d4-9434-0d2e23b2ad82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:58:13.949178 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-4d705567-c445-4573-971a-e2141a593f95 req-9b55098c-0a87-4b26-ac4e-b83f79d16ba5 tempest-VolumesSnapshotsTestJSON-1768912343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3789105c-d2cf-45aa-bd9e-46cb22a2294f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:58:13.950649 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [req-4d705567-c445-4573-971a-e2141a593f95 req-9b55098c-0a87-4b26-ac4e-b83f79d16ba5 tempest-VolumesSnapshotsTestJSON-1768912343 None] Volume 795f287b-e8fd-40f2-affb-61de6a37bc8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-795f287b-e8fd-40f2-affb-61de6a37bc8b', 'volume_size': 1} Feb 05 20:58:13.951121 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-4d705567-c445-4573-971a-e2141a593f95 req-9b55098c-0a87-4b26-ac4e-b83f79d16ba5 tempest-VolumesSnapshotsTestJSON-1768912343 None] creating volume 'volume-795f287b-e8fd-40f2-affb-61de6a37bc8b' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 20:58:13.952276 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-4d705567-c445-4573-971a-e2141a593f95 req-9b55098c-0a87-4b26-ac4e-b83f79d16ba5 tempest-VolumesSnapshotsTestJSON-1768912343 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:58:14.077530 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-4d705567-c445-4573-971a-e2141a593f95 req-9b55098c-0a87-4b26-ac4e-b83f79d16ba5 tempest-VolumesSnapshotsTestJSON-1768912343 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 20:58:14.078217 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-4d705567-c445-4573-971a-e2141a593f95 req-9b55098c-0a87-4b26-ac4e-b83f79d16ba5 tempest-VolumesSnapshotsTestJSON-1768912343 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 20:58:14.085158 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-4d705567-c445-4573-971a-e2141a593f95 req-9b55098c-0a87-4b26-ac4e-b83f79d16ba5 tempest-VolumesSnapshotsTestJSON-1768912343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3789105c-d2cf-45aa-bd9e-46cb22a2294f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-795f287b-e8fd-40f2-affb-61de6a37bc8b', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:58:14.092680 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-4d705567-c445-4573-971a-e2141a593f95 req-9b55098c-0a87-4b26-ac4e-b83f79d16ba5 tempest-VolumesSnapshotsTestJSON-1768912343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6aa7450-67dd-47ba-bcd1-c84e6f1a090d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:58:14.128296 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [req-4d705567-c445-4573-971a-e2141a593f95 req-9b55098c-0a87-4b26-ac4e-b83f79d16ba5 tempest-VolumesSnapshotsTestJSON-1768912343 None] Volume volume-795f287b-e8fd-40f2-affb-61de6a37bc8b (795f287b-e8fd-40f2-affb-61de6a37bc8b): created successfully Feb 05 20:58:14.135984 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-4d705567-c445-4573-971a-e2141a593f95 req-9b55098c-0a87-4b26-ac4e-b83f79d16ba5 tempest-VolumesSnapshotsTestJSON-1768912343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6aa7450-67dd-47ba-bcd1-c84e6f1a090d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:58:14.145222 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-4d705567-c445-4573-971a-e2141a593f95 req-9b55098c-0a87-4b26-ac4e-b83f79d16ba5 tempest-VolumesSnapshotsTestJSON-1768912343 None] Flow 'volume_create_manager' (827ddd1a-b43e-4a7e-8955-93ff13834944) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 20:58:14.161788 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-4d705567-c445-4573-971a-e2141a593f95 req-9b55098c-0a87-4b26-ac4e-b83f79d16ba5 tempest-VolumesSnapshotsTestJSON-1768912343 None] Created volume successfully. Feb 05 20:58:15.607294 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-3d6a2be6-b3e4-41b3-83f3-c0c809f99f3f req-bd6ac55c-1853-4959-90b6-4fceafbb9bb5 tempest-VolumesSnapshotsTestJSON-1768912343 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:58:16.611333 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-3d6a2be6-b3e4-41b3-83f3-c0c809f99f3f req-bd6ac55c-1853-4959-90b6-4fceafbb9bb5 tempest-VolumesSnapshotsTestJSON-1768912343 None] Create snapshot completed successfully Feb 05 20:58:16.862717 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [req-a19072c6-99d3-4508-a76e-dbe0924ce513 req-56a2c0f3-61b0-454f-9c04-0c3f4d528778 tempest-VolumesSnapshotsTestJSON-1768912343 None] Lock "b'cinder-2e509ad9-3503-4a2e-a0b9-838de95a7ed3-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 20:58:16.864458 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-a19072c6-99d3-4508-a76e-dbe0924ce513 req-56a2c0f3-61b0-454f-9c04-0c3f4d528778 tempest-VolumesSnapshotsTestJSON-1768912343 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:58:17.479307 ncdv-master-1 cinder-volume[122683]: WARNING cinder.quota [req-a19072c6-99d3-4508-a76e-dbe0924ce513 req-56a2c0f3-61b0-454f-9c04-0c3f4d528778 tempest-VolumesSnapshotsTestJSON-1768912343 None] Deprecated: Default quota for resource: snapshots_ceph is set by the default quota flag: quota_snapshots_ceph, it is now deprecated. Please use the default quota class for default quota. Feb 05 20:58:17.497151 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [req-a19072c6-99d3-4508-a76e-dbe0924ce513 req-56a2c0f3-61b0-454f-9c04-0c3f4d528778 tempest-VolumesSnapshotsTestJSON-1768912343 None] Created reservations ['9a9325f7-66c5-4f37-a062-c6a08104b490', '4a705b7a-955a-452a-8c18-a5f7d7aca236', '91b8c8bc-aa74-4b8e-99fb-0b5b9de8a0f1', '3ab1eac1-2aed-425b-8060-f32e1ebb3d69'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 20:58:17.540168 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-a19072c6-99d3-4508-a76e-dbe0924ce513 req-56a2c0f3-61b0-454f-9c04-0c3f4d528778 tempest-VolumesSnapshotsTestJSON-1768912343 None] Delete snapshot completed successfully. Feb 05 20:58:17.545033 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [req-a19072c6-99d3-4508-a76e-dbe0924ce513 req-56a2c0f3-61b0-454f-9c04-0c3f4d528778 tempest-VolumesSnapshotsTestJSON-1768912343 None] Lock "b'cinder-2e509ad9-3503-4a2e-a0b9-838de95a7ed3-delete_snapshot'" released by "delete_snapshot" :: held 0.683s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 20:58:18.061799 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [req-b2f10b08-f45d-4a1f-ad4d-5d6c871e127b req-ec64e42e-6dd1-45d6-b604-573ea0cba95c tempest-VolumesSnapshotsTestJSON-1768912343 None] Lock "b'cinder-795f287b-e8fd-40f2-affb-61de6a37bc8b-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 20:58:18.104420 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-b2f10b08-f45d-4a1f-ad4d-5d6c871e127b req-ec64e42e-6dd1-45d6-b604-573ea0cba95c tempest-VolumesSnapshotsTestJSON-1768912343 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:58:18.149679 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-b2f10b08-f45d-4a1f-ad4d-5d6c871e127b req-ec64e42e-6dd1-45d6-b604-573ea0cba95c tempest-VolumesSnapshotsTestJSON-1768912343 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 20:58:18.150129 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-b2f10b08-f45d-4a1f-ad4d-5d6c871e127b req-ec64e42e-6dd1-45d6-b604-573ea0cba95c tempest-VolumesSnapshotsTestJSON-1768912343 None] Volume volume-795f287b-e8fd-40f2-affb-61de6a37bc8b is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 20:58:18.163968 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-b2f10b08-f45d-4a1f-ad4d-5d6c871e127b req-ec64e42e-6dd1-45d6-b604-573ea0cba95c tempest-VolumesSnapshotsTestJSON-1768912343 None] deleting rbd volume volume-795f287b-e8fd-40f2-affb-61de6a37bc8b {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 20:58:18.509100 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [req-b2f10b08-f45d-4a1f-ad4d-5d6c871e127b req-ec64e42e-6dd1-45d6-b604-573ea0cba95c tempest-VolumesSnapshotsTestJSON-1768912343 None] Created reservations ['f26e6817-f8a1-40e7-a9f9-fbd70ffff388', 'c49c9a1e-36b9-439d-b1fb-34f28208e521', 'af371cbb-28cd-4473-ae21-e7aa69d5b40b', 'ad3046eb-f33e-4100-8527-8c8bc9b3fa18'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 20:58:18.566296 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-b2f10b08-f45d-4a1f-ad4d-5d6c871e127b req-ec64e42e-6dd1-45d6-b604-573ea0cba95c tempest-VolumesSnapshotsTestJSON-1768912343 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:58:18.608878 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-b2f10b08-f45d-4a1f-ad4d-5d6c871e127b req-ec64e42e-6dd1-45d6-b604-573ea0cba95c tempest-VolumesSnapshotsTestJSON-1768912343 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:58:18.657726 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [req-b2f10b08-f45d-4a1f-ad4d-5d6c871e127b req-ec64e42e-6dd1-45d6-b604-573ea0cba95c tempest-VolumesSnapshotsTestJSON-1768912343 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 20:58:18.674889 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-b2f10b08-f45d-4a1f-ad4d-5d6c871e127b req-ec64e42e-6dd1-45d6-b604-573ea0cba95c tempest-VolumesSnapshotsTestJSON-1768912343 None] Deleted volume successfully. Feb 05 20:58:18.693849 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [req-b2f10b08-f45d-4a1f-ad4d-5d6c871e127b req-ec64e42e-6dd1-45d6-b604-573ea0cba95c tempest-VolumesSnapshotsTestJSON-1768912343 None] Lock "b'cinder-795f287b-e8fd-40f2-affb-61de6a37bc8b-delete_volume'" released by "delete_volume" :: held 0.632s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 20:58:35.639515 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-cbd77056-3812-42b1-bc50-77282364a179 req-3a1bddec-9361-45e9-abe5-67dd138d6089 tempest-TaggedBootDevicesTest_v242-1057228886 None] Terminate volume connection completed successfully. Feb 05 20:58:35.640836 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-cbd77056-3812-42b1-bc50-77282364a179 req-3a1bddec-9361-45e9-abe5-67dd138d6089 tempest-TaggedBootDevicesTest_v242-1057228886 None] Deleting attachment bde27437-3264-4994-8e59-68ce2c8a2800. {{(pid=122683) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 05 20:58:35.835659 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-cbd77056-3812-42b1-bc50-77282364a179 req-aa7e37b8-b9ac-4b6e-b11f-3843fea8fede tempest-TaggedBootDevicesTest_v242-1057228886 None] Terminate volume connection completed successfully. Feb 05 20:58:35.836092 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-cbd77056-3812-42b1-bc50-77282364a179 req-aa7e37b8-b9ac-4b6e-b11f-3843fea8fede tempest-TaggedBootDevicesTest_v242-1057228886 None] Deleting attachment 794dec2a-d35b-4e01-a0cf-946f2b1fc321. {{(pid=122683) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 05 20:58:35.989026 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-cbd77056-3812-42b1-bc50-77282364a179 req-ffa12d54-e4eb-450d-b7b4-08c0a8420548 tempest-TaggedBootDevicesTest_v242-1057228886 None] Terminate volume connection completed successfully. Feb 05 20:58:35.989825 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-cbd77056-3812-42b1-bc50-77282364a179 req-ffa12d54-e4eb-450d-b7b4-08c0a8420548 tempest-TaggedBootDevicesTest_v242-1057228886 None] Deleting attachment 4f9e0305-7a11-4104-82ef-1bc3684f8df8. {{(pid=122683) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 05 20:58:44.659575 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-92ba66f1-922a-4741-a043-83d5031daa17 tempest-TaggedBootDevicesTest_v242-1057228886 None] Lock "b'cinder-10df4ddf-f452-44cb-a8d7-fd39e4ea5537-delete_volume'" acquired by "delete_volume" :: waited 0.026s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 20:58:44.713325 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-92ba66f1-922a-4741-a043-83d5031daa17 tempest-TaggedBootDevicesTest_v242-1057228886 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:58:44.803835 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-92ba66f1-922a-4741-a043-83d5031daa17 tempest-TaggedBootDevicesTest_v242-1057228886 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 20:58:44.804457 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-92ba66f1-922a-4741-a043-83d5031daa17 tempest-TaggedBootDevicesTest_v242-1057228886 None] Volume volume-10df4ddf-f452-44cb-a8d7-fd39e4ea5537 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 20:58:44.823915 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-92ba66f1-922a-4741-a043-83d5031daa17 tempest-TaggedBootDevicesTest_v242-1057228886 None] deleting rbd volume volume-10df4ddf-f452-44cb-a8d7-fd39e4ea5537 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 20:58:45.395446 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-92ba66f1-922a-4741-a043-83d5031daa17 tempest-TaggedBootDevicesTest_v242-1057228886 None] Created reservations ['5dd1ec0b-4c36-4aa7-b929-e75060745f50', '1ec5df96-984a-4c3b-a259-1917dbf78c17', '0c830529-56d4-4b23-82c2-0fce71061e75', '4ef14be7-4fa8-44ef-b117-bce3e43cb0cc'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 20:58:45.489907 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-92ba66f1-922a-4741-a043-83d5031daa17 tempest-TaggedBootDevicesTest_v242-1057228886 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:58:45.592081 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-92ba66f1-922a-4741-a043-83d5031daa17 tempest-TaggedBootDevicesTest_v242-1057228886 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:58:45.658769 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-92ba66f1-922a-4741-a043-83d5031daa17 tempest-TaggedBootDevicesTest_v242-1057228886 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 20:58:45.665173 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-92ba66f1-922a-4741-a043-83d5031daa17 tempest-TaggedBootDevicesTest_v242-1057228886 None] Deleted volume successfully. Feb 05 20:58:45.684257 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-92ba66f1-922a-4741-a043-83d5031daa17 tempest-TaggedBootDevicesTest_v242-1057228886 None] Lock "b'cinder-10df4ddf-f452-44cb-a8d7-fd39e4ea5537-delete_volume'" released by "delete_volume" :: held 1.025s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 20:58:45.904991 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-81f961ea-c5a6-4760-bda8-28a944f74b47 tempest-TaggedBootDevicesTest_v242-1057228886 None] Lock "b'cinder-3431439a-02b5-460c-b168-84a4fbb4a172-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 20:58:45.968762 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-81f961ea-c5a6-4760-bda8-28a944f74b47 tempest-TaggedBootDevicesTest_v242-1057228886 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:58:46.070723 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-81f961ea-c5a6-4760-bda8-28a944f74b47 tempest-TaggedBootDevicesTest_v242-1057228886 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 20:58:46.071566 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-81f961ea-c5a6-4760-bda8-28a944f74b47 tempest-TaggedBootDevicesTest_v242-1057228886 None] Volume volume-3431439a-02b5-460c-b168-84a4fbb4a172 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 20:58:46.084138 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-81f961ea-c5a6-4760-bda8-28a944f74b47 tempest-TaggedBootDevicesTest_v242-1057228886 None] deleting rbd volume volume-3431439a-02b5-460c-b168-84a4fbb4a172 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 20:58:46.768385 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-81f961ea-c5a6-4760-bda8-28a944f74b47 tempest-TaggedBootDevicesTest_v242-1057228886 None] Created reservations ['0dbbe205-fb7d-46ee-98b4-1c4107136b2c', '63a3e0d4-ff41-4dae-b74d-69994e0ff1e4', '52b973ce-3879-469b-a169-aed562b8c0c3', '5a1c9a31-6fd0-48c8-bea8-6b70330fd412'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 20:58:46.846241 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-81f961ea-c5a6-4760-bda8-28a944f74b47 tempest-TaggedBootDevicesTest_v242-1057228886 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:58:46.958014 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-81f961ea-c5a6-4760-bda8-28a944f74b47 tempest-TaggedBootDevicesTest_v242-1057228886 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:58:47.052692 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-81f961ea-c5a6-4760-bda8-28a944f74b47 tempest-TaggedBootDevicesTest_v242-1057228886 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 20:58:47.063140 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-81f961ea-c5a6-4760-bda8-28a944f74b47 tempest-TaggedBootDevicesTest_v242-1057228886 None] Deleted volume successfully. Feb 05 20:58:47.091533 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-81f961ea-c5a6-4760-bda8-28a944f74b47 tempest-TaggedBootDevicesTest_v242-1057228886 None] Lock "b'cinder-3431439a-02b5-460c-b168-84a4fbb4a172-delete_volume'" released by "delete_volume" :: held 1.186s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 20:58:47.204263 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-464188b1-3856-48c6-b200-9d2b21295912 tempest-TaggedBootDevicesTest_v242-1057228886 None] Lock "b'cinder-353ce482-9628-4481-970d-bcb74adf4238-delete_volume'" acquired by "delete_volume" :: waited 0.027s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 20:58:47.302481 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-464188b1-3856-48c6-b200-9d2b21295912 tempest-TaggedBootDevicesTest_v242-1057228886 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:58:47.448722 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-464188b1-3856-48c6-b200-9d2b21295912 tempest-TaggedBootDevicesTest_v242-1057228886 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 20:58:47.462218 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-464188b1-3856-48c6-b200-9d2b21295912 tempest-TaggedBootDevicesTest_v242-1057228886 None] deleting rbd volume volume-353ce482-9628-4481-970d-bcb74adf4238 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 20:58:48.377917 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-464188b1-3856-48c6-b200-9d2b21295912 tempest-TaggedBootDevicesTest_v242-1057228886 None] volume is a clone so cleaning references {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 05 20:58:48.422929 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-464188b1-3856-48c6-b200-9d2b21295912 tempest-TaggedBootDevicesTest_v242-1057228886 None] deleting parent snapshot volume-353ce482-9628-4481-970d-bcb74adf4238.clone_snap {{(pid=122683) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 05 20:58:49.556390 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-464188b1-3856-48c6-b200-9d2b21295912 tempest-TaggedBootDevicesTest_v242-1057228886 None] Created reservations ['058e12c6-9769-4ea5-be90-eda844222189', 'c89352cd-acb1-4be6-839a-c764db63baa9', '1de6318d-2e57-4054-a496-a4bb3d030a00', 'ba68a209-0463-4033-974c-6b2380d9aaa0'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 20:58:49.711827 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-464188b1-3856-48c6-b200-9d2b21295912 tempest-TaggedBootDevicesTest_v242-1057228886 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:58:49.788066 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-464188b1-3856-48c6-b200-9d2b21295912 tempest-TaggedBootDevicesTest_v242-1057228886 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:58:49.869884 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-464188b1-3856-48c6-b200-9d2b21295912 tempest-TaggedBootDevicesTest_v242-1057228886 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 20:58:49.893517 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-464188b1-3856-48c6-b200-9d2b21295912 tempest-TaggedBootDevicesTest_v242-1057228886 None] Deleted volume successfully. Feb 05 20:58:49.917621 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-464188b1-3856-48c6-b200-9d2b21295912 tempest-TaggedBootDevicesTest_v242-1057228886 None] Lock "b'cinder-353ce482-9628-4481-970d-bcb74adf4238-delete_volume'" released by "delete_volume" :: held 2.713s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 20:58:52.565356 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 20:58:52.566969 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:58:52.645191 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:58:52.702572 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 20:58:59.307548 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-931634db-558b-4652-a379-8ea1240e5763 req-fbdbcc1e-b6ea-4722-ab8f-b5b53d83f34a tempest-ServersTestBootFromVolume-671315418 None] Terminate volume connection completed successfully. Feb 05 20:58:59.308198 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-931634db-558b-4652-a379-8ea1240e5763 req-fbdbcc1e-b6ea-4722-ab8f-b5b53d83f34a tempest-ServersTestBootFromVolume-671315418 None] Deleting attachment b373b80d-8336-454b-8283-c5c1262c59b8. {{(pid=122683) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 05 20:58:59.631131 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [req-931634db-558b-4652-a379-8ea1240e5763 req-66224e39-8136-4d26-b0e0-878a7a49e537 tempest-ServersTestBootFromVolume-671315418 None] Lock "b'cinder-82def447-c2dd-457a-86e8-abafcb636ae0-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 20:58:59.745340 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-931634db-558b-4652-a379-8ea1240e5763 req-66224e39-8136-4d26-b0e0-878a7a49e537 tempest-ServersTestBootFromVolume-671315418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:58:59.878974 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-931634db-558b-4652-a379-8ea1240e5763 req-66224e39-8136-4d26-b0e0-878a7a49e537 tempest-ServersTestBootFromVolume-671315418 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 20:58:59.894421 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-931634db-558b-4652-a379-8ea1240e5763 req-66224e39-8136-4d26-b0e0-878a7a49e537 tempest-ServersTestBootFromVolume-671315418 None] deleting rbd volume volume-82def447-c2dd-457a-86e8-abafcb636ae0 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 20:59:00.484738 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-931634db-558b-4652-a379-8ea1240e5763 req-66224e39-8136-4d26-b0e0-878a7a49e537 tempest-ServersTestBootFromVolume-671315418 None] volume is a clone so cleaning references {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 05 20:59:00.541234 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-931634db-558b-4652-a379-8ea1240e5763 req-66224e39-8136-4d26-b0e0-878a7a49e537 tempest-ServersTestBootFromVolume-671315418 None] deleting parent snapshot volume-82def447-c2dd-457a-86e8-abafcb636ae0.clone_snap {{(pid=122683) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 05 20:59:01.509419 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [req-931634db-558b-4652-a379-8ea1240e5763 req-66224e39-8136-4d26-b0e0-878a7a49e537 tempest-ServersTestBootFromVolume-671315418 None] Created reservations ['a783785c-0f1a-46da-b79e-03eee8491c8e', 'a1878878-7dee-49b7-a728-85c2da4ab411', 'c35ac44f-2676-44b8-8513-3114a765ebb4', '4c8061e2-c58a-4111-a64a-fe01fe973a07'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 20:59:01.591024 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-931634db-558b-4652-a379-8ea1240e5763 req-66224e39-8136-4d26-b0e0-878a7a49e537 tempest-ServersTestBootFromVolume-671315418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:59:01.655145 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-931634db-558b-4652-a379-8ea1240e5763 req-66224e39-8136-4d26-b0e0-878a7a49e537 tempest-ServersTestBootFromVolume-671315418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:59:01.730333 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [req-931634db-558b-4652-a379-8ea1240e5763 req-66224e39-8136-4d26-b0e0-878a7a49e537 tempest-ServersTestBootFromVolume-671315418 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 20:59:01.735140 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-931634db-558b-4652-a379-8ea1240e5763 req-66224e39-8136-4d26-b0e0-878a7a49e537 tempest-ServersTestBootFromVolume-671315418 None] Deleted volume successfully. Feb 05 20:59:01.756067 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [req-931634db-558b-4652-a379-8ea1240e5763 req-66224e39-8136-4d26-b0e0-878a7a49e537 tempest-ServersTestBootFromVolume-671315418 None] Lock "b'cinder-82def447-c2dd-457a-86e8-abafcb636ae0-delete_volume'" released by "delete_volume" :: held 2.127s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 20:59:25.566524 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-ae2bf985-a4db-4e2d-8014-d3518d6e779f tempest-GroupSnapshotsTest-2054420281 None] Group tempest-GroupSnapshotsTest-Group-1677788793: creating Feb 05 20:59:25.621591 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-ae2bf985-a4db-4e2d-8014-d3518d6e779f tempest-GroupSnapshotsTest-2054420281 None] Group tempest-GroupSnapshotsTest-Group-1677788793: created successfully Feb 05 20:59:25.651966 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-ae2bf985-a4db-4e2d-8014-d3518d6e779f tempest-GroupSnapshotsTest-2054420281 None] Create group completed successfully. Feb 05 20:59:27.688502 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bb55e0f-419b-473d-a398-e1ebc0129f87 tempest-GroupSnapshotsTest-2054420281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 20:59:27.699761 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-8bb55e0f-419b-473d-a398-e1ebc0129f87 tempest-GroupSnapshotsTest-2054420281 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 20:59:27.699982 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-8bb55e0f-419b-473d-a398-e1ebc0129f87 tempest-GroupSnapshotsTest-2054420281 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 20:59:27.759761 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8bb55e0f-419b-473d-a398-e1ebc0129f87 tempest-GroupSnapshotsTest-2054420281 None] Flow 'volume_create_manager' (09185518-db45-4fa4-923d-6fff9da265a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 20:59:27.769517 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8bb55e0f-419b-473d-a398-e1ebc0129f87 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5853d16-7f9a-4b89-bd66-7b229e818af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:59:27.799586 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-8bb55e0f-419b-473d-a398-e1ebc0129f87 tempest-GroupSnapshotsTest-2054420281 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 20:59:27.817732 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8bb55e0f-419b-473d-a398-e1ebc0129f87 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5853d16-7f9a-4b89-bd66-7b229e818af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T20:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1706691161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0440f256-9dbc-4b29-80e9-ef0219e84cff,host='ncdv-master-1@ceph#ceph',id=78866621-784c-421f-91d3-0d5f9f16da78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd6704b87ce043e087be4f8c2937678a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T20:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T20:59:28Z,use_quota=True,user_id='8880931f35204816b64d718a2803c46d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f51c0f86-9241-4543-8050-0e71d51c6d54),volume_type_id=f51c0f86-9241-4543-8050-0e71d51c6d54)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:59:27.827553 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8bb55e0f-419b-473d-a398-e1ebc0129f87 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b77c078-829e-47f1-bb26-371e12aa77b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:59:27.833175 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8bb55e0f-419b-473d-a398-e1ebc0129f87 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b77c078-829e-47f1-bb26-371e12aa77b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:59:27.842315 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8bb55e0f-419b-473d-a398-e1ebc0129f87 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c70ccdb-8b00-4fd9-a26a-a51a11d02fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:59:27.847697 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8bb55e0f-419b-473d-a398-e1ebc0129f87 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c70ccdb-8b00-4fd9-a26a-a51a11d02fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78866621-784c-421f-91d3-0d5f9f16da78', 'volume_name': 'volume-78866621-784c-421f-91d3-0d5f9f16da78', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:59:27.853249 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8bb55e0f-419b-473d-a398-e1ebc0129f87 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a57c52b-2157-479a-a4a8-4c4d872f9a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:59:27.859891 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8bb55e0f-419b-473d-a398-e1ebc0129f87 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a57c52b-2157-479a-a4a8-4c4d872f9a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:59:27.865336 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8bb55e0f-419b-473d-a398-e1ebc0129f87 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02c654e0-7f19-4b45-a20f-f250ed616a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:59:27.866935 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-8bb55e0f-419b-473d-a398-e1ebc0129f87 tempest-GroupSnapshotsTest-2054420281 None] Volume 78866621-784c-421f-91d3-0d5f9f16da78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78866621-784c-421f-91d3-0d5f9f16da78', 'volume_size': 1} Feb 05 20:59:27.869721 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8bb55e0f-419b-473d-a398-e1ebc0129f87 tempest-GroupSnapshotsTest-2054420281 None] creating volume 'volume-78866621-784c-421f-91d3-0d5f9f16da78' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 20:59:27.871485 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8bb55e0f-419b-473d-a398-e1ebc0129f87 tempest-GroupSnapshotsTest-2054420281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:59:28.056311 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8bb55e0f-419b-473d-a398-e1ebc0129f87 tempest-GroupSnapshotsTest-2054420281 None] extra_specs: {} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 20:59:28.056950 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8bb55e0f-419b-473d-a398-e1ebc0129f87 tempest-GroupSnapshotsTest-2054420281 None] extra_specs: {} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 20:59:28.061802 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8bb55e0f-419b-473d-a398-e1ebc0129f87 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02c654e0-7f19-4b45-a20f-f250ed616a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78866621-784c-421f-91d3-0d5f9f16da78', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:59:28.083992 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8bb55e0f-419b-473d-a398-e1ebc0129f87 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc0111ae-799b-4876-a2ec-b3789c513796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:59:28.123040 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-8bb55e0f-419b-473d-a398-e1ebc0129f87 tempest-GroupSnapshotsTest-2054420281 None] Volume volume-78866621-784c-421f-91d3-0d5f9f16da78 (78866621-784c-421f-91d3-0d5f9f16da78): created successfully Feb 05 20:59:28.127697 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8bb55e0f-419b-473d-a398-e1ebc0129f87 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc0111ae-799b-4876-a2ec-b3789c513796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:59:28.156113 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8bb55e0f-419b-473d-a398-e1ebc0129f87 tempest-GroupSnapshotsTest-2054420281 None] Flow 'volume_create_manager' (09185518-db45-4fa4-923d-6fff9da265a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 20:59:28.177141 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-8bb55e0f-419b-473d-a398-e1ebc0129f87 tempest-GroupSnapshotsTest-2054420281 None] Created volume successfully. Feb 05 20:59:29.091690 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-c93b55ce-8b2f-4648-8c0e-541012532fb6 tempest-GroupSnapshotsTest-2054420281 None] GroupSnapshot a2584bba-8384-4fcb-8bc2-02d7f130d2b0: creating. Feb 05 20:59:29.234261 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-c93b55ce-8b2f-4648-8c0e-541012532fb6 tempest-GroupSnapshotsTest-2054420281 None] Group snapshot a2584bba-8384-4fcb-8bc2-02d7f130d2b0: creating. {{(pid=122683) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4078}} Feb 05 20:59:29.287722 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c93b55ce-8b2f-4648-8c0e-541012532fb6 tempest-GroupSnapshotsTest-2054420281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:59:30.701228 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-c93b55ce-8b2f-4648-8c0e-541012532fb6 tempest-GroupSnapshotsTest-2054420281 None] group_snapshot a2584bba-8384-4fcb-8bc2-02d7f130d2b0: created successfully Feb 05 20:59:32.502298 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-2a5d416a-dffd-4c76-91be-ce9725218a46 tempest-GroupSnapshotsTest-2054420281 None] cloning volumes/volume-78866621-784c-421f-91d3-0d5f9f16da78@snapshot-14cd4e83-2114-48c6-8516-cfb961c62384 to volume-6c58a031-dc2e-47d1-818a-af919a68967f {{(pid=122683) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Feb 05 20:59:32.517653 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-2a5d416a-dffd-4c76-91be-ce9725218a46 tempest-GroupSnapshotsTest-2054420281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:59:32.670121 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-2a5d416a-dffd-4c76-91be-ce9725218a46 tempest-GroupSnapshotsTest-2054420281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:59:32.932969 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-2a5d416a-dffd-4c76-91be-ce9725218a46 tempest-GroupSnapshotsTest-2054420281 None] extra_specs: {} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 20:59:32.935507 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-2a5d416a-dffd-4c76-91be-ce9725218a46 tempest-GroupSnapshotsTest-2054420281 None] extra_specs: {} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 20:59:32.947229 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-2a5d416a-dffd-4c76-91be-ce9725218a46 tempest-GroupSnapshotsTest-2054420281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:59:33.101319 ncdv-master-1 cinder-volume[122683]: WARNING cinder.volume.drivers.rbd [None req-2a5d416a-dffd-4c76-91be-ce9725218a46 tempest-GroupSnapshotsTest-2054420281 None] Not using v2 clone API, please upgrade to mimic+ and set the OSD minimum client compat version to mimic for better performance, fewer deletion issues: NotImplementedError Feb 05 20:59:33.261440 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-2a5d416a-dffd-4c76-91be-ce9725218a46 tempest-GroupSnapshotsTest-2054420281 None] Create group from source-snapshot-a2584bba-8384-4fcb-8bc2-02d7f130d2b0 completed successfully. Feb 05 20:59:34.961431 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-b06d44c0-8c92-418b-b709-f3fa2f085351 tempest-GroupSnapshotsTest-2054420281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:59:35.202636 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-b06d44c0-8c92-418b-b709-f3fa2f085351 tempest-GroupSnapshotsTest-2054420281 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 20:59:35.280316 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-b06d44c0-8c92-418b-b709-f3fa2f085351 tempest-GroupSnapshotsTest-2054420281 None] deleting rbd volume volume-6c58a031-dc2e-47d1-818a-af919a68967f {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 20:59:36.250305 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-b06d44c0-8c92-418b-b709-f3fa2f085351 tempest-GroupSnapshotsTest-2054420281 None] Created reservations ['e9df96f5-9861-4413-828a-63beda824f1b'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 20:59:36.300808 ncdv-master-1 cinder-volume[122683]: WARNING cinder.quota [None req-b06d44c0-8c92-418b-b709-f3fa2f085351 tempest-GroupSnapshotsTest-2054420281 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-825098408 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-825098408, it is now deprecated. Please use the default quota class for default quota. Feb 05 20:59:36.303241 ncdv-master-1 cinder-volume[122683]: WARNING cinder.quota [None req-b06d44c0-8c92-418b-b709-f3fa2f085351 tempest-GroupSnapshotsTest-2054420281 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-825098408 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-825098408, it is now deprecated. Please use the default quota class for default quota. Feb 05 20:59:36.350155 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-b06d44c0-8c92-418b-b709-f3fa2f085351 tempest-GroupSnapshotsTest-2054420281 None] Created reservations ['c9487945-ba74-419f-b63d-2c9b531406da', 'feaa19f4-ca18-4307-9fe5-47ba16bbb9f0', 'cb7c04d7-ad88-4a8e-978c-e697ac1828f1', 'c1abf787-7745-49bf-8335-469db5112730'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 20:59:36.476059 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-b06d44c0-8c92-418b-b709-f3fa2f085351 tempest-GroupSnapshotsTest-2054420281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:59:36.553986 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-b06d44c0-8c92-418b-b709-f3fa2f085351 tempest-GroupSnapshotsTest-2054420281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:59:36.611048 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-b06d44c0-8c92-418b-b709-f3fa2f085351 tempest-GroupSnapshotsTest-2054420281 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 20:59:36.617547 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-b06d44c0-8c92-418b-b709-f3fa2f085351 tempest-GroupSnapshotsTest-2054420281 None] Delete group completed successfully. Feb 05 20:59:37.622845 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-c0e1554c-d7d3-47bb-a483-786b5bbf86a7 tempest-GroupSnapshotsTest-2054420281 None] group_snapshot a2584bba-8384-4fcb-8bc2-02d7f130d2b0: deleting Feb 05 20:59:37.711331 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-c0e1554c-d7d3-47bb-a483-786b5bbf86a7 tempest-GroupSnapshotsTest-2054420281 None] group_snapshot a2584bba-8384-4fcb-8bc2-02d7f130d2b0: deleting {{(pid=122683) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4253}} Feb 05 20:59:37.731168 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c0e1554c-d7d3-47bb-a483-786b5bbf86a7 tempest-GroupSnapshotsTest-2054420281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:59:38.565725 ncdv-master-1 cinder-volume[122683]: WARNING cinder.quota [None req-c0e1554c-d7d3-47bb-a483-786b5bbf86a7 tempest-GroupSnapshotsTest-2054420281 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-825098408 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-825098408, it is now deprecated. Please use the default quota class for default quota. Feb 05 20:59:38.595778 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-c0e1554c-d7d3-47bb-a483-786b5bbf86a7 tempest-GroupSnapshotsTest-2054420281 None] Created reservations ['539a8647-6575-4e17-9895-820414110c7e', '04f1876d-1e09-4452-9e6f-ed859676d175', '1ec67756-1fce-4b62-bb0b-b2c9a974596d', '08be58db-dcf1-46f7-8c76-95dc21917d4d'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 20:59:38.682860 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-c0e1554c-d7d3-47bb-a483-786b5bbf86a7 tempest-GroupSnapshotsTest-2054420281 None] group_snapshot a2584bba-8384-4fcb-8bc2-02d7f130d2b0: deleted successfully Feb 05 20:59:39.727945 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-2215b3dc-47cd-4a61-8dbd-f8fff520462e tempest-GroupSnapshotsTest-2054420281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:59:39.836880 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-2215b3dc-47cd-4a61-8dbd-f8fff520462e tempest-GroupSnapshotsTest-2054420281 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 20:59:39.837681 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-2215b3dc-47cd-4a61-8dbd-f8fff520462e tempest-GroupSnapshotsTest-2054420281 None] Volume volume-78866621-784c-421f-91d3-0d5f9f16da78 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 20:59:39.862130 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-2215b3dc-47cd-4a61-8dbd-f8fff520462e tempest-GroupSnapshotsTest-2054420281 None] deleting rbd volume volume-78866621-784c-421f-91d3-0d5f9f16da78 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 20:59:40.745802 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-2215b3dc-47cd-4a61-8dbd-f8fff520462e tempest-GroupSnapshotsTest-2054420281 None] Created reservations ['9f619182-de21-4546-ac14-b616abcbfa6e'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 20:59:40.882577 ncdv-master-1 cinder-volume[122683]: WARNING cinder.db.sqlalchemy.api [None req-2215b3dc-47cd-4a61-8dbd-f8fff520462e tempest-GroupSnapshotsTest-2054420281 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-825098408'] Feb 05 20:59:40.895225 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-2215b3dc-47cd-4a61-8dbd-f8fff520462e tempest-GroupSnapshotsTest-2054420281 None] Created reservations ['ea3204d8-0fc8-4acc-8d73-e12e6e18a9fb', '38841a9f-0aa2-4a06-81bf-ba2ac5e4ce35', '93369508-1621-490c-ab53-ec4099b0b080', '837a48f0-7586-440f-9458-3a1be104747e'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 20:59:41.066757 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-2215b3dc-47cd-4a61-8dbd-f8fff520462e tempest-GroupSnapshotsTest-2054420281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:59:41.149491 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-2215b3dc-47cd-4a61-8dbd-f8fff520462e tempest-GroupSnapshotsTest-2054420281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:59:41.189546 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-2215b3dc-47cd-4a61-8dbd-f8fff520462e tempest-GroupSnapshotsTest-2054420281 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 20:59:41.200580 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-2215b3dc-47cd-4a61-8dbd-f8fff520462e tempest-GroupSnapshotsTest-2054420281 None] Delete group completed successfully. Feb 05 20:59:42.538863 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-b04fb8d7-ab17-40af-877a-4f60ea2b0cfd tempest-GroupSnapshotsTest-2054420281 None] Group tempest-GroupSnapshotsTest-Group-1159856312: creating Feb 05 20:59:42.580587 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-b04fb8d7-ab17-40af-877a-4f60ea2b0cfd tempest-GroupSnapshotsTest-2054420281 None] Group tempest-GroupSnapshotsTest-Group-1159856312: created successfully Feb 05 20:59:42.601426 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-b04fb8d7-ab17-40af-877a-4f60ea2b0cfd tempest-GroupSnapshotsTest-2054420281 None] Create group completed successfully. Feb 05 20:59:44.453493 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-409c9464-c6e3-4dba-b38b-9887dfa9bdf4 tempest-GroupSnapshotsTest-2054420281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 20:59:44.461431 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-409c9464-c6e3-4dba-b38b-9887dfa9bdf4 tempest-GroupSnapshotsTest-2054420281 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 20:59:44.462225 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-409c9464-c6e3-4dba-b38b-9887dfa9bdf4 tempest-GroupSnapshotsTest-2054420281 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 20:59:44.494998 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-409c9464-c6e3-4dba-b38b-9887dfa9bdf4 tempest-GroupSnapshotsTest-2054420281 None] Flow 'volume_create_manager' (36ec4dda-8c49-4559-9df6-466001c36502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 20:59:44.507990 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-409c9464-c6e3-4dba-b38b-9887dfa9bdf4 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4524e247-2cb3-4ef6-86e5-1ed754a21fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:59:44.537797 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-409c9464-c6e3-4dba-b38b-9887dfa9bdf4 tempest-GroupSnapshotsTest-2054420281 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 20:59:44.582990 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-409c9464-c6e3-4dba-b38b-9887dfa9bdf4 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4524e247-2cb3-4ef6-86e5-1ed754a21fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T20:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-321833603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=59e55a0e-2622-4c7f-8ab2-fbe7edf86770,host='ncdv-master-1@ceph#ceph',id=2e63798e-20b9-4bc5-8d2a-65e3268452f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd6704b87ce043e087be4f8c2937678a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T20:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T20:59:44Z,use_quota=True,user_id='8880931f35204816b64d718a2803c46d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef605082-2d05-4b15-a03e-b507f1fb5a7a),volume_type_id=ef605082-2d05-4b15-a03e-b507f1fb5a7a)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:59:44.595805 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-409c9464-c6e3-4dba-b38b-9887dfa9bdf4 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58228552-e13e-4416-9c28-3da0c0ab089b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:59:44.603673 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-409c9464-c6e3-4dba-b38b-9887dfa9bdf4 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58228552-e13e-4416-9c28-3da0c0ab089b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:59:44.614186 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-409c9464-c6e3-4dba-b38b-9887dfa9bdf4 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2cf4bf5-c0a0-4bb2-83cb-608931b5e457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:59:44.620346 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-409c9464-c6e3-4dba-b38b-9887dfa9bdf4 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2cf4bf5-c0a0-4bb2-83cb-608931b5e457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e63798e-20b9-4bc5-8d2a-65e3268452f6', 'volume_name': 'volume-2e63798e-20b9-4bc5-8d2a-65e3268452f6', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:59:44.628993 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-409c9464-c6e3-4dba-b38b-9887dfa9bdf4 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e742ce42-8f89-435b-b605-b43b480d849b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:59:44.635134 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-409c9464-c6e3-4dba-b38b-9887dfa9bdf4 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e742ce42-8f89-435b-b605-b43b480d849b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:59:44.643980 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-409c9464-c6e3-4dba-b38b-9887dfa9bdf4 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dc729eb-f732-46e2-9c76-4c620513c5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:59:44.655376 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-409c9464-c6e3-4dba-b38b-9887dfa9bdf4 tempest-GroupSnapshotsTest-2054420281 None] Volume 2e63798e-20b9-4bc5-8d2a-65e3268452f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e63798e-20b9-4bc5-8d2a-65e3268452f6', 'volume_size': 1} Feb 05 20:59:44.656633 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-409c9464-c6e3-4dba-b38b-9887dfa9bdf4 tempest-GroupSnapshotsTest-2054420281 None] creating volume 'volume-2e63798e-20b9-4bc5-8d2a-65e3268452f6' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 20:59:44.658335 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-409c9464-c6e3-4dba-b38b-9887dfa9bdf4 tempest-GroupSnapshotsTest-2054420281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:59:44.820471 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-409c9464-c6e3-4dba-b38b-9887dfa9bdf4 tempest-GroupSnapshotsTest-2054420281 None] extra_specs: {} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 20:59:44.820999 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-409c9464-c6e3-4dba-b38b-9887dfa9bdf4 tempest-GroupSnapshotsTest-2054420281 None] extra_specs: {} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 20:59:44.825997 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-409c9464-c6e3-4dba-b38b-9887dfa9bdf4 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dc729eb-f732-46e2-9c76-4c620513c5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e63798e-20b9-4bc5-8d2a-65e3268452f6', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:59:44.837413 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-409c9464-c6e3-4dba-b38b-9887dfa9bdf4 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1fbeaa6-4d55-45ff-81bf-84f56bf42364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:59:44.849607 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-409c9464-c6e3-4dba-b38b-9887dfa9bdf4 tempest-GroupSnapshotsTest-2054420281 None] Volume volume-2e63798e-20b9-4bc5-8d2a-65e3268452f6 (2e63798e-20b9-4bc5-8d2a-65e3268452f6): created successfully Feb 05 20:59:44.854201 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-409c9464-c6e3-4dba-b38b-9887dfa9bdf4 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1fbeaa6-4d55-45ff-81bf-84f56bf42364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:59:44.868533 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-409c9464-c6e3-4dba-b38b-9887dfa9bdf4 tempest-GroupSnapshotsTest-2054420281 None] Flow 'volume_create_manager' (36ec4dda-8c49-4559-9df6-466001c36502) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 20:59:44.896711 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-409c9464-c6e3-4dba-b38b-9887dfa9bdf4 tempest-GroupSnapshotsTest-2054420281 None] Created volume successfully. Feb 05 20:59:46.581185 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d2b92f9-2e87-4690-9ea8-73e0abe5ee16 tempest-GroupSnapshotsTest-2054420281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 20:59:46.590371 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-8d2b92f9-2e87-4690-9ea8-73e0abe5ee16 tempest-GroupSnapshotsTest-2054420281 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 20:59:46.596787 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-8d2b92f9-2e87-4690-9ea8-73e0abe5ee16 tempest-GroupSnapshotsTest-2054420281 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 20:59:46.690498 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8d2b92f9-2e87-4690-9ea8-73e0abe5ee16 tempest-GroupSnapshotsTest-2054420281 None] Flow 'volume_create_manager' (fcfc80fe-e348-45ab-808a-58777c55c382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 20:59:46.711137 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8d2b92f9-2e87-4690-9ea8-73e0abe5ee16 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71e88583-2b81-45d0-8300-35d54cd80785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:59:46.730780 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-8d2b92f9-2e87-4690-9ea8-73e0abe5ee16 tempest-GroupSnapshotsTest-2054420281 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 20:59:46.777651 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8d2b92f9-2e87-4690-9ea8-73e0abe5ee16 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71e88583-2b81-45d0-8300-35d54cd80785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T20:59:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-348063641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=59e55a0e-2622-4c7f-8ab2-fbe7edf86770,host='ncdv-master-1@ceph#ceph',id=24707fbf-a59d-494d-9c7d-51a15db47957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd6704b87ce043e087be4f8c2937678a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T20:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T20:59:47Z,use_quota=True,user_id='8880931f35204816b64d718a2803c46d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef605082-2d05-4b15-a03e-b507f1fb5a7a),volume_type_id=ef605082-2d05-4b15-a03e-b507f1fb5a7a)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:59:46.802632 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8d2b92f9-2e87-4690-9ea8-73e0abe5ee16 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (775ea891-deb7-43f1-ad20-3fa7952f18a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:59:46.820837 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8d2b92f9-2e87-4690-9ea8-73e0abe5ee16 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (775ea891-deb7-43f1-ad20-3fa7952f18a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:59:46.840871 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8d2b92f9-2e87-4690-9ea8-73e0abe5ee16 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3425e545-c04a-4251-b68e-881b80d21baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:59:46.849993 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8d2b92f9-2e87-4690-9ea8-73e0abe5ee16 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3425e545-c04a-4251-b68e-881b80d21baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24707fbf-a59d-494d-9c7d-51a15db47957', 'volume_name': 'volume-24707fbf-a59d-494d-9c7d-51a15db47957', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:59:46.870681 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8d2b92f9-2e87-4690-9ea8-73e0abe5ee16 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bd10aa7-42aa-4428-a37f-44311f633ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:59:46.887025 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8d2b92f9-2e87-4690-9ea8-73e0abe5ee16 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bd10aa7-42aa-4428-a37f-44311f633ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:59:46.902093 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8d2b92f9-2e87-4690-9ea8-73e0abe5ee16 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43a137c9-495b-48b7-81c5-74469e855280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:59:46.906035 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-8d2b92f9-2e87-4690-9ea8-73e0abe5ee16 tempest-GroupSnapshotsTest-2054420281 None] Volume 24707fbf-a59d-494d-9c7d-51a15db47957: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24707fbf-a59d-494d-9c7d-51a15db47957', 'volume_size': 1} Feb 05 20:59:46.908361 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8d2b92f9-2e87-4690-9ea8-73e0abe5ee16 tempest-GroupSnapshotsTest-2054420281 None] creating volume 'volume-24707fbf-a59d-494d-9c7d-51a15db47957' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 20:59:46.909543 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8d2b92f9-2e87-4690-9ea8-73e0abe5ee16 tempest-GroupSnapshotsTest-2054420281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:59:47.079667 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8d2b92f9-2e87-4690-9ea8-73e0abe5ee16 tempest-GroupSnapshotsTest-2054420281 None] extra_specs: {} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 20:59:47.080344 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8d2b92f9-2e87-4690-9ea8-73e0abe5ee16 tempest-GroupSnapshotsTest-2054420281 None] extra_specs: {} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 20:59:47.091503 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8d2b92f9-2e87-4690-9ea8-73e0abe5ee16 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43a137c9-495b-48b7-81c5-74469e855280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24707fbf-a59d-494d-9c7d-51a15db47957', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:59:47.123968 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8d2b92f9-2e87-4690-9ea8-73e0abe5ee16 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59f154a3-8297-4c30-909d-dd5fb7bc8d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 20:59:47.138345 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-8d2b92f9-2e87-4690-9ea8-73e0abe5ee16 tempest-GroupSnapshotsTest-2054420281 None] Volume volume-24707fbf-a59d-494d-9c7d-51a15db47957 (24707fbf-a59d-494d-9c7d-51a15db47957): created successfully Feb 05 20:59:47.142664 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8d2b92f9-2e87-4690-9ea8-73e0abe5ee16 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59f154a3-8297-4c30-909d-dd5fb7bc8d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 20:59:47.171657 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8d2b92f9-2e87-4690-9ea8-73e0abe5ee16 tempest-GroupSnapshotsTest-2054420281 None] Flow 'volume_create_manager' (fcfc80fe-e348-45ab-808a-58777c55c382) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 20:59:47.213849 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-8d2b92f9-2e87-4690-9ea8-73e0abe5ee16 tempest-GroupSnapshotsTest-2054420281 None] Created volume successfully. Feb 05 20:59:48.202809 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-b7bdd6f4-6194-4155-a658-197f4d332762 tempest-GroupSnapshotsTest-2054420281 None] Update group completed successfully. Feb 05 20:59:49.822627 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-a0447378-a50b-425b-8ce2-38554f52e731 tempest-GroupSnapshotsTest-2054420281 None] Update group completed successfully. Feb 05 20:59:50.925055 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-3168ca07-5104-41c1-9a0c-b12df786a273 tempest-GroupSnapshotsTest-2054420281 None] Update group completed successfully. Feb 05 20:59:52.153844 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-4855e589-ec74-4ede-a733-97d276e96d19 tempest-GroupSnapshotsTest-2054420281 None] Update group completed successfully. Feb 05 20:59:52.568327 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 20:59:52.569196 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:59:52.673546 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:59:52.776559 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 20:59:54.115279 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-4bd00c92-86fb-4356-8b91-42689b89f8dc tempest-GroupSnapshotsTest-2054420281 None] GroupSnapshot 676f7faa-5fa0-4889-9313-58b04131a9e3: creating. Feb 05 20:59:54.170321 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-4bd00c92-86fb-4356-8b91-42689b89f8dc tempest-GroupSnapshotsTest-2054420281 None] Group snapshot 676f7faa-5fa0-4889-9313-58b04131a9e3: creating. {{(pid=122683) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4078}} Feb 05 20:59:54.220562 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-4bd00c92-86fb-4356-8b91-42689b89f8dc tempest-GroupSnapshotsTest-2054420281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:59:54.642583 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-4bd00c92-86fb-4356-8b91-42689b89f8dc tempest-GroupSnapshotsTest-2054420281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:59:55.785228 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-4bd00c92-86fb-4356-8b91-42689b89f8dc tempest-GroupSnapshotsTest-2054420281 None] group_snapshot 676f7faa-5fa0-4889-9313-58b04131a9e3: created successfully Feb 05 20:59:56.526854 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-662d89bd-04a3-4b2f-af95-28780d7c3e96 tempest-GroupSnapshotsTest-2054420281 None] group_snapshot 676f7faa-5fa0-4889-9313-58b04131a9e3: deleting Feb 05 20:59:56.581059 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-662d89bd-04a3-4b2f-af95-28780d7c3e96 tempest-GroupSnapshotsTest-2054420281 None] group_snapshot 676f7faa-5fa0-4889-9313-58b04131a9e3: deleting {{(pid=122683) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4253}} Feb 05 20:59:56.635003 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-662d89bd-04a3-4b2f-af95-28780d7c3e96 tempest-GroupSnapshotsTest-2054420281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:59:57.669505 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-662d89bd-04a3-4b2f-af95-28780d7c3e96 tempest-GroupSnapshotsTest-2054420281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:59:58.808777 ncdv-master-1 cinder-volume[122683]: WARNING cinder.quota [None req-662d89bd-04a3-4b2f-af95-28780d7c3e96 tempest-GroupSnapshotsTest-2054420281 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-413607560 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-413607560, it is now deprecated. Please use the default quota class for default quota. Feb 05 20:59:58.809564 ncdv-master-1 cinder-volume[122683]: WARNING cinder.quota [None req-662d89bd-04a3-4b2f-af95-28780d7c3e96 tempest-GroupSnapshotsTest-2054420281 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-413607560 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-413607560, it is now deprecated. Please use the default quota class for default quota. Feb 05 20:59:58.856962 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-662d89bd-04a3-4b2f-af95-28780d7c3e96 tempest-GroupSnapshotsTest-2054420281 None] Created reservations ['39d73452-fe8d-4637-a450-a470300d0117', 'ed76d4af-8da3-47dd-bb26-b876372837f7', '14102c42-3266-49df-8cb7-3d711f3b203f', '52462237-0a51-4c62-890f-8ed1eea714fe'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 20:59:59.043711 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-662d89bd-04a3-4b2f-af95-28780d7c3e96 tempest-GroupSnapshotsTest-2054420281 None] Created reservations ['3882d5ac-fe30-4620-b820-91504311dfd4', '4957f8ea-d371-49e1-a729-3d419c6a8fa0', '0ade52a8-09b6-441b-b384-e0fbc1afa0c3', '07bb75e6-b3f6-415a-b217-57ab3fff9f02'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 20:59:59.103516 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-662d89bd-04a3-4b2f-af95-28780d7c3e96 tempest-GroupSnapshotsTest-2054420281 None] group_snapshot 676f7faa-5fa0-4889-9313-58b04131a9e3: deleted successfully Feb 05 20:59:59.884209 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8bd9e3f7-4cc9-4b53-a445-946cfa88edc2 tempest-GroupSnapshotsTest-2054420281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 20:59:59.997640 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8bd9e3f7-4cc9-4b53-a445-946cfa88edc2 tempest-GroupSnapshotsTest-2054420281 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 20:59:59.998337 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8bd9e3f7-4cc9-4b53-a445-946cfa88edc2 tempest-GroupSnapshotsTest-2054420281 None] Volume volume-24707fbf-a59d-494d-9c7d-51a15db47957 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:00:00.007990 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8bd9e3f7-4cc9-4b53-a445-946cfa88edc2 tempest-GroupSnapshotsTest-2054420281 None] deleting rbd volume volume-24707fbf-a59d-494d-9c7d-51a15db47957 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:00:00.427156 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8bd9e3f7-4cc9-4b53-a445-946cfa88edc2 tempest-GroupSnapshotsTest-2054420281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:00:00.506708 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8bd9e3f7-4cc9-4b53-a445-946cfa88edc2 tempest-GroupSnapshotsTest-2054420281 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:00:00.507379 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8bd9e3f7-4cc9-4b53-a445-946cfa88edc2 tempest-GroupSnapshotsTest-2054420281 None] Volume volume-2e63798e-20b9-4bc5-8d2a-65e3268452f6 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:00:00.527975 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8bd9e3f7-4cc9-4b53-a445-946cfa88edc2 tempest-GroupSnapshotsTest-2054420281 None] deleting rbd volume volume-2e63798e-20b9-4bc5-8d2a-65e3268452f6 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:00:00.985228 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-8bd9e3f7-4cc9-4b53-a445-946cfa88edc2 tempest-GroupSnapshotsTest-2054420281 None] Created reservations ['415d0f95-328d-4f9c-a1f4-a64679b627e9'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:00:01.035982 ncdv-master-1 cinder-volume[122683]: WARNING cinder.quota [None req-8bd9e3f7-4cc9-4b53-a445-946cfa88edc2 tempest-GroupSnapshotsTest-2054420281 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-413607560 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-413607560, it is now deprecated. Please use the default quota class for default quota. Feb 05 21:00:01.093695 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-8bd9e3f7-4cc9-4b53-a445-946cfa88edc2 tempest-GroupSnapshotsTest-2054420281 None] Created reservations ['1b9ee463-558a-42e1-b574-114699c50d50', '49ab149c-1344-4f7c-aa44-9a9f4eb8975d', 'b4379d16-8c44-4e03-bdab-6f8e68a6b8d6', 'd134419c-96e5-4ef9-bda2-bc011a844668'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:00:01.314062 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-8bd9e3f7-4cc9-4b53-a445-946cfa88edc2 tempest-GroupSnapshotsTest-2054420281 None] Created reservations ['ca631c10-4f10-49b0-8d83-6ffceeacedff', 'a8645244-fb8a-4fec-86df-61bed4966fb3', 'c693357c-81a9-498b-ba81-7b3cb99bc73d', '46f9d132-eb58-4b21-b886-a8f923d80e9b'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:00:01.467400 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8bd9e3f7-4cc9-4b53-a445-946cfa88edc2 tempest-GroupSnapshotsTest-2054420281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:00:01.549960 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8bd9e3f7-4cc9-4b53-a445-946cfa88edc2 tempest-GroupSnapshotsTest-2054420281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:00:01.630665 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-8bd9e3f7-4cc9-4b53-a445-946cfa88edc2 tempest-GroupSnapshotsTest-2054420281 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:00:01.637337 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-8bd9e3f7-4cc9-4b53-a445-946cfa88edc2 tempest-GroupSnapshotsTest-2054420281 None] Delete group completed successfully. Feb 05 21:00:02.766649 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-7762f912-3149-4405-a580-5cbbcf67afb4 tempest-GroupSnapshotsTest-2054420281 None] Group tempest-GroupSnapshotsTest-Group-1152765498: creating Feb 05 21:00:02.802652 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-7762f912-3149-4405-a580-5cbbcf67afb4 tempest-GroupSnapshotsTest-2054420281 None] Group tempest-GroupSnapshotsTest-Group-1152765498: created successfully Feb 05 21:00:02.821400 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-7762f912-3149-4405-a580-5cbbcf67afb4 tempest-GroupSnapshotsTest-2054420281 None] Create group completed successfully. Feb 05 21:00:04.525162 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab06163f-1408-4621-a748-4ab019027701 tempest-GroupSnapshotsTest-2054420281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:00:04.531330 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-ab06163f-1408-4621-a748-4ab019027701 tempest-GroupSnapshotsTest-2054420281 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:00:04.532033 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-ab06163f-1408-4621-a748-4ab019027701 tempest-GroupSnapshotsTest-2054420281 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:00:04.564530 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ab06163f-1408-4621-a748-4ab019027701 tempest-GroupSnapshotsTest-2054420281 None] Flow 'volume_create_manager' (4f32d700-8cbc-4cfb-a7c8-ca4b0a59d706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:00:04.574321 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ab06163f-1408-4621-a748-4ab019027701 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c662252-2948-435f-a9f7-46b373512a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:00:04.584159 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-ab06163f-1408-4621-a748-4ab019027701 tempest-GroupSnapshotsTest-2054420281 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:00:04.608624 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ab06163f-1408-4621-a748-4ab019027701 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c662252-2948-435f-a9f7-46b373512a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-314224964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fc150eae-3446-47c3-a854-85cff53f6436,host='ncdv-master-1@ceph#ceph',id=f526427d-6910-4559-8615-97cd30b34e83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd6704b87ce043e087be4f8c2937678a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:00:04Z,use_quota=True,user_id='8880931f35204816b64d718a2803c46d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(163a740c-63d6-4c82-9866-b2d96c93d7d5),volume_type_id=163a740c-63d6-4c82-9866-b2d96c93d7d5)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:00:04.618727 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ab06163f-1408-4621-a748-4ab019027701 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b536d38-9852-44a7-9d4c-b92342f3be38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:00:04.632808 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ab06163f-1408-4621-a748-4ab019027701 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b536d38-9852-44a7-9d4c-b92342f3be38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:00:04.654990 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ab06163f-1408-4621-a748-4ab019027701 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5ee8841-9935-4b07-ad5d-35633fc5ffc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:00:04.663148 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ab06163f-1408-4621-a748-4ab019027701 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5ee8841-9935-4b07-ad5d-35633fc5ffc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f526427d-6910-4559-8615-97cd30b34e83', 'volume_name': 'volume-f526427d-6910-4559-8615-97cd30b34e83', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:00:04.669624 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ab06163f-1408-4621-a748-4ab019027701 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e540fe6f-faa9-417f-8f5c-750f4fa99760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:00:04.675267 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ab06163f-1408-4621-a748-4ab019027701 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e540fe6f-faa9-417f-8f5c-750f4fa99760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:00:04.681172 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ab06163f-1408-4621-a748-4ab019027701 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ed69622-4e0a-4e03-aadd-0acebc9bca40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:00:04.682572 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-ab06163f-1408-4621-a748-4ab019027701 tempest-GroupSnapshotsTest-2054420281 None] Volume f526427d-6910-4559-8615-97cd30b34e83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f526427d-6910-4559-8615-97cd30b34e83', 'volume_size': 1} Feb 05 21:00:04.683208 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ab06163f-1408-4621-a748-4ab019027701 tempest-GroupSnapshotsTest-2054420281 None] creating volume 'volume-f526427d-6910-4559-8615-97cd30b34e83' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:00:04.684473 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ab06163f-1408-4621-a748-4ab019027701 tempest-GroupSnapshotsTest-2054420281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:00:04.829263 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ab06163f-1408-4621-a748-4ab019027701 tempest-GroupSnapshotsTest-2054420281 None] extra_specs: {} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:00:04.829864 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ab06163f-1408-4621-a748-4ab019027701 tempest-GroupSnapshotsTest-2054420281 None] extra_specs: {} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:00:04.837759 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ab06163f-1408-4621-a748-4ab019027701 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ed69622-4e0a-4e03-aadd-0acebc9bca40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f526427d-6910-4559-8615-97cd30b34e83', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:00:04.846977 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ab06163f-1408-4621-a748-4ab019027701 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab0fa593-4fcc-40b6-8a61-7c1ef21fefba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:00:04.881356 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-ab06163f-1408-4621-a748-4ab019027701 tempest-GroupSnapshotsTest-2054420281 None] Volume volume-f526427d-6910-4559-8615-97cd30b34e83 (f526427d-6910-4559-8615-97cd30b34e83): created successfully Feb 05 21:00:04.887481 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ab06163f-1408-4621-a748-4ab019027701 tempest-GroupSnapshotsTest-2054420281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab0fa593-4fcc-40b6-8a61-7c1ef21fefba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:00:04.906868 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ab06163f-1408-4621-a748-4ab019027701 tempest-GroupSnapshotsTest-2054420281 None] Flow 'volume_create_manager' (4f32d700-8cbc-4cfb-a7c8-ca4b0a59d706) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:00:04.933257 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-ab06163f-1408-4621-a748-4ab019027701 tempest-GroupSnapshotsTest-2054420281 None] Created volume successfully. Feb 05 21:00:05.795435 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-4d672fa8-0fdd-40fd-bab4-4402af8c0db3 tempest-GroupSnapshotsTest-2054420281 None] GroupSnapshot 9103335a-b44b-495e-bcd2-72e99d0b8272: creating. Feb 05 21:00:05.822795 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-4d672fa8-0fdd-40fd-bab4-4402af8c0db3 tempest-GroupSnapshotsTest-2054420281 None] Group snapshot 9103335a-b44b-495e-bcd2-72e99d0b8272: creating. {{(pid=122683) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4078}} Feb 05 21:00:05.846190 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-4d672fa8-0fdd-40fd-bab4-4402af8c0db3 tempest-GroupSnapshotsTest-2054420281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:00:06.662644 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-4d672fa8-0fdd-40fd-bab4-4402af8c0db3 tempest-GroupSnapshotsTest-2054420281 None] group_snapshot 9103335a-b44b-495e-bcd2-72e99d0b8272: created successfully Feb 05 21:00:07.120598 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-f59e25ce-84d0-41cc-9a75-5985d29aa122 tempest-GroupSnapshotsTest-2054420281 None] group_snapshot 9103335a-b44b-495e-bcd2-72e99d0b8272: deleting Feb 05 21:00:07.191643 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-f59e25ce-84d0-41cc-9a75-5985d29aa122 tempest-GroupSnapshotsTest-2054420281 None] group_snapshot 9103335a-b44b-495e-bcd2-72e99d0b8272: deleting {{(pid=122683) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4253}} Feb 05 21:00:07.251950 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-f59e25ce-84d0-41cc-9a75-5985d29aa122 tempest-GroupSnapshotsTest-2054420281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:00:08.607218 ncdv-master-1 cinder-volume[122683]: WARNING cinder.quota [None req-f59e25ce-84d0-41cc-9a75-5985d29aa122 tempest-GroupSnapshotsTest-2054420281 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-388274419 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-388274419, it is now deprecated. Please use the default quota class for default quota. Feb 05 21:00:08.610767 ncdv-master-1 cinder-volume[122683]: WARNING cinder.quota [None req-f59e25ce-84d0-41cc-9a75-5985d29aa122 tempest-GroupSnapshotsTest-2054420281 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-388274419 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-388274419, it is now deprecated. Please use the default quota class for default quota. Feb 05 21:00:08.629898 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-f59e25ce-84d0-41cc-9a75-5985d29aa122 tempest-GroupSnapshotsTest-2054420281 None] Created reservations ['6e4d5de9-8de8-412c-8426-8e313e126d07', '8e789e3f-90da-4734-af72-d4a78e3962ad', 'fbf753bc-97d5-497e-8bef-cc71a7e08126', 'b32e4022-4c07-4a70-89c1-2ca5078d6d2b'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:00:08.704947 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-f59e25ce-84d0-41cc-9a75-5985d29aa122 tempest-GroupSnapshotsTest-2054420281 None] group_snapshot 9103335a-b44b-495e-bcd2-72e99d0b8272: deleted successfully Feb 05 21:00:10.256111 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-7843bc2c-e9ad-44d2-8bc5-fd86005e6830 tempest-GroupSnapshotsTest-2054420281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:00:10.379504 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-7843bc2c-e9ad-44d2-8bc5-fd86005e6830 tempest-GroupSnapshotsTest-2054420281 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:00:10.379946 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-7843bc2c-e9ad-44d2-8bc5-fd86005e6830 tempest-GroupSnapshotsTest-2054420281 None] Volume volume-f526427d-6910-4559-8615-97cd30b34e83 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:00:10.392035 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-7843bc2c-e9ad-44d2-8bc5-fd86005e6830 tempest-GroupSnapshotsTest-2054420281 None] deleting rbd volume volume-f526427d-6910-4559-8615-97cd30b34e83 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:00:10.924369 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-7843bc2c-e9ad-44d2-8bc5-fd86005e6830 tempest-GroupSnapshotsTest-2054420281 None] Created reservations ['aacb0d4e-a086-45f5-a7a9-959fecf9790e'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:00:10.985299 ncdv-master-1 cinder-volume[122683]: WARNING cinder.quota [None req-7843bc2c-e9ad-44d2-8bc5-fd86005e6830 tempest-GroupSnapshotsTest-2054420281 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-388274419 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-388274419, it is now deprecated. Please use the default quota class for default quota. Feb 05 21:00:11.002702 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-7843bc2c-e9ad-44d2-8bc5-fd86005e6830 tempest-GroupSnapshotsTest-2054420281 None] Created reservations ['0b2c9a9e-98d9-4279-84f5-76d8fc811708', '95729f66-2662-4508-9564-916d1303caec', '0b7eb664-d939-4a98-8e73-76cce73279e6', '4a3e7cc0-36e7-4dba-8d60-bb9a3e058498'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:00:11.101632 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-7843bc2c-e9ad-44d2-8bc5-fd86005e6830 tempest-GroupSnapshotsTest-2054420281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:00:11.179200 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-7843bc2c-e9ad-44d2-8bc5-fd86005e6830 tempest-GroupSnapshotsTest-2054420281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:00:11.251330 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-7843bc2c-e9ad-44d2-8bc5-fd86005e6830 tempest-GroupSnapshotsTest-2054420281 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:00:11.268649 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-7843bc2c-e9ad-44d2-8bc5-fd86005e6830 tempest-GroupSnapshotsTest-2054420281 None] Delete group completed successfully. Feb 05 21:00:23.841291 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-a004470e-7e51-406c-b0cb-1b9ef796f718 tempest-GroupsV314Test-112071497 None] Group tempest-GroupsV314Test-Group-872775761: creating Feb 05 21:00:23.877568 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-a004470e-7e51-406c-b0cb-1b9ef796f718 tempest-GroupsV314Test-112071497 None] Group tempest-GroupsV314Test-Group-872775761: created successfully Feb 05 21:00:23.896265 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-a004470e-7e51-406c-b0cb-1b9ef796f718 tempest-GroupsV314Test-112071497 None] Create group completed successfully. Feb 05 21:00:25.474017 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-899ba7e3-7272-4794-a152-a7cde48284fc tempest-GroupsV314Test-112071497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:00:25.478043 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-899ba7e3-7272-4794-a152-a7cde48284fc tempest-GroupsV314Test-112071497 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:00:25.478524 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-899ba7e3-7272-4794-a152-a7cde48284fc tempest-GroupsV314Test-112071497 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:00:25.501593 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-899ba7e3-7272-4794-a152-a7cde48284fc tempest-GroupsV314Test-112071497 None] Flow 'volume_create_manager' (6be62dab-3426-4c47-a818-d4a02a4caaba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:00:25.516444 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-899ba7e3-7272-4794-a152-a7cde48284fc tempest-GroupsV314Test-112071497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cd81631-1c1c-4fea-a7a8-ae3158b185bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:00:25.523751 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-899ba7e3-7272-4794-a152-a7cde48284fc tempest-GroupsV314Test-112071497 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:00:25.545379 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-899ba7e3-7272-4794-a152-a7cde48284fc tempest-GroupsV314Test-112071497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cd81631-1c1c-4fea-a7a8-ae3158b185bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsV314Test-Volume-16513666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6eac8531-bfe6-410a-a9c0-30d7c6b0b160,host='ncdv-master-1@ceph#ceph',id=6f5206a4-9c33-4b89-8122-02cdd3d2fa24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece026c847a44a76a179f84e90bf0334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:00:25Z,use_quota=True,user_id='00ccb31d8e904ed69f572876659230a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd059b99-08f7-4119-ac64-51249f953703),volume_type_id=dd059b99-08f7-4119-ac64-51249f953703)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:00:25.552672 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-899ba7e3-7272-4794-a152-a7cde48284fc tempest-GroupsV314Test-112071497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16e2f272-dead-4d6d-8489-dd20c5fc84df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:00:25.558953 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-899ba7e3-7272-4794-a152-a7cde48284fc tempest-GroupsV314Test-112071497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16e2f272-dead-4d6d-8489-dd20c5fc84df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:00:25.565574 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-899ba7e3-7272-4794-a152-a7cde48284fc tempest-GroupsV314Test-112071497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7959250e-7e6f-47fa-8897-82d27f98b9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:00:25.570258 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-899ba7e3-7272-4794-a152-a7cde48284fc tempest-GroupsV314Test-112071497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7959250e-7e6f-47fa-8897-82d27f98b9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f5206a4-9c33-4b89-8122-02cdd3d2fa24', 'volume_name': 'volume-6f5206a4-9c33-4b89-8122-02cdd3d2fa24', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:00:25.575619 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-899ba7e3-7272-4794-a152-a7cde48284fc tempest-GroupsV314Test-112071497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a34b43c-7a28-4bce-8c03-cc814f14fcad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:00:25.581056 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-899ba7e3-7272-4794-a152-a7cde48284fc tempest-GroupsV314Test-112071497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a34b43c-7a28-4bce-8c03-cc814f14fcad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:00:25.587319 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-899ba7e3-7272-4794-a152-a7cde48284fc tempest-GroupsV314Test-112071497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e07ab7a-ab37-4996-9bb1-03ad01a0c2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:00:25.588986 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-899ba7e3-7272-4794-a152-a7cde48284fc tempest-GroupsV314Test-112071497 None] Volume 6f5206a4-9c33-4b89-8122-02cdd3d2fa24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f5206a4-9c33-4b89-8122-02cdd3d2fa24', 'volume_size': 1} Feb 05 21:00:25.589541 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-899ba7e3-7272-4794-a152-a7cde48284fc tempest-GroupsV314Test-112071497 None] creating volume 'volume-6f5206a4-9c33-4b89-8122-02cdd3d2fa24' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:00:25.590817 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-899ba7e3-7272-4794-a152-a7cde48284fc tempest-GroupsV314Test-112071497 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:00:25.688162 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-899ba7e3-7272-4794-a152-a7cde48284fc tempest-GroupsV314Test-112071497 None] extra_specs: {} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:00:25.688961 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-899ba7e3-7272-4794-a152-a7cde48284fc tempest-GroupsV314Test-112071497 None] extra_specs: {} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:00:25.694744 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-899ba7e3-7272-4794-a152-a7cde48284fc tempest-GroupsV314Test-112071497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e07ab7a-ab37-4996-9bb1-03ad01a0c2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f5206a4-9c33-4b89-8122-02cdd3d2fa24', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:00:25.701160 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-899ba7e3-7272-4794-a152-a7cde48284fc tempest-GroupsV314Test-112071497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f642ea-5871-4d87-9706-7866bf3018b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:00:25.716677 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-899ba7e3-7272-4794-a152-a7cde48284fc tempest-GroupsV314Test-112071497 None] Volume volume-6f5206a4-9c33-4b89-8122-02cdd3d2fa24 (6f5206a4-9c33-4b89-8122-02cdd3d2fa24): created successfully Feb 05 21:00:25.723940 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-899ba7e3-7272-4794-a152-a7cde48284fc tempest-GroupsV314Test-112071497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f642ea-5871-4d87-9706-7866bf3018b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:00:25.731914 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-899ba7e3-7272-4794-a152-a7cde48284fc tempest-GroupsV314Test-112071497 None] Flow 'volume_create_manager' (6be62dab-3426-4c47-a818-d4a02a4caaba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:00:25.747094 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-899ba7e3-7272-4794-a152-a7cde48284fc tempest-GroupsV314Test-112071497 None] Created volume successfully. Feb 05 21:00:27.432290 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e88cdf51-99fa-4ca5-8578-e2ee301dde96 tempest-GroupsV314Test-112071497 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:00:27.530786 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e88cdf51-99fa-4ca5-8578-e2ee301dde96 tempest-GroupsV314Test-112071497 None] creating snapshot='volume-f8d47dd8-3c31-4469-ae16-58dad7e387e6.clone_snap' {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 05 21:00:28.520898 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e88cdf51-99fa-4ca5-8578-e2ee301dde96 tempest-GroupsV314Test-112071497 None] cloning 'volume-6f5206a4-9c33-4b89-8122-02cdd3d2fa24@volume-f8d47dd8-3c31-4469-ae16-58dad7e387e6.clone_snap' to 'volume-f8d47dd8-3c31-4469-ae16-58dad7e387e6' {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 05 21:00:28.689916 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e88cdf51-99fa-4ca5-8578-e2ee301dde96 tempest-GroupsV314Test-112071497 None] Volume volume-6f5206a4-9c33-4b89-8122-02cdd3d2fa24 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:00:28.704932 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e88cdf51-99fa-4ca5-8578-e2ee301dde96 tempest-GroupsV314Test-112071497 None] extra_specs: {} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:00:28.706671 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e88cdf51-99fa-4ca5-8578-e2ee301dde96 tempest-GroupsV314Test-112071497 None] extra_specs: {} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:00:28.751849 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e88cdf51-99fa-4ca5-8578-e2ee301dde96 tempest-GroupsV314Test-112071497 None] clone created successfully {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 05 21:00:28.832560 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-e88cdf51-99fa-4ca5-8578-e2ee301dde96 tempest-GroupsV314Test-112071497 None] Create group from source-group-6eac8531-bfe6-410a-a9c0-30d7c6b0b160 completed successfully. Feb 05 21:00:30.436961 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-d3455f79-0d52-4302-be86-88666901d11a tempest-GroupsV314Test-112071497 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:00:30.539160 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-d3455f79-0d52-4302-be86-88666901d11a tempest-GroupsV314Test-112071497 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:00:30.548504 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-d3455f79-0d52-4302-be86-88666901d11a tempest-GroupsV314Test-112071497 None] deleting rbd volume volume-f8d47dd8-3c31-4469-ae16-58dad7e387e6 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:00:30.895648 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-d3455f79-0d52-4302-be86-88666901d11a tempest-GroupsV314Test-112071497 None] volume is a clone so cleaning references {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 05 21:00:30.918220 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-d3455f79-0d52-4302-be86-88666901d11a tempest-GroupsV314Test-112071497 None] Volume volume-6f5206a4-9c33-4b89-8122-02cdd3d2fa24 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:00:30.918817 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-d3455f79-0d52-4302-be86-88666901d11a tempest-GroupsV314Test-112071497 None] deleting parent snapshot volume-f8d47dd8-3c31-4469-ae16-58dad7e387e6.clone_snap {{(pid=122683) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 05 21:00:32.219258 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-d3455f79-0d52-4302-be86-88666901d11a tempest-GroupsV314Test-112071497 None] Created reservations ['47a0d237-555a-4cb3-a8b7-caf40325a960'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:00:32.260120 ncdv-master-1 cinder-volume[122683]: WARNING cinder.quota [None req-d3455f79-0d52-4302-be86-88666901d11a tempest-GroupsV314Test-112071497 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-378352150 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-378352150, it is now deprecated. Please use the default quota class for default quota. Feb 05 21:00:32.263239 ncdv-master-1 cinder-volume[122683]: WARNING cinder.quota [None req-d3455f79-0d52-4302-be86-88666901d11a tempest-GroupsV314Test-112071497 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-378352150 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-378352150, it is now deprecated. Please use the default quota class for default quota. Feb 05 21:00:32.292212 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-d3455f79-0d52-4302-be86-88666901d11a tempest-GroupsV314Test-112071497 None] Created reservations ['31e5e275-0779-4983-8568-d085b163eb53', 'a0df9c97-d2ea-4f43-a0fd-579102a4d08b', 'e0ac6ca0-4fb0-433b-b0f2-33af53a2771d', 'c938f47d-4ca2-4539-aef5-f1b8531e6d95'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:00:32.425476 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-d3455f79-0d52-4302-be86-88666901d11a tempest-GroupsV314Test-112071497 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:00:32.480571 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-d3455f79-0d52-4302-be86-88666901d11a tempest-GroupsV314Test-112071497 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:00:32.535767 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-d3455f79-0d52-4302-be86-88666901d11a tempest-GroupsV314Test-112071497 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:00:32.544903 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-d3455f79-0d52-4302-be86-88666901d11a tempest-GroupsV314Test-112071497 None] Delete group completed successfully. Feb 05 21:00:32.939703 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e62971e8-a27c-4ae1-8001-2f0b1849b34a tempest-GroupsV314Test-112071497 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:00:33.025066 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e62971e8-a27c-4ae1-8001-2f0b1849b34a tempest-GroupsV314Test-112071497 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:00:33.025459 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e62971e8-a27c-4ae1-8001-2f0b1849b34a tempest-GroupsV314Test-112071497 None] Volume volume-6f5206a4-9c33-4b89-8122-02cdd3d2fa24 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:00:33.034014 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e62971e8-a27c-4ae1-8001-2f0b1849b34a tempest-GroupsV314Test-112071497 None] deleting rbd volume volume-6f5206a4-9c33-4b89-8122-02cdd3d2fa24 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:00:33.625430 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-e62971e8-a27c-4ae1-8001-2f0b1849b34a tempest-GroupsV314Test-112071497 None] Created reservations ['2fee1a39-fbdf-4e9b-ac0b-afff5ed29514'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:00:33.675705 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-e62971e8-a27c-4ae1-8001-2f0b1849b34a tempest-GroupsV314Test-112071497 None] Created reservations ['b631979b-0259-4933-bacf-8bcd1ef4f260', '1042c339-f56e-4e02-95e6-e5e8c0928671', 'fbf28e7a-904f-4878-9ab0-f8b413cfdfaf', '1c7b164c-11cd-4186-a9a9-e7bc545a0df3'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:00:33.792770 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e62971e8-a27c-4ae1-8001-2f0b1849b34a tempest-GroupsV314Test-112071497 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:00:33.858900 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e62971e8-a27c-4ae1-8001-2f0b1849b34a tempest-GroupsV314Test-112071497 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:00:33.917488 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-e62971e8-a27c-4ae1-8001-2f0b1849b34a tempest-GroupsV314Test-112071497 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:00:33.921994 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-e62971e8-a27c-4ae1-8001-2f0b1849b34a tempest-GroupsV314Test-112071497 None] Delete group completed successfully. Feb 05 21:00:39.584495 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4e3830c-46fd-46ec-abd9-b6b717f97e2d tempest-VolumeTypesTest-1593031382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:00:39.596217 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-b4e3830c-46fd-46ec-abd9-b6b717f97e2d tempest-VolumeTypesTest-1593031382 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:00:39.596703 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-b4e3830c-46fd-46ec-abd9-b6b717f97e2d tempest-VolumeTypesTest-1593031382 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:00:39.654689 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b4e3830c-46fd-46ec-abd9-b6b717f97e2d tempest-VolumeTypesTest-1593031382 None] Flow 'volume_create_manager' (f3c35022-029e-4529-abcb-2e6a51e18b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:00:39.665758 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b4e3830c-46fd-46ec-abd9-b6b717f97e2d tempest-VolumeTypesTest-1593031382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a3fdc91-735d-401b-b5c5-a5694d8dbebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:00:39.676117 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-b4e3830c-46fd-46ec-abd9-b6b717f97e2d tempest-VolumeTypesTest-1593031382 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:00:39.696522 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b4e3830c-46fd-46ec-abd9-b6b717f97e2d tempest-VolumeTypesTest-1593031382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a3fdc91-735d-401b-b5c5-a5694d8dbebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-1980383898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b334ff08-20b2-452b-bf27-46ab3f14b775,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac7e19dcc25b4d2ba896162ab8f8fdd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:00:40Z,use_quota=True,user_id='0f81b0cd8ab74521aa4ec9e012cfdfac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da1671d5-04b6-4180-88d5-d8b7f1bf1ead),volume_type_id=da1671d5-04b6-4180-88d5-d8b7f1bf1ead)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:00:39.704335 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b4e3830c-46fd-46ec-abd9-b6b717f97e2d tempest-VolumeTypesTest-1593031382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13bd97b6-b985-46f6-9519-e9304e6a0760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:00:39.709727 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b4e3830c-46fd-46ec-abd9-b6b717f97e2d tempest-VolumeTypesTest-1593031382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13bd97b6-b985-46f6-9519-e9304e6a0760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:00:39.715602 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b4e3830c-46fd-46ec-abd9-b6b717f97e2d tempest-VolumeTypesTest-1593031382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bda97ce7-beda-4296-9ae0-af4fe52c99ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:00:39.720906 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b4e3830c-46fd-46ec-abd9-b6b717f97e2d tempest-VolumeTypesTest-1593031382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bda97ce7-beda-4296-9ae0-af4fe52c99ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b334ff08-20b2-452b-bf27-46ab3f14b775', 'volume_name': 'volume-b334ff08-20b2-452b-bf27-46ab3f14b775', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:00:39.726275 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b4e3830c-46fd-46ec-abd9-b6b717f97e2d tempest-VolumeTypesTest-1593031382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a20dab86-7028-44e6-9751-0ace602c5096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:00:39.730610 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b4e3830c-46fd-46ec-abd9-b6b717f97e2d tempest-VolumeTypesTest-1593031382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a20dab86-7028-44e6-9751-0ace602c5096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:00:39.736337 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b4e3830c-46fd-46ec-abd9-b6b717f97e2d tempest-VolumeTypesTest-1593031382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67c56643-86cf-4ac6-8120-b5deb29f83cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:00:39.737675 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-b4e3830c-46fd-46ec-abd9-b6b717f97e2d tempest-VolumeTypesTest-1593031382 None] Volume b334ff08-20b2-452b-bf27-46ab3f14b775: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b334ff08-20b2-452b-bf27-46ab3f14b775', 'volume_size': 1} Feb 05 21:00:39.738232 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-b4e3830c-46fd-46ec-abd9-b6b717f97e2d tempest-VolumeTypesTest-1593031382 None] creating volume 'volume-b334ff08-20b2-452b-bf27-46ab3f14b775' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:00:39.739411 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-b4e3830c-46fd-46ec-abd9-b6b717f97e2d tempest-VolumeTypesTest-1593031382 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:00:39.840116 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-b4e3830c-46fd-46ec-abd9-b6b717f97e2d tempest-VolumeTypesTest-1593031382 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:00:39.840503 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-b4e3830c-46fd-46ec-abd9-b6b717f97e2d tempest-VolumeTypesTest-1593031382 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:00:39.844978 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b4e3830c-46fd-46ec-abd9-b6b717f97e2d tempest-VolumeTypesTest-1593031382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67c56643-86cf-4ac6-8120-b5deb29f83cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b334ff08-20b2-452b-bf27-46ab3f14b775', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:00:39.850212 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b4e3830c-46fd-46ec-abd9-b6b717f97e2d tempest-VolumeTypesTest-1593031382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38725d94-2c64-44b2-903a-001d35ddf875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:00:39.862548 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-b4e3830c-46fd-46ec-abd9-b6b717f97e2d tempest-VolumeTypesTest-1593031382 None] Volume volume-b334ff08-20b2-452b-bf27-46ab3f14b775 (b334ff08-20b2-452b-bf27-46ab3f14b775): created successfully Feb 05 21:00:39.871361 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b4e3830c-46fd-46ec-abd9-b6b717f97e2d tempest-VolumeTypesTest-1593031382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38725d94-2c64-44b2-903a-001d35ddf875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:00:39.880553 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b4e3830c-46fd-46ec-abd9-b6b717f97e2d tempest-VolumeTypesTest-1593031382 None] Flow 'volume_create_manager' (f3c35022-029e-4529-abcb-2e6a51e18b15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:00:39.893444 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-b4e3830c-46fd-46ec-abd9-b6b717f97e2d tempest-VolumeTypesTest-1593031382 None] Created volume successfully. Feb 05 21:00:40.994183 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-901546e5-441a-4941-8410-7340c29d8da9 tempest-VolumeTypesTest-1593031382 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:00:41.048227 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-901546e5-441a-4941-8410-7340c29d8da9 tempest-VolumeTypesTest-1593031382 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:00:41.107382 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-901546e5-441a-4941-8410-7340c29d8da9 tempest-VolumeTypesTest-1593031382 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:00:41.112527 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-901546e5-441a-4941-8410-7340c29d8da9 tempest-VolumeTypesTest-1593031382 None] Retype volume completed successfully. Feb 05 21:00:43.448989 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-c2921573-908a-449e-9918-9e9c8f1f817e tempest-VolumeTypesTest-1593031382 None] Lock "b'cinder-b334ff08-20b2-452b-bf27-46ab3f14b775-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:00:43.539071 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c2921573-908a-449e-9918-9e9c8f1f817e tempest-VolumeTypesTest-1593031382 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:00:43.621438 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c2921573-908a-449e-9918-9e9c8f1f817e tempest-VolumeTypesTest-1593031382 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:00:43.621871 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c2921573-908a-449e-9918-9e9c8f1f817e tempest-VolumeTypesTest-1593031382 None] Volume volume-b334ff08-20b2-452b-bf27-46ab3f14b775 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:00:43.634360 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c2921573-908a-449e-9918-9e9c8f1f817e tempest-VolumeTypesTest-1593031382 None] deleting rbd volume volume-b334ff08-20b2-452b-bf27-46ab3f14b775 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:00:44.174209 ncdv-master-1 cinder-volume[122683]: WARNING cinder.quota [None req-c2921573-908a-449e-9918-9e9c8f1f817e tempest-VolumeTypesTest-1593031382 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesTest-volume-type-1397667785 is set by the default quota flag: quota_volumes_tempest-VolumeTypesTest-volume-type-1397667785, it is now deprecated. Please use the default quota class for default quota. Feb 05 21:00:44.175374 ncdv-master-1 cinder-volume[122683]: WARNING cinder.quota [None req-c2921573-908a-449e-9918-9e9c8f1f817e tempest-VolumeTypesTest-1593031382 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesTest-volume-type-1397667785 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesTest-volume-type-1397667785, it is now deprecated. Please use the default quota class for default quota. Feb 05 21:00:44.200790 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-c2921573-908a-449e-9918-9e9c8f1f817e tempest-VolumeTypesTest-1593031382 None] Created reservations ['23030736-84fd-413c-aad2-f8ff52891eae', '9b6819bc-7e26-4aa4-9d59-9188c9726018', 'b2e7ea29-e202-441c-bd88-57d43e5ccd09', 'c97d0f64-d3a9-4641-9250-02e7b8ccc720'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:00:44.290646 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c2921573-908a-449e-9918-9e9c8f1f817e tempest-VolumeTypesTest-1593031382 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:00:44.363241 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c2921573-908a-449e-9918-9e9c8f1f817e tempest-VolumeTypesTest-1593031382 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:00:44.431205 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-c2921573-908a-449e-9918-9e9c8f1f817e tempest-VolumeTypesTest-1593031382 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:00:44.436583 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-c2921573-908a-449e-9918-9e9c8f1f817e tempest-VolumeTypesTest-1593031382 None] Deleted volume successfully. Feb 05 21:00:44.464843 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-c2921573-908a-449e-9918-9e9c8f1f817e tempest-VolumeTypesTest-1593031382 None] Lock "b'cinder-b334ff08-20b2-452b-bf27-46ab3f14b775-delete_volume'" released by "delete_volume" :: held 1.015s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:00:52.127527 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e3b3068-6289-4835-8ab0-9c4cc2e268be tempest-VolumeRetypeWithoutMigrationTest-1800045287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:00:52.137213 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-8e3b3068-6289-4835-8ab0-9c4cc2e268be tempest-VolumeRetypeWithoutMigrationTest-1800045287 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:00:52.141132 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-8e3b3068-6289-4835-8ab0-9c4cc2e268be tempest-VolumeRetypeWithoutMigrationTest-1800045287 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:00:52.217491 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8e3b3068-6289-4835-8ab0-9c4cc2e268be tempest-VolumeRetypeWithoutMigrationTest-1800045287 None] Flow 'volume_create_manager' (4111bb20-dd1b-43eb-acc8-96fcfd9bdaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:00:52.236378 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8e3b3068-6289-4835-8ab0-9c4cc2e268be tempest-VolumeRetypeWithoutMigrationTest-1800045287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c8a8f03-5d47-4aa2-b1ed-6de0647bf331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:00:52.261452 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-8e3b3068-6289-4835-8ab0-9c4cc2e268be tempest-VolumeRetypeWithoutMigrationTest-1800045287 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:00:52.334481 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8e3b3068-6289-4835-8ab0-9c4cc2e268be tempest-VolumeRetypeWithoutMigrationTest-1800045287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c8a8f03-5d47-4aa2-b1ed-6de0647bf331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:00:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1920773634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e76c73ab-1ebc-4a63-b69e-55ef5dfdb40e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c82ec764e2b4ba7b31f9784114ad689',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:00:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:00:52Z,use_quota=True,user_id='6a9219d8cf134fd3927e8746376df1c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3abda3a-dc0c-42ad-befe-3c32d9eb0564),volume_type_id=f3abda3a-dc0c-42ad-befe-3c32d9eb0564)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:00:52.371706 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8e3b3068-6289-4835-8ab0-9c4cc2e268be tempest-VolumeRetypeWithoutMigrationTest-1800045287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96844305-f14a-4f64-816d-95e29f0ca360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:00:52.388365 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8e3b3068-6289-4835-8ab0-9c4cc2e268be tempest-VolumeRetypeWithoutMigrationTest-1800045287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96844305-f14a-4f64-816d-95e29f0ca360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:00:52.402131 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8e3b3068-6289-4835-8ab0-9c4cc2e268be tempest-VolumeRetypeWithoutMigrationTest-1800045287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f4641f7-d857-4584-9465-bcf792a233af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:00:52.414305 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8e3b3068-6289-4835-8ab0-9c4cc2e268be tempest-VolumeRetypeWithoutMigrationTest-1800045287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f4641f7-d857-4584-9465-bcf792a233af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e76c73ab-1ebc-4a63-b69e-55ef5dfdb40e', 'volume_name': 'volume-e76c73ab-1ebc-4a63-b69e-55ef5dfdb40e', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:00:52.425972 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8e3b3068-6289-4835-8ab0-9c4cc2e268be tempest-VolumeRetypeWithoutMigrationTest-1800045287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67596827-9379-4976-bb4f-5028907a2fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:00:52.440159 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8e3b3068-6289-4835-8ab0-9c4cc2e268be tempest-VolumeRetypeWithoutMigrationTest-1800045287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67596827-9379-4976-bb4f-5028907a2fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:00:52.461398 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8e3b3068-6289-4835-8ab0-9c4cc2e268be tempest-VolumeRetypeWithoutMigrationTest-1800045287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8407f710-b650-4d5e-a977-7b17eecee62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:00:52.463179 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-8e3b3068-6289-4835-8ab0-9c4cc2e268be tempest-VolumeRetypeWithoutMigrationTest-1800045287 None] Volume e76c73ab-1ebc-4a63-b69e-55ef5dfdb40e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e76c73ab-1ebc-4a63-b69e-55ef5dfdb40e', 'volume_size': 1} Feb 05 21:00:52.463731 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8e3b3068-6289-4835-8ab0-9c4cc2e268be tempest-VolumeRetypeWithoutMigrationTest-1800045287 None] creating volume 'volume-e76c73ab-1ebc-4a63-b69e-55ef5dfdb40e' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:00:52.471748 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8e3b3068-6289-4835-8ab0-9c4cc2e268be tempest-VolumeRetypeWithoutMigrationTest-1800045287 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:00:52.572383 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:00:52.573333 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:00:52.646218 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:00:52.727269 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:00:52.740856 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8e3b3068-6289-4835-8ab0-9c4cc2e268be tempest-VolumeRetypeWithoutMigrationTest-1800045287 None] extra_specs: {} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:00:52.743053 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8e3b3068-6289-4835-8ab0-9c4cc2e268be tempest-VolumeRetypeWithoutMigrationTest-1800045287 None] extra_specs: {} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:00:52.760630 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8e3b3068-6289-4835-8ab0-9c4cc2e268be tempest-VolumeRetypeWithoutMigrationTest-1800045287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8407f710-b650-4d5e-a977-7b17eecee62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e76c73ab-1ebc-4a63-b69e-55ef5dfdb40e', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:00:52.776139 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8e3b3068-6289-4835-8ab0-9c4cc2e268be tempest-VolumeRetypeWithoutMigrationTest-1800045287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ed8f2e-732b-4a72-a4c4-6f98a41ae7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:00:52.813114 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-8e3b3068-6289-4835-8ab0-9c4cc2e268be tempest-VolumeRetypeWithoutMigrationTest-1800045287 None] Volume volume-e76c73ab-1ebc-4a63-b69e-55ef5dfdb40e (e76c73ab-1ebc-4a63-b69e-55ef5dfdb40e): created successfully Feb 05 21:00:52.818674 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8e3b3068-6289-4835-8ab0-9c4cc2e268be tempest-VolumeRetypeWithoutMigrationTest-1800045287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ed8f2e-732b-4a72-a4c4-6f98a41ae7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:00:52.839071 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8e3b3068-6289-4835-8ab0-9c4cc2e268be tempest-VolumeRetypeWithoutMigrationTest-1800045287 None] Flow 'volume_create_manager' (4111bb20-dd1b-43eb-acc8-96fcfd9bdaec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:00:52.853629 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-8e3b3068-6289-4835-8ab0-9c4cc2e268be tempest-VolumeRetypeWithoutMigrationTest-1800045287 None] Created volume successfully. Feb 05 21:00:53.755091 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-b15b000b-f4e7-49bb-9368-c3a864023a35 tempest-VolumeRetypeWithoutMigrationTest-1800045287 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:00:53.870042 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-b15b000b-f4e7-49bb-9368-c3a864023a35 tempest-VolumeRetypeWithoutMigrationTest-1800045287 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:00:53.938304 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-b15b000b-f4e7-49bb-9368-c3a864023a35 tempest-VolumeRetypeWithoutMigrationTest-1800045287 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:00:53.942280 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-b15b000b-f4e7-49bb-9368-c3a864023a35 tempest-VolumeRetypeWithoutMigrationTest-1800045287 None] Retype volume completed successfully. Feb 05 21:00:55.146368 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-c1842388-444a-4e72-853d-f786d69a26fc tempest-VolumeRetypeWithoutMigrationTest-1800045287 None] Lock "b'cinder-e76c73ab-1ebc-4a63-b69e-55ef5dfdb40e-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:00:55.194513 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c1842388-444a-4e72-853d-f786d69a26fc tempest-VolumeRetypeWithoutMigrationTest-1800045287 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:00:55.266159 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c1842388-444a-4e72-853d-f786d69a26fc tempest-VolumeRetypeWithoutMigrationTest-1800045287 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:00:55.266619 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c1842388-444a-4e72-853d-f786d69a26fc tempest-VolumeRetypeWithoutMigrationTest-1800045287 None] Volume volume-e76c73ab-1ebc-4a63-b69e-55ef5dfdb40e is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:00:55.283769 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c1842388-444a-4e72-853d-f786d69a26fc tempest-VolumeRetypeWithoutMigrationTest-1800045287 None] deleting rbd volume volume-e76c73ab-1ebc-4a63-b69e-55ef5dfdb40e {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:00:55.738833 ncdv-master-1 cinder-volume[122683]: WARNING cinder.quota [None req-c1842388-444a-4e72-853d-f786d69a26fc tempest-VolumeRetypeWithoutMigrationTest-1800045287 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Feb 05 21:00:55.739999 ncdv-master-1 cinder-volume[122683]: WARNING cinder.quota [None req-c1842388-444a-4e72-853d-f786d69a26fc tempest-VolumeRetypeWithoutMigrationTest-1800045287 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Feb 05 21:00:55.762629 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-c1842388-444a-4e72-853d-f786d69a26fc tempest-VolumeRetypeWithoutMigrationTest-1800045287 None] Created reservations ['162bdab3-1842-4475-9110-90fad71e34c8', '62922798-ba77-482d-8f20-76b73abb9543', '3fc7dd22-6436-4c40-a9bf-7c678586a7d4', '5a276268-df10-4cd4-ae5b-b79d4c72157f'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:00:55.867053 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c1842388-444a-4e72-853d-f786d69a26fc tempest-VolumeRetypeWithoutMigrationTest-1800045287 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:00:55.945187 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c1842388-444a-4e72-853d-f786d69a26fc tempest-VolumeRetypeWithoutMigrationTest-1800045287 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:00:55.994668 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-c1842388-444a-4e72-853d-f786d69a26fc tempest-VolumeRetypeWithoutMigrationTest-1800045287 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:00:56.012271 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-c1842388-444a-4e72-853d-f786d69a26fc tempest-VolumeRetypeWithoutMigrationTest-1800045287 None] Deleted volume successfully. Feb 05 21:00:56.037054 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-c1842388-444a-4e72-853d-f786d69a26fc tempest-VolumeRetypeWithoutMigrationTest-1800045287 None] Lock "b'cinder-e76c73ab-1ebc-4a63-b69e-55ef5dfdb40e-delete_volume'" released by "delete_volume" :: held 0.891s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:00:59.825294 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-c01e6cb8-2fb3-4cd8-ad0f-e530062d173b req-9f1266c7-18ce-4d94-a068-32a17d793e5d tempest-TaggedBootDevicesTest-547170310 None] Terminate volume connection completed successfully. Feb 05 21:00:59.826040 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-c01e6cb8-2fb3-4cd8-ad0f-e530062d173b req-9f1266c7-18ce-4d94-a068-32a17d793e5d tempest-TaggedBootDevicesTest-547170310 None] Deleting attachment 833ec444-71ca-4c59-a723-44a07c4bb2c3. {{(pid=122683) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 05 21:00:59.944073 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-c01e6cb8-2fb3-4cd8-ad0f-e530062d173b req-7317a185-be31-4e3e-84fd-9952affcdcd7 tempest-TaggedBootDevicesTest-547170310 None] Terminate volume connection completed successfully. Feb 05 21:00:59.944171 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-c01e6cb8-2fb3-4cd8-ad0f-e530062d173b req-7317a185-be31-4e3e-84fd-9952affcdcd7 tempest-TaggedBootDevicesTest-547170310 None] Deleting attachment cf088e53-489e-4511-82c8-a7f0807e6bb6. {{(pid=122683) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 05 21:01:00.130948 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-c01e6cb8-2fb3-4cd8-ad0f-e530062d173b req-7653b859-7c5e-46d2-a2c5-6cc48413dd6b tempest-TaggedBootDevicesTest-547170310 None] Terminate volume connection completed successfully. Feb 05 21:01:00.131654 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-c01e6cb8-2fb3-4cd8-ad0f-e530062d173b req-7653b859-7c5e-46d2-a2c5-6cc48413dd6b tempest-TaggedBootDevicesTest-547170310 None] Deleting attachment 31f2b19b-8b03-4962-95e6-c044ecdf94d4. {{(pid=122683) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 05 21:01:00.598367 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-18bcb63f-226b-4615-a1be-76a78d087e6c tempest-VolumesBackupsAdminTest-2077144323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:01:00.601674 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-18bcb63f-226b-4615-a1be-76a78d087e6c tempest-VolumesBackupsAdminTest-2077144323 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:01:00.602303 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-18bcb63f-226b-4615-a1be-76a78d087e6c tempest-VolumesBackupsAdminTest-2077144323 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:01:00.622492 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-18bcb63f-226b-4615-a1be-76a78d087e6c tempest-VolumesBackupsAdminTest-2077144323 None] Flow 'volume_create_manager' (37b33685-4378-40bd-ae91-db13a1750744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:01:00.629051 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-18bcb63f-226b-4615-a1be-76a78d087e6c tempest-VolumesBackupsAdminTest-2077144323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28395325-ac90-4027-a742-6c85f364e700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:00.635519 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-18bcb63f-226b-4615-a1be-76a78d087e6c tempest-VolumesBackupsAdminTest-2077144323 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:01:00.652220 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-18bcb63f-226b-4615-a1be-76a78d087e6c tempest-VolumesBackupsAdminTest-2077144323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28395325-ac90-4027-a742-6c85f364e700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-392442358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d2ae291c-dfca-46b6-b441-0f74813e2a5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd53344e89624261811c75c09ecfabb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:01:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:01:01Z,use_quota=True,user_id='a4b7e03fb9fb49f5bd1410ade1eae6e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:00.658451 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-18bcb63f-226b-4615-a1be-76a78d087e6c tempest-VolumesBackupsAdminTest-2077144323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8065675-7d92-4006-890d-cb5756ffd2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:00.662739 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-18bcb63f-226b-4615-a1be-76a78d087e6c tempest-VolumesBackupsAdminTest-2077144323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8065675-7d92-4006-890d-cb5756ffd2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:00.667891 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-18bcb63f-226b-4615-a1be-76a78d087e6c tempest-VolumesBackupsAdminTest-2077144323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77fc5a08-16a0-4c96-8727-39d9962c57bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:00.672776 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-18bcb63f-226b-4615-a1be-76a78d087e6c tempest-VolumesBackupsAdminTest-2077144323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77fc5a08-16a0-4c96-8727-39d9962c57bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2ae291c-dfca-46b6-b441-0f74813e2a5c', 'volume_name': 'volume-d2ae291c-dfca-46b6-b441-0f74813e2a5c', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:00.677764 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-18bcb63f-226b-4615-a1be-76a78d087e6c tempest-VolumesBackupsAdminTest-2077144323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19cbd40e-c1d3-48d6-acc9-4236ab51e40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:00.681775 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-18bcb63f-226b-4615-a1be-76a78d087e6c tempest-VolumesBackupsAdminTest-2077144323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19cbd40e-c1d3-48d6-acc9-4236ab51e40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:00.687115 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-18bcb63f-226b-4615-a1be-76a78d087e6c tempest-VolumesBackupsAdminTest-2077144323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c17c8c-23ee-4826-a676-7a262865b4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:00.688201 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-18bcb63f-226b-4615-a1be-76a78d087e6c tempest-VolumesBackupsAdminTest-2077144323 None] Volume d2ae291c-dfca-46b6-b441-0f74813e2a5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2ae291c-dfca-46b6-b441-0f74813e2a5c', 'volume_size': 1} Feb 05 21:01:00.688591 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-18bcb63f-226b-4615-a1be-76a78d087e6c tempest-VolumesBackupsAdminTest-2077144323 None] creating volume 'volume-d2ae291c-dfca-46b6-b441-0f74813e2a5c' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:01:00.689823 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-18bcb63f-226b-4615-a1be-76a78d087e6c tempest-VolumesBackupsAdminTest-2077144323 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:00.807113 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-18bcb63f-226b-4615-a1be-76a78d087e6c tempest-VolumesBackupsAdminTest-2077144323 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:01:00.807487 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-18bcb63f-226b-4615-a1be-76a78d087e6c tempest-VolumesBackupsAdminTest-2077144323 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:01:00.813389 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-18bcb63f-226b-4615-a1be-76a78d087e6c tempest-VolumesBackupsAdminTest-2077144323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c17c8c-23ee-4826-a676-7a262865b4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2ae291c-dfca-46b6-b441-0f74813e2a5c', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:00.818580 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-18bcb63f-226b-4615-a1be-76a78d087e6c tempest-VolumesBackupsAdminTest-2077144323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15a70379-353a-4fdd-b862-bc3e647fbb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:00.831333 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-18bcb63f-226b-4615-a1be-76a78d087e6c tempest-VolumesBackupsAdminTest-2077144323 None] Volume volume-d2ae291c-dfca-46b6-b441-0f74813e2a5c (d2ae291c-dfca-46b6-b441-0f74813e2a5c): created successfully Feb 05 21:01:00.835253 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-18bcb63f-226b-4615-a1be-76a78d087e6c tempest-VolumesBackupsAdminTest-2077144323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15a70379-353a-4fdd-b862-bc3e647fbb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:00.840784 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-18bcb63f-226b-4615-a1be-76a78d087e6c tempest-VolumesBackupsAdminTest-2077144323 None] Flow 'volume_create_manager' (37b33685-4378-40bd-ae91-db13a1750744) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:01:00.850686 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-18bcb63f-226b-4615-a1be-76a78d087e6c tempest-VolumesBackupsAdminTest-2077144323 None] Created volume successfully. Feb 05 21:01:01.940176 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-74b757c0-8546-4072-bef4-051e39dcff55 tempest-VolumesBackupsAdminTest-2077144323 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-02-05T21:01:01Z,data_timestamp=2022-02-05T21:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-691205693',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=77a65ba8-8f0d-4204-9ebf-a6e085ea5d07,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='fd53344e89624261811c75c09ecfabb2',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='a4b7e03fb9fb49f5bd1410ade1eae6e6',volume_id=d2ae291c-dfca-46b6-b441-0f74813e2a5c) Feb 05 21:01:01.940918 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.backup.rpcapi [None req-74b757c0-8546-4072-bef4-051e39dcff55 tempest-VolumesBackupsAdminTest-2077144323 None] continue_backup in rpcapi backup_id 77a65ba8-8f0d-4204-9ebf-a6e085ea5d07 {{(pid=122683) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Feb 05 21:01:06.513394 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [None req-74b757c0-8546-4072-bef4-051e39dcff55 tempest-VolumesBackupsAdminTest-2077144323 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 21:01:07.804928 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [None req-74b757c0-8546-4072-bef4-051e39dcff55 tempest-VolumesBackupsAdminTest-2077144323 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.291s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 21:01:07.806136 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-74b757c0-8546-4072-bef4-051e39dcff55 tempest-VolumesBackupsAdminTest-2077144323 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d2ae291c-dfca-46b6-b441-0f74813e2a5c', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': 'd2ae291c-dfca-46b6-b441-0f74813e2a5c', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 21:01:07.822608 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-74b757c0-8546-4072-bef4-051e39dcff55 tempest-VolumesBackupsAdminTest-2077144323 None] Initialize volume connection completed successfully. Feb 05 21:01:08.868372 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-4779d9e9-0c56-4413-8c5e-dcc353408763 tempest-TaggedBootDevicesTest-547170310 None] Lock "b'cinder-88be82bc-6eec-4de5-8baa-fb763d3170ad-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:01:08.904879 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-4779d9e9-0c56-4413-8c5e-dcc353408763 tempest-TaggedBootDevicesTest-547170310 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:08.974128 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-4779d9e9-0c56-4413-8c5e-dcc353408763 tempest-TaggedBootDevicesTest-547170310 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:01:08.974717 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-4779d9e9-0c56-4413-8c5e-dcc353408763 tempest-TaggedBootDevicesTest-547170310 None] Volume volume-88be82bc-6eec-4de5-8baa-fb763d3170ad is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:01:08.983601 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-4779d9e9-0c56-4413-8c5e-dcc353408763 tempest-TaggedBootDevicesTest-547170310 None] deleting rbd volume volume-88be82bc-6eec-4de5-8baa-fb763d3170ad {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:01:09.313041 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-4779d9e9-0c56-4413-8c5e-dcc353408763 tempest-TaggedBootDevicesTest-547170310 None] Created reservations ['a87e16be-54a8-495a-9cc3-5b9948676e4b', 'e81dc0be-5342-4f3b-8412-80c80c068f7d', '13d2052f-7b6b-4798-bc9b-7d57a116bda9', '18e4ab85-2660-4e31-b76b-8e4ee92388a4'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:01:09.381681 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-4779d9e9-0c56-4413-8c5e-dcc353408763 tempest-TaggedBootDevicesTest-547170310 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:09.441251 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-4779d9e9-0c56-4413-8c5e-dcc353408763 tempest-TaggedBootDevicesTest-547170310 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:09.527150 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-4779d9e9-0c56-4413-8c5e-dcc353408763 tempest-TaggedBootDevicesTest-547170310 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:01:09.536503 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-4779d9e9-0c56-4413-8c5e-dcc353408763 tempest-TaggedBootDevicesTest-547170310 None] Deleted volume successfully. Feb 05 21:01:09.556154 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-4779d9e9-0c56-4413-8c5e-dcc353408763 tempest-TaggedBootDevicesTest-547170310 None] Lock "b'cinder-88be82bc-6eec-4de5-8baa-fb763d3170ad-delete_volume'" released by "delete_volume" :: held 0.687s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:01:10.125849 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-bab9ec5c-b0a4-48b6-9a3d-91e62e37a965 tempest-TaggedBootDevicesTest-547170310 None] Lock "b'cinder-94129f58-a380-4835-a6c7-7999a4d49a8b-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:01:10.208376 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-bab9ec5c-b0a4-48b6-9a3d-91e62e37a965 tempest-TaggedBootDevicesTest-547170310 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:10.297681 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-bab9ec5c-b0a4-48b6-9a3d-91e62e37a965 tempest-TaggedBootDevicesTest-547170310 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:01:10.298439 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-bab9ec5c-b0a4-48b6-9a3d-91e62e37a965 tempest-TaggedBootDevicesTest-547170310 None] Volume volume-94129f58-a380-4835-a6c7-7999a4d49a8b is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:01:10.313601 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-bab9ec5c-b0a4-48b6-9a3d-91e62e37a965 tempest-TaggedBootDevicesTest-547170310 None] deleting rbd volume volume-94129f58-a380-4835-a6c7-7999a4d49a8b {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:01:10.727942 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-bab9ec5c-b0a4-48b6-9a3d-91e62e37a965 tempest-TaggedBootDevicesTest-547170310 None] Created reservations ['5830f47c-0f1a-4e2c-bbf1-2af7e992a813', 'c0790873-7573-4d3d-af12-8204069c06c4', '5cf044cd-45ad-406f-a0c1-0d132c534d9e', 'da6484b7-fc5b-4a0f-9da0-595aeb4c78fd'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:01:10.783393 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-bab9ec5c-b0a4-48b6-9a3d-91e62e37a965 tempest-TaggedBootDevicesTest-547170310 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:10.861999 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-bab9ec5c-b0a4-48b6-9a3d-91e62e37a965 tempest-TaggedBootDevicesTest-547170310 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:10.925384 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-bab9ec5c-b0a4-48b6-9a3d-91e62e37a965 tempest-TaggedBootDevicesTest-547170310 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:01:10.934433 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-bab9ec5c-b0a4-48b6-9a3d-91e62e37a965 tempest-TaggedBootDevicesTest-547170310 None] Deleted volume successfully. Feb 05 21:01:10.956037 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-bab9ec5c-b0a4-48b6-9a3d-91e62e37a965 tempest-TaggedBootDevicesTest-547170310 None] Lock "b'cinder-94129f58-a380-4835-a6c7-7999a4d49a8b-delete_volume'" released by "delete_volume" :: held 0.830s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:01:11.323291 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-599f25a6-9b98-4b30-add2-e85325b56e90 tempest-TaggedBootDevicesTest-547170310 None] Lock "b'cinder-b7715ffc-afa8-4753-b29c-82554a24d216-delete_volume'" acquired by "delete_volume" :: waited 0.034s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:01:11.370281 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-599f25a6-9b98-4b30-add2-e85325b56e90 tempest-TaggedBootDevicesTest-547170310 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:11.446879 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-599f25a6-9b98-4b30-add2-e85325b56e90 tempest-TaggedBootDevicesTest-547170310 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:01:11.456742 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-599f25a6-9b98-4b30-add2-e85325b56e90 tempest-TaggedBootDevicesTest-547170310 None] deleting rbd volume volume-b7715ffc-afa8-4753-b29c-82554a24d216 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:01:11.880069 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-74b757c0-8546-4072-bef4-051e39dcff55 tempest-VolumesBackupsAdminTest-2077144323 None] Terminate volume connection completed successfully. Feb 05 21:01:11.948153 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-74b757c0-8546-4072-bef4-051e39dcff55 tempest-VolumesBackupsAdminTest-2077144323 None] Remove volume export completed successfully. Feb 05 21:01:11.959610 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-599f25a6-9b98-4b30-add2-e85325b56e90 tempest-TaggedBootDevicesTest-547170310 None] volume is a clone so cleaning references {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 05 21:01:11.997380 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-599f25a6-9b98-4b30-add2-e85325b56e90 tempest-TaggedBootDevicesTest-547170310 None] deleting parent snapshot volume-b7715ffc-afa8-4753-b29c-82554a24d216.clone_snap {{(pid=122683) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 05 21:01:12.754514 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-599f25a6-9b98-4b30-add2-e85325b56e90 tempest-TaggedBootDevicesTest-547170310 None] Created reservations ['6c31e134-a9eb-4e8e-aedf-b6bb3a102e58', '789262e7-26e8-44f4-a229-bb0c380b4c9e', '0506938d-b8a6-4230-a975-e76c093cb742', 'b6f286b5-d4bc-4b1b-b8fe-80f2ce4ec0b3'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:01:12.817944 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-599f25a6-9b98-4b30-add2-e85325b56e90 tempest-TaggedBootDevicesTest-547170310 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:12.869604 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-599f25a6-9b98-4b30-add2-e85325b56e90 tempest-TaggedBootDevicesTest-547170310 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:12.933313 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-599f25a6-9b98-4b30-add2-e85325b56e90 tempest-TaggedBootDevicesTest-547170310 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:01:12.940370 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-599f25a6-9b98-4b30-add2-e85325b56e90 tempest-TaggedBootDevicesTest-547170310 None] Deleted volume successfully. Feb 05 21:01:12.959461 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-599f25a6-9b98-4b30-add2-e85325b56e90 tempest-TaggedBootDevicesTest-547170310 None] Lock "b'cinder-b7715ffc-afa8-4753-b29c-82554a24d216-delete_volume'" released by "delete_volume" :: held 1.636s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:01:13.405772 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-7460895f-9ae5-4f0a-be57-6cef7f822965 tempest-VolumesActionsTest-287547343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:01:13.410997 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-7460895f-9ae5-4f0a-be57-6cef7f822965 tempest-VolumesActionsTest-287547343 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:01:13.411629 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-7460895f-9ae5-4f0a-be57-6cef7f822965 tempest-VolumesActionsTest-287547343 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:01:13.442509 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-7460895f-9ae5-4f0a-be57-6cef7f822965 tempest-VolumesActionsTest-287547343 None] Flow 'volume_create_manager' (ffe9f7c2-d633-4aae-9ff1-335d304df831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:01:13.462960 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-7460895f-9ae5-4f0a-be57-6cef7f822965 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf71828-db1a-43d6-9fba-fe262eb21685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:13.485533 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-7460895f-9ae5-4f0a-be57-6cef7f822965 tempest-VolumesActionsTest-287547343 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:01:13.520486 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-7460895f-9ae5-4f0a-be57-6cef7f822965 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf71828-db1a-43d6-9fba-fe262eb21685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:01:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-576428322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3c6716ad-0857-4482-82ab-f6e657a48849,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe86b33bc9674ec59c8749b675f2eff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:01:13Z,use_quota=True,user_id='e735bee20533455bb3bfcbfb6d664f50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:13.532432 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-7460895f-9ae5-4f0a-be57-6cef7f822965 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ded3d5a-fe0c-431f-b8bf-2b2a8a0160fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:13.553635 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-7460895f-9ae5-4f0a-be57-6cef7f822965 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ded3d5a-fe0c-431f-b8bf-2b2a8a0160fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:13.564517 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-7460895f-9ae5-4f0a-be57-6cef7f822965 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07ed0872-fc10-4b24-a60e-ab41aa482911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:13.574268 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-7460895f-9ae5-4f0a-be57-6cef7f822965 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07ed0872-fc10-4b24-a60e-ab41aa482911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c6716ad-0857-4482-82ab-f6e657a48849', 'volume_name': 'volume-3c6716ad-0857-4482-82ab-f6e657a48849', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:13.591147 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-7460895f-9ae5-4f0a-be57-6cef7f822965 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ac36ce5-5d61-4589-874f-c160024b8a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:13.601047 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-7460895f-9ae5-4f0a-be57-6cef7f822965 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ac36ce5-5d61-4589-874f-c160024b8a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:13.612785 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-7460895f-9ae5-4f0a-be57-6cef7f822965 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbb869b9-647b-4dd6-bb43-01103fce41be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:13.616941 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-7460895f-9ae5-4f0a-be57-6cef7f822965 tempest-VolumesActionsTest-287547343 None] Volume 3c6716ad-0857-4482-82ab-f6e657a48849: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c6716ad-0857-4482-82ab-f6e657a48849', 'volume_size': 1} Feb 05 21:01:13.617366 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-7460895f-9ae5-4f0a-be57-6cef7f822965 tempest-VolumesActionsTest-287547343 None] creating volume 'volume-3c6716ad-0857-4482-82ab-f6e657a48849' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:01:13.619018 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-7460895f-9ae5-4f0a-be57-6cef7f822965 tempest-VolumesActionsTest-287547343 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:13.764470 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-7460895f-9ae5-4f0a-be57-6cef7f822965 tempest-VolumesActionsTest-287547343 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:01:13.765875 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-7460895f-9ae5-4f0a-be57-6cef7f822965 tempest-VolumesActionsTest-287547343 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:01:13.778067 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-7460895f-9ae5-4f0a-be57-6cef7f822965 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbb869b9-647b-4dd6-bb43-01103fce41be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c6716ad-0857-4482-82ab-f6e657a48849', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:13.801398 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-7460895f-9ae5-4f0a-be57-6cef7f822965 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df2acb37-fe85-43d7-a137-125cd0d1b554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:13.818499 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-7460895f-9ae5-4f0a-be57-6cef7f822965 tempest-VolumesActionsTest-287547343 None] Volume volume-3c6716ad-0857-4482-82ab-f6e657a48849 (3c6716ad-0857-4482-82ab-f6e657a48849): created successfully Feb 05 21:01:13.822347 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-7460895f-9ae5-4f0a-be57-6cef7f822965 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df2acb37-fe85-43d7-a137-125cd0d1b554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:13.833995 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-7460895f-9ae5-4f0a-be57-6cef7f822965 tempest-VolumesActionsTest-287547343 None] Flow 'volume_create_manager' (ffe9f7c2-d633-4aae-9ff1-335d304df831) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:01:13.857877 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-7460895f-9ae5-4f0a-be57-6cef7f822965 tempest-VolumesActionsTest-287547343 None] Created volume successfully. Feb 05 21:01:14.470412 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-a3523448-f48e-4c40-a0e6-88bfdabd8844 tempest-VolumesActionsTest-287547343 None] Lock "b'cinder-3c6716ad-0857-4482-82ab-f6e657a48849'" acquired by "attach_volume" :: waited 0.018s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:01:14.542610 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-a3523448-f48e-4c40-a0e6-88bfdabd8844 tempest-VolumesActionsTest-287547343 None] Attaching volume 3c6716ad-0857-4482-82ab-f6e657a48849 to instance 4da8abcb-7629-4edf-a3ac-685f6330c3be at mountpoint /dev/sdb on host None. Feb 05 21:01:14.578257 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-a3523448-f48e-4c40-a0e6-88bfdabd8844 tempest-VolumesActionsTest-287547343 None] Attach volume completed successfully. Feb 05 21:01:14.584895 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-a3523448-f48e-4c40-a0e6-88bfdabd8844 tempest-VolumesActionsTest-287547343 None] Lock "b'cinder-3c6716ad-0857-4482-82ab-f6e657a48849'" released by "attach_volume" :: held 0.115s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:01:14.630738 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfd5b8ac-f5ec-4317-9908-e2f15b115b04 tempest-VolumesBackupsAdminTest-2077144323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:01:14.636940 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-cfd5b8ac-f5ec-4317-9908-e2f15b115b04 tempest-VolumesBackupsAdminTest-2077144323 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:01:14.637546 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-cfd5b8ac-f5ec-4317-9908-e2f15b115b04 tempest-VolumesBackupsAdminTest-2077144323 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:01:14.661237 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-cfd5b8ac-f5ec-4317-9908-e2f15b115b04 tempest-VolumesBackupsAdminTest-2077144323 None] Flow 'volume_create_manager' (ccf08cab-5acc-49bc-9187-9a158ff9c3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:01:14.686880 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-cfd5b8ac-f5ec-4317-9908-e2f15b115b04 tempest-VolumesBackupsAdminTest-2077144323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a959831-f946-4c52-ad8d-76c70b6f67a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:14.714692 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-cfd5b8ac-f5ec-4317-9908-e2f15b115b04 tempest-VolumesBackupsAdminTest-2077144323 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:01:14.736489 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-cfd5b8ac-f5ec-4317-9908-e2f15b115b04 tempest-VolumesBackupsAdminTest-2077144323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a959831-f946-4c52-ad8d-76c70b6f67a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:01:14Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_77a65ba8-8f0d-4204-9ebf-a6e085ea5d07',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8ceb9e09-5239-46e7-95b8-cf7d1ee205fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd53344e89624261811c75c09ecfabb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:01:15Z,use_quota=True,user_id='a4b7e03fb9fb49f5bd1410ade1eae6e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:14.743607 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-cfd5b8ac-f5ec-4317-9908-e2f15b115b04 tempest-VolumesBackupsAdminTest-2077144323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc93d191-14a4-4e92-a32b-e7b712afbda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:14.750492 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-cfd5b8ac-f5ec-4317-9908-e2f15b115b04 tempest-VolumesBackupsAdminTest-2077144323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc93d191-14a4-4e92-a32b-e7b712afbda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:14.757777 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-cfd5b8ac-f5ec-4317-9908-e2f15b115b04 tempest-VolumesBackupsAdminTest-2077144323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbaf28a9-8464-45dd-a710-c518b8b5424e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:14.764063 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-cfd5b8ac-f5ec-4317-9908-e2f15b115b04 tempest-VolumesBackupsAdminTest-2077144323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbaf28a9-8464-45dd-a710-c518b8b5424e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ceb9e09-5239-46e7-95b8-cf7d1ee205fe', 'volume_name': 'volume-8ceb9e09-5239-46e7-95b8-cf7d1ee205fe', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:14.771684 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-cfd5b8ac-f5ec-4317-9908-e2f15b115b04 tempest-VolumesBackupsAdminTest-2077144323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9c7a441-4e1e-41b7-9ee1-64446a3d54a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:14.776845 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-cfd5b8ac-f5ec-4317-9908-e2f15b115b04 tempest-VolumesBackupsAdminTest-2077144323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9c7a441-4e1e-41b7-9ee1-64446a3d54a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:14.783550 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-cfd5b8ac-f5ec-4317-9908-e2f15b115b04 tempest-VolumesBackupsAdminTest-2077144323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3056be9-d3b6-4b5e-b0a3-5284078ad2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:14.785259 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-cfd5b8ac-f5ec-4317-9908-e2f15b115b04 tempest-VolumesBackupsAdminTest-2077144323 None] Volume 8ceb9e09-5239-46e7-95b8-cf7d1ee205fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ceb9e09-5239-46e7-95b8-cf7d1ee205fe', 'volume_size': 1} Feb 05 21:01:14.785877 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-cfd5b8ac-f5ec-4317-9908-e2f15b115b04 tempest-VolumesBackupsAdminTest-2077144323 None] creating volume 'volume-8ceb9e09-5239-46e7-95b8-cf7d1ee205fe' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:01:14.787167 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-cfd5b8ac-f5ec-4317-9908-e2f15b115b04 tempest-VolumesBackupsAdminTest-2077144323 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:14.909668 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-cfd5b8ac-f5ec-4317-9908-e2f15b115b04 tempest-VolumesBackupsAdminTest-2077144323 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:01:14.911178 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-cfd5b8ac-f5ec-4317-9908-e2f15b115b04 tempest-VolumesBackupsAdminTest-2077144323 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:01:14.917369 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-cfd5b8ac-f5ec-4317-9908-e2f15b115b04 tempest-VolumesBackupsAdminTest-2077144323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3056be9-d3b6-4b5e-b0a3-5284078ad2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ceb9e09-5239-46e7-95b8-cf7d1ee205fe', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:14.928887 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-cfd5b8ac-f5ec-4317-9908-e2f15b115b04 tempest-VolumesBackupsAdminTest-2077144323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30c01dfb-ea9e-4de9-a2a8-9fdf943fca94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:14.956450 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-cfd5b8ac-f5ec-4317-9908-e2f15b115b04 tempest-VolumesBackupsAdminTest-2077144323 None] Volume volume-8ceb9e09-5239-46e7-95b8-cf7d1ee205fe (8ceb9e09-5239-46e7-95b8-cf7d1ee205fe): created successfully Feb 05 21:01:14.964801 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-cfd5b8ac-f5ec-4317-9908-e2f15b115b04 tempest-VolumesBackupsAdminTest-2077144323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30c01dfb-ea9e-4de9-a2a8-9fdf943fca94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:14.974970 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-cfd5b8ac-f5ec-4317-9908-e2f15b115b04 tempest-VolumesBackupsAdminTest-2077144323 None] Flow 'volume_create_manager' (ccf08cab-5acc-49bc-9187-9a158ff9c3dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:01:14.987659 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-cfd5b8ac-f5ec-4317-9908-e2f15b115b04 tempest-VolumesBackupsAdminTest-2077144323 None] Created volume successfully. Feb 05 21:01:15.222571 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-9a0b312c-6624-4109-93f2-f91874944c78 tempest-VolumesActionsTest-2085274505 None] Terminate volume connection completed successfully. Feb 05 21:01:15.264379 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-9a0b312c-6624-4109-93f2-f91874944c78 tempest-VolumesActionsTest-2085274505 None] Lock "b'cinder-3c6716ad-0857-4482-82ab-f6e657a48849-detach_volume'" acquired by "detach_volume" :: waited 0.013s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:01:15.280363 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-9a0b312c-6624-4109-93f2-f91874944c78 tempest-VolumesActionsTest-2085274505 None] Detaching volume 3c6716ad-0857-4482-82ab-f6e657a48849 from instance 4da8abcb-7629-4edf-a3ac-685f6330c3be. Feb 05 21:01:15.349704 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-9a0b312c-6624-4109-93f2-f91874944c78 tempest-VolumesActionsTest-2085274505 None] Detach volume completed successfully. Feb 05 21:01:15.356227 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-9a0b312c-6624-4109-93f2-f91874944c78 tempest-VolumesActionsTest-2085274505 None] Lock "b'cinder-3c6716ad-0857-4482-82ab-f6e657a48849-detach_volume'" released by "detach_volume" :: held 0.092s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:01:15.670462 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-3455193d-1e41-417f-ac49-2768af6751ef tempest-VolumesActionsTest-287547343 None] Lock "b'cinder-3c6716ad-0857-4482-82ab-f6e657a48849-detach_volume'" acquired by "detach_volume" :: waited 0.013s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:01:15.672024 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-3455193d-1e41-417f-ac49-2768af6751ef tempest-VolumesActionsTest-287547343 None] Volume detach called, but volume not attached. Feb 05 21:01:15.700964 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-3455193d-1e41-417f-ac49-2768af6751ef tempest-VolumesActionsTest-287547343 None] Lock "b'cinder-3c6716ad-0857-4482-82ab-f6e657a48849-detach_volume'" released by "detach_volume" :: held 0.030s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:01:15.864569 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [None req-cfd5b8ac-f5ec-4317-9908-e2f15b115b04 tempest-VolumesBackupsAdminTest-2077144323 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 21:01:16.805081 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [None req-cfd5b8ac-f5ec-4317-9908-e2f15b115b04 tempest-VolumesBackupsAdminTest-2077144323 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.939s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 21:01:16.806004 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-cfd5b8ac-f5ec-4317-9908-e2f15b115b04 tempest-VolumesBackupsAdminTest-2077144323 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-8ceb9e09-5239-46e7-95b8-cf7d1ee205fe', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': '8ceb9e09-5239-46e7-95b8-cf7d1ee205fe', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 21:01:16.832020 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-cfd5b8ac-f5ec-4317-9908-e2f15b115b04 tempest-VolumesBackupsAdminTest-2077144323 None] Initialize volume connection completed successfully. Feb 05 21:01:17.106593 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc699437-bc00-4297-80f1-2a2d8518760c tempest-AttachVolumeTestJSON-2131176214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:01:17.127605 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-cc699437-bc00-4297-80f1-2a2d8518760c tempest-AttachVolumeTestJSON-2131176214 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:01:17.130294 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-cc699437-bc00-4297-80f1-2a2d8518760c tempest-AttachVolumeTestJSON-2131176214 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:01:17.194712 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-cc699437-bc00-4297-80f1-2a2d8518760c tempest-AttachVolumeTestJSON-2131176214 None] Flow 'volume_create_manager' (553f22e9-640f-4f1b-a7f2-c0ba9594457d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:01:17.205792 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-cc699437-bc00-4297-80f1-2a2d8518760c tempest-AttachVolumeTestJSON-2131176214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a3c258-6255-4b75-af35-a21d2c96a62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:17.245620 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-cc699437-bc00-4297-80f1-2a2d8518760c tempest-AttachVolumeTestJSON-2131176214 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:01:17.266465 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-cc699437-bc00-4297-80f1-2a2d8518760c tempest-AttachVolumeTestJSON-2131176214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a3c258-6255-4b75-af35-a21d2c96a62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:01:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1279688880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e5398d21-0e5f-4120-80c1-9b1f3521b9c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2211e554783435c9b7af885ea20e242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:01:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:01:17Z,use_quota=True,user_id='61514eb86ceb4233a4ee71650879a0e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:17.288538 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-cc699437-bc00-4297-80f1-2a2d8518760c tempest-AttachVolumeTestJSON-2131176214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dd9b1f5-9d7c-4fb7-934a-b383986ab28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:17.305388 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-cc699437-bc00-4297-80f1-2a2d8518760c tempest-AttachVolumeTestJSON-2131176214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dd9b1f5-9d7c-4fb7-934a-b383986ab28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:17.324336 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-cc699437-bc00-4297-80f1-2a2d8518760c tempest-AttachVolumeTestJSON-2131176214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0cfe667-f39f-4071-b994-8fda8e448ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:17.345390 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-cc699437-bc00-4297-80f1-2a2d8518760c tempest-AttachVolumeTestJSON-2131176214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0cfe667-f39f-4071-b994-8fda8e448ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5398d21-0e5f-4120-80c1-9b1f3521b9c4', 'volume_name': 'volume-e5398d21-0e5f-4120-80c1-9b1f3521b9c4', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:17.366774 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-cc699437-bc00-4297-80f1-2a2d8518760c tempest-AttachVolumeTestJSON-2131176214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f424fa05-bc2f-45ea-b0c0-8fe0af4e5eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:17.384773 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-cc699437-bc00-4297-80f1-2a2d8518760c tempest-AttachVolumeTestJSON-2131176214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f424fa05-bc2f-45ea-b0c0-8fe0af4e5eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:17.409772 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-cc699437-bc00-4297-80f1-2a2d8518760c tempest-AttachVolumeTestJSON-2131176214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (537999f6-af97-4665-a1f4-536337c99ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:17.416247 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-cc699437-bc00-4297-80f1-2a2d8518760c tempest-AttachVolumeTestJSON-2131176214 None] Volume e5398d21-0e5f-4120-80c1-9b1f3521b9c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5398d21-0e5f-4120-80c1-9b1f3521b9c4', 'volume_size': 1} Feb 05 21:01:17.416666 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-cc699437-bc00-4297-80f1-2a2d8518760c tempest-AttachVolumeTestJSON-2131176214 None] creating volume 'volume-e5398d21-0e5f-4120-80c1-9b1f3521b9c4' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:01:17.417837 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-cc699437-bc00-4297-80f1-2a2d8518760c tempest-AttachVolumeTestJSON-2131176214 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:17.622611 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-cc699437-bc00-4297-80f1-2a2d8518760c tempest-AttachVolumeTestJSON-2131176214 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:01:17.623490 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-cc699437-bc00-4297-80f1-2a2d8518760c tempest-AttachVolumeTestJSON-2131176214 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:01:17.630817 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-cc699437-bc00-4297-80f1-2a2d8518760c tempest-AttachVolumeTestJSON-2131176214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (537999f6-af97-4665-a1f4-536337c99ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5398d21-0e5f-4120-80c1-9b1f3521b9c4', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:17.639403 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-cc699437-bc00-4297-80f1-2a2d8518760c tempest-AttachVolumeTestJSON-2131176214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277b9db5-03c6-4ed0-b4f8-761f89421d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:17.651225 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-cc699437-bc00-4297-80f1-2a2d8518760c tempest-AttachVolumeTestJSON-2131176214 None] Volume volume-e5398d21-0e5f-4120-80c1-9b1f3521b9c4 (e5398d21-0e5f-4120-80c1-9b1f3521b9c4): created successfully Feb 05 21:01:17.658109 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-cc699437-bc00-4297-80f1-2a2d8518760c tempest-AttachVolumeTestJSON-2131176214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277b9db5-03c6-4ed0-b4f8-761f89421d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:17.670665 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-cc699437-bc00-4297-80f1-2a2d8518760c tempest-AttachVolumeTestJSON-2131176214 None] Flow 'volume_create_manager' (553f22e9-640f-4f1b-a7f2-c0ba9594457d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:01:17.693447 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-cc699437-bc00-4297-80f1-2a2d8518760c tempest-AttachVolumeTestJSON-2131176214 None] Created volume successfully. Feb 05 21:01:18.690306 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-75083dbb-f3cd-4098-8ec8-a188ca8bc182 req-a8f597c3-60c8-4d38-b998-74a35f38032a tempest-AttachVolumeTestJSON-2131176214 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 21:01:18.900605 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-cfd5b8ac-f5ec-4317-9908-e2f15b115b04 tempest-VolumesBackupsAdminTest-2077144323 None] Terminate volume connection completed successfully. Feb 05 21:01:18.952711 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-cfd5b8ac-f5ec-4317-9908-e2f15b115b04 tempest-VolumesBackupsAdminTest-2077144323 None] Remove volume export completed successfully. Feb 05 21:01:19.873277 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-75083dbb-f3cd-4098-8ec8-a188ca8bc182 req-a8f597c3-60c8-4d38-b998-74a35f38032a tempest-AttachVolumeTestJSON-2131176214 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.183s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 21:01:19.874061 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-75083dbb-f3cd-4098-8ec8-a188ca8bc182 req-a8f597c3-60c8-4d38-b998-74a35f38032a tempest-AttachVolumeTestJSON-2131176214 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e5398d21-0e5f-4120-80c1-9b1f3521b9c4', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': 'e5398d21-0e5f-4120-80c1-9b1f3521b9c4', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 21:01:19.924379 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-75083dbb-f3cd-4098-8ec8-a188ca8bc182 req-a8f597c3-60c8-4d38-b998-74a35f38032a tempest-AttachVolumeTestJSON-2131176214 None] Connection info returned from driver {'name': 'volumes/volume-e5398d21-0e5f-4120-80c1-9b1f3521b9c4', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e5398d21-0e5f-4120-80c1-9b1f3521b9c4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '027c3063-3a3f-434f-a54c-6e6fe9c70dbd'} {{(pid=122683) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 05 21:01:20.213693 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-cf05d5b1-c170-4029-956d-229996a70813 tempest-VolumesBackupsAdminTest-2077144323 None] Lock "b'cinder-8ceb9e09-5239-46e7-95b8-cf7d1ee205fe-delete_volume'" acquired by "delete_volume" :: waited 0.039s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:01:20.299505 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-75083dbb-f3cd-4098-8ec8-a188ca8bc182 req-a8f597c3-60c8-4d38-b998-74a35f38032a tempest-AttachVolumeTestJSON-2131176214 None] attachment_update completed successfully. Feb 05 21:01:20.317311 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-cf05d5b1-c170-4029-956d-229996a70813 tempest-VolumesBackupsAdminTest-2077144323 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:20.607908 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-cf05d5b1-c170-4029-956d-229996a70813 tempest-VolumesBackupsAdminTest-2077144323 None] Volume volume-8ceb9e09-5239-46e7-95b8-cf7d1ee205fe is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:01:20.642426 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-cf05d5b1-c170-4029-956d-229996a70813 tempest-VolumesBackupsAdminTest-2077144323 None] deleting rbd volume volume-8ceb9e09-5239-46e7-95b8-cf7d1ee205fe {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:01:20.840714 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-09cc42af-e34d-45f2-8132-c502ca2d7bd4 tempest-VolumesActionsTest-287547343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:01:20.847009 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-09cc42af-e34d-45f2-8132-c502ca2d7bd4 tempest-VolumesActionsTest-287547343 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:01:20.847976 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-09cc42af-e34d-45f2-8132-c502ca2d7bd4 tempest-VolumesActionsTest-287547343 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:01:20.871261 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-09cc42af-e34d-45f2-8132-c502ca2d7bd4 tempest-VolumesActionsTest-287547343 None] Flow 'volume_create_manager' (72a3a822-1148-487c-8c1f-21632e2e9cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:01:20.881015 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-09cc42af-e34d-45f2-8132-c502ca2d7bd4 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ccdeec3-4e09-48f3-959a-202ac535cc29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:20.893016 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-09cc42af-e34d-45f2-8132-c502ca2d7bd4 tempest-VolumesActionsTest-287547343 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:01:20.911920 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-09cc42af-e34d-45f2-8132-c502ca2d7bd4 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ccdeec3-4e09-48f3-959a-202ac535cc29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1949604659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=452ec45e-fab4-4108-8d13-bc3dc87465f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe86b33bc9674ec59c8749b675f2eff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:01:21Z,use_quota=True,user_id='e735bee20533455bb3bfcbfb6d664f50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:20.919818 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-09cc42af-e34d-45f2-8132-c502ca2d7bd4 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e96aade-e3df-46fb-838b-1c40585ec2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:20.934117 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-09cc42af-e34d-45f2-8132-c502ca2d7bd4 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e96aade-e3df-46fb-838b-1c40585ec2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:20.953062 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-09cc42af-e34d-45f2-8132-c502ca2d7bd4 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89efaf78-b646-408d-adc5-bb10a8e574fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:20.957789 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-09cc42af-e34d-45f2-8132-c502ca2d7bd4 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89efaf78-b646-408d-adc5-bb10a8e574fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '452ec45e-fab4-4108-8d13-bc3dc87465f3', 'volume_name': 'volume-452ec45e-fab4-4108-8d13-bc3dc87465f3', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:20.963496 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-09cc42af-e34d-45f2-8132-c502ca2d7bd4 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30537e47-e91a-4d50-8fba-5328fe8ff18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:20.969246 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-09cc42af-e34d-45f2-8132-c502ca2d7bd4 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30537e47-e91a-4d50-8fba-5328fe8ff18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:20.981221 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-09cc42af-e34d-45f2-8132-c502ca2d7bd4 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c82ca844-3d0a-4139-a6bf-771c5e7a2cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:20.983932 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-09cc42af-e34d-45f2-8132-c502ca2d7bd4 tempest-VolumesActionsTest-287547343 None] Volume 452ec45e-fab4-4108-8d13-bc3dc87465f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-452ec45e-fab4-4108-8d13-bc3dc87465f3', 'volume_size': 1} Feb 05 21:01:20.984480 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-09cc42af-e34d-45f2-8132-c502ca2d7bd4 tempest-VolumesActionsTest-287547343 None] creating volume 'volume-452ec45e-fab4-4108-8d13-bc3dc87465f3' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:01:20.985544 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-09cc42af-e34d-45f2-8132-c502ca2d7bd4 tempest-VolumesActionsTest-287547343 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:21.108205 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-cf05d5b1-c170-4029-956d-229996a70813 tempest-VolumesBackupsAdminTest-2077144323 None] Created reservations ['4f36b301-11f0-40b7-afa2-18f384d40e29', 'a4f56309-1e49-4cb6-8a4f-d7df3bab495b', '8e032e59-5e1e-44a3-b83e-7beb12f46875', 'c38f7764-b244-4475-9f19-b8860b5d4855'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:01:21.115764 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-09cc42af-e34d-45f2-8132-c502ca2d7bd4 tempest-VolumesActionsTest-287547343 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:01:21.116152 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-09cc42af-e34d-45f2-8132-c502ca2d7bd4 tempest-VolumesActionsTest-287547343 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:01:21.120243 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-09cc42af-e34d-45f2-8132-c502ca2d7bd4 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c82ca844-3d0a-4139-a6bf-771c5e7a2cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-452ec45e-fab4-4108-8d13-bc3dc87465f3', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:21.127871 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-09cc42af-e34d-45f2-8132-c502ca2d7bd4 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2329ba37-76c6-42fe-aee3-2d9dd8904186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:21.148007 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-09cc42af-e34d-45f2-8132-c502ca2d7bd4 tempest-VolumesActionsTest-287547343 None] Volume volume-452ec45e-fab4-4108-8d13-bc3dc87465f3 (452ec45e-fab4-4108-8d13-bc3dc87465f3): created successfully Feb 05 21:01:21.151662 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-09cc42af-e34d-45f2-8132-c502ca2d7bd4 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2329ba37-76c6-42fe-aee3-2d9dd8904186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:21.157996 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-09cc42af-e34d-45f2-8132-c502ca2d7bd4 tempest-VolumesActionsTest-287547343 None] Flow 'volume_create_manager' (72a3a822-1148-487c-8c1f-21632e2e9cf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:01:21.172788 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-09cc42af-e34d-45f2-8132-c502ca2d7bd4 tempest-VolumesActionsTest-287547343 None] Created volume successfully. Feb 05 21:01:21.203055 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-cf05d5b1-c170-4029-956d-229996a70813 tempest-VolumesBackupsAdminTest-2077144323 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:21.244158 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-cf05d5b1-c170-4029-956d-229996a70813 tempest-VolumesBackupsAdminTest-2077144323 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:21.314101 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-cf05d5b1-c170-4029-956d-229996a70813 tempest-VolumesBackupsAdminTest-2077144323 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:01:21.318686 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-cf05d5b1-c170-4029-956d-229996a70813 tempest-VolumesBackupsAdminTest-2077144323 None] Deleted volume successfully. Feb 05 21:01:21.335405 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-cf05d5b1-c170-4029-956d-229996a70813 tempest-VolumesBackupsAdminTest-2077144323 None] Lock "b'cinder-8ceb9e09-5239-46e7-95b8-cf7d1ee205fe-delete_volume'" released by "delete_volume" :: held 1.122s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:01:22.165074 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-a58f4031-28ae-4b24-9af1-b5f10fce58d0 tempest-VolumesActionsTest-2085274505 None] Lock "b'cinder-452ec45e-fab4-4108-8d13-bc3dc87465f3-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:01:22.197884 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-a58f4031-28ae-4b24-9af1-b5f10fce58d0 tempest-VolumesActionsTest-2085274505 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:22.243190 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-a58f4031-28ae-4b24-9af1-b5f10fce58d0 tempest-VolumesActionsTest-2085274505 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:01:22.243731 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-a58f4031-28ae-4b24-9af1-b5f10fce58d0 tempest-VolumesActionsTest-2085274505 None] Volume volume-452ec45e-fab4-4108-8d13-bc3dc87465f3 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:01:22.250971 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-a58f4031-28ae-4b24-9af1-b5f10fce58d0 tempest-VolumesActionsTest-2085274505 None] deleting rbd volume volume-452ec45e-fab4-4108-8d13-bc3dc87465f3 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:01:22.523301 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-a58f4031-28ae-4b24-9af1-b5f10fce58d0 tempest-VolumesActionsTest-2085274505 None] Created reservations ['9da0c738-35cf-4531-b78b-83f5217a517d', '23cc8ec0-7554-4da8-b038-5e3b40847300', 'dcfdf2a2-4452-48fd-873f-fd4993c7a31e', 'ad444d03-8541-43a6-90ec-3ff181ca5114'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:01:22.578320 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-a58f4031-28ae-4b24-9af1-b5f10fce58d0 tempest-VolumesActionsTest-2085274505 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:22.663078 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-a58f4031-28ae-4b24-9af1-b5f10fce58d0 tempest-VolumesActionsTest-2085274505 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:22.748193 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-a58f4031-28ae-4b24-9af1-b5f10fce58d0 tempest-VolumesActionsTest-2085274505 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:01:22.762578 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-a58f4031-28ae-4b24-9af1-b5f10fce58d0 tempest-VolumesActionsTest-2085274505 None] Deleted volume successfully. Feb 05 21:01:22.789839 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-a58f4031-28ae-4b24-9af1-b5f10fce58d0 tempest-VolumesActionsTest-2085274505 None] Lock "b'cinder-452ec45e-fab4-4108-8d13-bc3dc87465f3-delete_volume'" released by "delete_volume" :: held 0.625s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:01:23.036635 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-88d34792-51c7-4be4-a6ca-2bd025f1b4b3 tempest-VolumesBackupsAdminTest-2077144323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:01:23.040563 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-88d34792-51c7-4be4-a6ca-2bd025f1b4b3 tempest-VolumesBackupsAdminTest-2077144323 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:01:23.040945 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-88d34792-51c7-4be4-a6ca-2bd025f1b4b3 tempest-VolumesBackupsAdminTest-2077144323 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:01:23.062491 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-88d34792-51c7-4be4-a6ca-2bd025f1b4b3 tempest-VolumesBackupsAdminTest-2077144323 None] Flow 'volume_create_manager' (0f4a9a06-1eb8-4017-b6f9-07293759efbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:01:23.072211 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-88d34792-51c7-4be4-a6ca-2bd025f1b4b3 tempest-VolumesBackupsAdminTest-2077144323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77ab8ac8-a1c8-4717-8c25-9536d5adce78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:23.084757 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-88d34792-51c7-4be4-a6ca-2bd025f1b4b3 tempest-VolumesBackupsAdminTest-2077144323 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:01:23.131245 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-88d34792-51c7-4be4-a6ca-2bd025f1b4b3 tempest-VolumesBackupsAdminTest-2077144323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77ab8ac8-a1c8-4717-8c25-9536d5adce78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-1169503751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c702e501-f624-45c5-8ff4-1f251b54fbee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd53344e89624261811c75c09ecfabb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:01:23Z,use_quota=True,user_id='a4b7e03fb9fb49f5bd1410ade1eae6e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:23.149360 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-88d34792-51c7-4be4-a6ca-2bd025f1b4b3 tempest-VolumesBackupsAdminTest-2077144323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7129a5c9-a0d2-40ff-8d83-7537f6ddefa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:23.166430 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-88d34792-51c7-4be4-a6ca-2bd025f1b4b3 tempest-VolumesBackupsAdminTest-2077144323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7129a5c9-a0d2-40ff-8d83-7537f6ddefa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:23.185465 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-88d34792-51c7-4be4-a6ca-2bd025f1b4b3 tempest-VolumesBackupsAdminTest-2077144323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6879c840-d816-4f18-9a6d-b2849f8b94d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:23.190471 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-88d34792-51c7-4be4-a6ca-2bd025f1b4b3 tempest-VolumesBackupsAdminTest-2077144323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6879c840-d816-4f18-9a6d-b2849f8b94d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c702e501-f624-45c5-8ff4-1f251b54fbee', 'volume_name': 'volume-c702e501-f624-45c5-8ff4-1f251b54fbee', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:23.198132 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-88d34792-51c7-4be4-a6ca-2bd025f1b4b3 tempest-VolumesBackupsAdminTest-2077144323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5877af5-949c-4fda-87f9-020865a32881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:23.211076 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-88d34792-51c7-4be4-a6ca-2bd025f1b4b3 tempest-VolumesBackupsAdminTest-2077144323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5877af5-949c-4fda-87f9-020865a32881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:23.251936 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-88d34792-51c7-4be4-a6ca-2bd025f1b4b3 tempest-VolumesBackupsAdminTest-2077144323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4947bf89-5add-4ee9-9192-478d63bfacb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:23.258438 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-88d34792-51c7-4be4-a6ca-2bd025f1b4b3 tempest-VolumesBackupsAdminTest-2077144323 None] Volume c702e501-f624-45c5-8ff4-1f251b54fbee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c702e501-f624-45c5-8ff4-1f251b54fbee', 'volume_size': 1} Feb 05 21:01:23.260320 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-88d34792-51c7-4be4-a6ca-2bd025f1b4b3 tempest-VolumesBackupsAdminTest-2077144323 None] creating volume 'volume-c702e501-f624-45c5-8ff4-1f251b54fbee' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:01:23.263486 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-88d34792-51c7-4be4-a6ca-2bd025f1b4b3 tempest-VolumesBackupsAdminTest-2077144323 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:23.452120 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-88d34792-51c7-4be4-a6ca-2bd025f1b4b3 tempest-VolumesBackupsAdminTest-2077144323 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:01:23.452616 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-88d34792-51c7-4be4-a6ca-2bd025f1b4b3 tempest-VolumesBackupsAdminTest-2077144323 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:01:23.458529 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-88d34792-51c7-4be4-a6ca-2bd025f1b4b3 tempest-VolumesBackupsAdminTest-2077144323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4947bf89-5add-4ee9-9192-478d63bfacb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c702e501-f624-45c5-8ff4-1f251b54fbee', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:23.464966 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-88d34792-51c7-4be4-a6ca-2bd025f1b4b3 tempest-VolumesBackupsAdminTest-2077144323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47b2667e-c2ff-411f-ac70-5ce17ebe89aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:23.487634 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-88d34792-51c7-4be4-a6ca-2bd025f1b4b3 tempest-VolumesBackupsAdminTest-2077144323 None] Volume volume-c702e501-f624-45c5-8ff4-1f251b54fbee (c702e501-f624-45c5-8ff4-1f251b54fbee): created successfully Feb 05 21:01:23.502084 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-88d34792-51c7-4be4-a6ca-2bd025f1b4b3 tempest-VolumesBackupsAdminTest-2077144323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47b2667e-c2ff-411f-ac70-5ce17ebe89aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:23.516731 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-88d34792-51c7-4be4-a6ca-2bd025f1b4b3 tempest-VolumesBackupsAdminTest-2077144323 None] Flow 'volume_create_manager' (0f4a9a06-1eb8-4017-b6f9-07293759efbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:01:23.529779 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-88d34792-51c7-4be4-a6ca-2bd025f1b4b3 tempest-VolumesBackupsAdminTest-2077144323 None] Created volume successfully. Feb 05 21:01:23.817816 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bf9106b-13b1-4d67-b13d-8670ff606b16 tempest-VolumesActionsTest-287547343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:01:23.822068 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-2bf9106b-13b1-4d67-b13d-8670ff606b16 tempest-VolumesActionsTest-287547343 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:01:23.822682 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-2bf9106b-13b1-4d67-b13d-8670ff606b16 tempest-VolumesActionsTest-287547343 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:01:23.851301 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-2bf9106b-13b1-4d67-b13d-8670ff606b16 tempest-VolumesActionsTest-287547343 None] Flow 'volume_create_manager' (54f1858d-3ad7-4475-afa4-0e0ff40ee5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:01:23.860407 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-2bf9106b-13b1-4d67-b13d-8670ff606b16 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b75f4fa-aca0-482d-9fd8-3566766b876a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:23.868214 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-2bf9106b-13b1-4d67-b13d-8670ff606b16 tempest-VolumesActionsTest-287547343 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:01:23.902869 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-2bf9106b-13b1-4d67-b13d-8670ff606b16 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b75f4fa-aca0-482d-9fd8-3566766b876a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1422751294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=373ffada-251d-44d2-8b6a-99308cbe88d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe86b33bc9674ec59c8749b675f2eff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:01:24Z,use_quota=True,user_id='e735bee20533455bb3bfcbfb6d664f50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:23.916459 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-2bf9106b-13b1-4d67-b13d-8670ff606b16 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (512e08d6-c92d-4b36-a39c-d396cf9e06b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:23.934966 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-2bf9106b-13b1-4d67-b13d-8670ff606b16 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (512e08d6-c92d-4b36-a39c-d396cf9e06b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:23.947892 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-2bf9106b-13b1-4d67-b13d-8670ff606b16 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca0b1194-6fcd-4715-91de-5102c35a4eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:23.963963 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-2bf9106b-13b1-4d67-b13d-8670ff606b16 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca0b1194-6fcd-4715-91de-5102c35a4eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '373ffada-251d-44d2-8b6a-99308cbe88d5', 'volume_name': 'volume-373ffada-251d-44d2-8b6a-99308cbe88d5', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:23.970833 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-2bf9106b-13b1-4d67-b13d-8670ff606b16 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f682f7fe-a6be-474d-aec7-385b08acb9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:23.977416 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-2bf9106b-13b1-4d67-b13d-8670ff606b16 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f682f7fe-a6be-474d-aec7-385b08acb9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:23.985489 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-2bf9106b-13b1-4d67-b13d-8670ff606b16 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5c3b1d4-46be-4fa0-b82f-10dbd4d8480d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:23.987119 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-2bf9106b-13b1-4d67-b13d-8670ff606b16 tempest-VolumesActionsTest-287547343 None] Volume 373ffada-251d-44d2-8b6a-99308cbe88d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-373ffada-251d-44d2-8b6a-99308cbe88d5', 'volume_size': 1} Feb 05 21:01:23.987877 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-2bf9106b-13b1-4d67-b13d-8670ff606b16 tempest-VolumesActionsTest-287547343 None] creating volume 'volume-373ffada-251d-44d2-8b6a-99308cbe88d5' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:01:23.989092 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-2bf9106b-13b1-4d67-b13d-8670ff606b16 tempest-VolumesActionsTest-287547343 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:24.130819 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-2bf9106b-13b1-4d67-b13d-8670ff606b16 tempest-VolumesActionsTest-287547343 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:01:24.131221 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-2bf9106b-13b1-4d67-b13d-8670ff606b16 tempest-VolumesActionsTest-287547343 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:01:24.135758 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-2bf9106b-13b1-4d67-b13d-8670ff606b16 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5c3b1d4-46be-4fa0-b82f-10dbd4d8480d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-373ffada-251d-44d2-8b6a-99308cbe88d5', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:24.141724 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-2bf9106b-13b1-4d67-b13d-8670ff606b16 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc2af6b4-18da-4fff-81c3-58c9cfc256ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:24.155812 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-2bf9106b-13b1-4d67-b13d-8670ff606b16 tempest-VolumesActionsTest-287547343 None] Volume volume-373ffada-251d-44d2-8b6a-99308cbe88d5 (373ffada-251d-44d2-8b6a-99308cbe88d5): created successfully Feb 05 21:01:24.161478 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-2bf9106b-13b1-4d67-b13d-8670ff606b16 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc2af6b4-18da-4fff-81c3-58c9cfc256ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:24.175711 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-2bf9106b-13b1-4d67-b13d-8670ff606b16 tempest-VolumesActionsTest-287547343 None] Flow 'volume_create_manager' (54f1858d-3ad7-4475-afa4-0e0ff40ee5d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:01:24.192409 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-2bf9106b-13b1-4d67-b13d-8670ff606b16 tempest-VolumesActionsTest-287547343 None] Created volume successfully. Feb 05 21:01:24.317517 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-4bbbbcb3-b1f5-43f6-8c1c-2205b0fae76d tempest-VolumesBackupsAdminTest-2077144323 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-02-05T21:01:24Z,data_timestamp=2022-02-05T21:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-854308935',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=5f2bf439-ecb4-4dad-9c8b-d27d54648d13,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='fd53344e89624261811c75c09ecfabb2',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='a4b7e03fb9fb49f5bd1410ade1eae6e6',volume_id=c702e501-f624-45c5-8ff4-1f251b54fbee) Feb 05 21:01:24.318285 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.backup.rpcapi [None req-4bbbbcb3-b1f5-43f6-8c1c-2205b0fae76d tempest-VolumesBackupsAdminTest-2077144323 None] continue_backup in rpcapi backup_id 5f2bf439-ecb4-4dad-9c8b-d27d54648d13 {{(pid=122683) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Feb 05 21:01:24.521687 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [None req-4bbbbcb3-b1f5-43f6-8c1c-2205b0fae76d tempest-VolumesBackupsAdminTest-2077144323 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 21:01:25.183119 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-3b86d80e-0580-4710-a15b-ca0403aab29e tempest-VolumesActionsTest-2085274505 None] Lock "b'cinder-373ffada-251d-44d2-8b6a-99308cbe88d5-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:01:25.249787 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3b86d80e-0580-4710-a15b-ca0403aab29e tempest-VolumesActionsTest-2085274505 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:25.397281 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3b86d80e-0580-4710-a15b-ca0403aab29e tempest-VolumesActionsTest-2085274505 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:01:25.398064 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3b86d80e-0580-4710-a15b-ca0403aab29e tempest-VolumesActionsTest-2085274505 None] Volume volume-373ffada-251d-44d2-8b6a-99308cbe88d5 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:01:25.408478 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3b86d80e-0580-4710-a15b-ca0403aab29e tempest-VolumesActionsTest-2085274505 None] deleting rbd volume volume-373ffada-251d-44d2-8b6a-99308cbe88d5 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:01:25.907197 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [None req-4bbbbcb3-b1f5-43f6-8c1c-2205b0fae76d tempest-VolumesBackupsAdminTest-2077144323 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.385s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 21:01:25.909194 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-4bbbbcb3-b1f5-43f6-8c1c-2205b0fae76d tempest-VolumesBackupsAdminTest-2077144323 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c702e501-f624-45c5-8ff4-1f251b54fbee', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': 'c702e501-f624-45c5-8ff4-1f251b54fbee', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 21:01:25.942426 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-4bbbbcb3-b1f5-43f6-8c1c-2205b0fae76d tempest-VolumesBackupsAdminTest-2077144323 None] Initialize volume connection completed successfully. Feb 05 21:01:25.956508 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-3b86d80e-0580-4710-a15b-ca0403aab29e tempest-VolumesActionsTest-2085274505 None] Created reservations ['48920c6b-85ab-47e5-b375-a241d7abfb00', '90c2447a-f782-48fb-9c06-7cbadc0f7753', 'ffbf00ab-8d26-4bae-86af-7a653b05baff', '3f723370-afe8-4d24-879d-80bb8f41e280'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:01:26.061261 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3b86d80e-0580-4710-a15b-ca0403aab29e tempest-VolumesActionsTest-2085274505 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:26.132484 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3b86d80e-0580-4710-a15b-ca0403aab29e tempest-VolumesActionsTest-2085274505 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:26.203614 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-3b86d80e-0580-4710-a15b-ca0403aab29e tempest-VolumesActionsTest-2085274505 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:01:26.208939 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-3b86d80e-0580-4710-a15b-ca0403aab29e tempest-VolumesActionsTest-2085274505 None] Deleted volume successfully. Feb 05 21:01:26.227041 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-3b86d80e-0580-4710-a15b-ca0403aab29e tempest-VolumesActionsTest-2085274505 None] Lock "b'cinder-373ffada-251d-44d2-8b6a-99308cbe88d5-delete_volume'" released by "delete_volume" :: held 1.047s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:01:26.766670 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-71a7db33-9b19-45fe-b118-f0474575c518 tempest-VolumesActionsTest-287547343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:01:26.776739 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-71a7db33-9b19-45fe-b118-f0474575c518 tempest-VolumesActionsTest-287547343 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:01:26.777211 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-71a7db33-9b19-45fe-b118-f0474575c518 tempest-VolumesActionsTest-287547343 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:01:26.811027 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-71a7db33-9b19-45fe-b118-f0474575c518 tempest-VolumesActionsTest-287547343 None] Flow 'volume_create_manager' (84f0ccc7-f983-4727-8feb-dceeea7551e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:01:26.821544 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-71a7db33-9b19-45fe-b118-f0474575c518 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a6c050b-d652-477d-abf3-ccb6e47e8936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:26.835860 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-82809f9d-effc-4507-adfc-750a7f628567 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:01:26.880750 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-71a7db33-9b19-45fe-b118-f0474575c518 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a6c050b-d652-477d-abf3-ccb6e47e8936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-704080646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=af8c7e22-d3fa-43ff-80f5-e3469e24cefc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe86b33bc9674ec59c8749b675f2eff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:01:27Z,use_quota=True,user_id='e735bee20533455bb3bfcbfb6d664f50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:26.889200 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-71a7db33-9b19-45fe-b118-f0474575c518 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1802e17e-c313-425a-8835-51deeb3b885e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:26.908171 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-71a7db33-9b19-45fe-b118-f0474575c518 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1802e17e-c313-425a-8835-51deeb3b885e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:26.914744 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-71a7db33-9b19-45fe-b118-f0474575c518 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83cb3bbc-9ab2-45cb-8238-a2b1395c1560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:26.930628 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-71a7db33-9b19-45fe-b118-f0474575c518 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83cb3bbc-9ab2-45cb-8238-a2b1395c1560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af8c7e22-d3fa-43ff-80f5-e3469e24cefc', 'volume_name': 'volume-af8c7e22-d3fa-43ff-80f5-e3469e24cefc', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:26.938803 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-71a7db33-9b19-45fe-b118-f0474575c518 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb80fd1e-cf32-44c0-9889-64e3d6495038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:26.945169 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-71a7db33-9b19-45fe-b118-f0474575c518 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb80fd1e-cf32-44c0-9889-64e3d6495038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:26.951559 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-71a7db33-9b19-45fe-b118-f0474575c518 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5190a112-b6df-4488-b535-5e1517f10f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:26.953578 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-71a7db33-9b19-45fe-b118-f0474575c518 tempest-VolumesActionsTest-287547343 None] Volume af8c7e22-d3fa-43ff-80f5-e3469e24cefc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af8c7e22-d3fa-43ff-80f5-e3469e24cefc', 'volume_size': 1} Feb 05 21:01:26.954157 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-71a7db33-9b19-45fe-b118-f0474575c518 tempest-VolumesActionsTest-287547343 None] creating volume 'volume-af8c7e22-d3fa-43ff-80f5-e3469e24cefc' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:01:26.964161 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-71a7db33-9b19-45fe-b118-f0474575c518 tempest-VolumesActionsTest-287547343 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:27.146646 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-71a7db33-9b19-45fe-b118-f0474575c518 tempest-VolumesActionsTest-287547343 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:01:27.147020 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-71a7db33-9b19-45fe-b118-f0474575c518 tempest-VolumesActionsTest-287547343 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:01:27.151938 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-71a7db33-9b19-45fe-b118-f0474575c518 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5190a112-b6df-4488-b535-5e1517f10f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af8c7e22-d3fa-43ff-80f5-e3469e24cefc', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:27.171825 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-71a7db33-9b19-45fe-b118-f0474575c518 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bf31c4e-618b-436e-a8f4-63b1b826d261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:27.192075 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-71a7db33-9b19-45fe-b118-f0474575c518 tempest-VolumesActionsTest-287547343 None] Volume volume-af8c7e22-d3fa-43ff-80f5-e3469e24cefc (af8c7e22-d3fa-43ff-80f5-e3469e24cefc): created successfully Feb 05 21:01:27.197012 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-71a7db33-9b19-45fe-b118-f0474575c518 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bf31c4e-618b-436e-a8f4-63b1b826d261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:27.203765 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-71a7db33-9b19-45fe-b118-f0474575c518 tempest-VolumesActionsTest-287547343 None] Flow 'volume_create_manager' (84f0ccc7-f983-4727-8feb-dceeea7551e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:01:27.218764 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-71a7db33-9b19-45fe-b118-f0474575c518 tempest-VolumesActionsTest-287547343 None] Created volume successfully. Feb 05 21:01:27.789128 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-4bbbbcb3-b1f5-43f6-8c1c-2205b0fae76d tempest-VolumesBackupsAdminTest-2077144323 None] Terminate volume connection completed successfully. Feb 05 21:01:27.814463 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-4bbbbcb3-b1f5-43f6-8c1c-2205b0fae76d tempest-VolumesBackupsAdminTest-2077144323 None] Remove volume export completed successfully. Feb 05 21:01:27.973399 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-ff9c2e3d-1210-4c41-8e79-0636ef0c8136 tempest-VolumesActionsTest-2085274505 None] Lock "b'cinder-af8c7e22-d3fa-43ff-80f5-e3469e24cefc-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:01:28.018175 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ff9c2e3d-1210-4c41-8e79-0636ef0c8136 tempest-VolumesActionsTest-2085274505 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:28.088212 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ff9c2e3d-1210-4c41-8e79-0636ef0c8136 tempest-VolumesActionsTest-2085274505 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:01:28.088661 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ff9c2e3d-1210-4c41-8e79-0636ef0c8136 tempest-VolumesActionsTest-2085274505 None] Volume volume-af8c7e22-d3fa-43ff-80f5-e3469e24cefc is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:01:28.101352 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ff9c2e3d-1210-4c41-8e79-0636ef0c8136 tempest-VolumesActionsTest-2085274505 None] deleting rbd volume volume-af8c7e22-d3fa-43ff-80f5-e3469e24cefc {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:01:28.532317 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-ff9c2e3d-1210-4c41-8e79-0636ef0c8136 tempest-VolumesActionsTest-2085274505 None] Created reservations ['7b5706df-b535-423b-a7e9-de7d6face705', '85d5fe3c-3a2c-4ac1-b798-3d1174a84380', '4b681611-c361-4db5-ad2d-ecf616182ed4', '4db0dcbc-adc5-4e13-b534-b82ffc3c9f69'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:01:28.618666 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ff9c2e3d-1210-4c41-8e79-0636ef0c8136 tempest-VolumesActionsTest-2085274505 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:28.681044 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ff9c2e3d-1210-4c41-8e79-0636ef0c8136 tempest-VolumesActionsTest-2085274505 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:28.762264 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-ff9c2e3d-1210-4c41-8e79-0636ef0c8136 tempest-VolumesActionsTest-2085274505 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:01:28.776000 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-ff9c2e3d-1210-4c41-8e79-0636ef0c8136 tempest-VolumesActionsTest-2085274505 None] Deleted volume successfully. Feb 05 21:01:28.790606 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-ff9c2e3d-1210-4c41-8e79-0636ef0c8136 tempest-VolumesActionsTest-2085274505 None] Lock "b'cinder-af8c7e22-d3fa-43ff-80f5-e3469e24cefc-delete_volume'" released by "delete_volume" :: held 0.817s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:01:29.847778 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b4330c6-0793-4961-ae97-da35e12efe08 tempest-VolumesActionsTest-287547343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:01:29.862988 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-1b4330c6-0793-4961-ae97-da35e12efe08 tempest-VolumesActionsTest-287547343 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:01:29.864298 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-1b4330c6-0793-4961-ae97-da35e12efe08 tempest-VolumesActionsTest-287547343 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:01:29.988804 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1b4330c6-0793-4961-ae97-da35e12efe08 tempest-VolumesActionsTest-287547343 None] Flow 'volume_create_manager' (28651123-6eb0-43f4-92dd-9ef381818346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:01:30.016605 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1b4330c6-0793-4961-ae97-da35e12efe08 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0e4734b-eeb6-4fa7-8274-79780eb57d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:30.040530 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-1b4330c6-0793-4961-ae97-da35e12efe08 tempest-VolumesActionsTest-287547343 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:01:30.068890 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1b4330c6-0793-4961-ae97-da35e12efe08 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0e4734b-eeb6-4fa7-8274-79780eb57d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1344603214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=fcd364e2-57d3-409f-97d2-6669c7c2d744,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe86b33bc9674ec59c8749b675f2eff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:01:30Z,use_quota=True,user_id='e735bee20533455bb3bfcbfb6d664f50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:30.088915 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1b4330c6-0793-4961-ae97-da35e12efe08 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6a76427-db89-431b-af0f-ca28fac5e887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:30.093663 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1b4330c6-0793-4961-ae97-da35e12efe08 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6a76427-db89-431b-af0f-ca28fac5e887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:30.104612 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1b4330c6-0793-4961-ae97-da35e12efe08 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c622d9a0-ff07-4035-86af-cd60b5ba79f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:30.110638 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1b4330c6-0793-4961-ae97-da35e12efe08 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c622d9a0-ff07-4035-86af-cd60b5ba79f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcd364e2-57d3-409f-97d2-6669c7c2d744', 'volume_name': 'volume-fcd364e2-57d3-409f-97d2-6669c7c2d744', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:30.116562 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1b4330c6-0793-4961-ae97-da35e12efe08 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b1148b0-1efb-41a4-8894-25e00e300e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:30.123557 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1b4330c6-0793-4961-ae97-da35e12efe08 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b1148b0-1efb-41a4-8894-25e00e300e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:30.129237 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1b4330c6-0793-4961-ae97-da35e12efe08 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd2d2d92-9f45-4989-b051-0055bca3ad22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:30.130609 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-1b4330c6-0793-4961-ae97-da35e12efe08 tempest-VolumesActionsTest-287547343 None] Volume fcd364e2-57d3-409f-97d2-6669c7c2d744: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcd364e2-57d3-409f-97d2-6669c7c2d744', 'volume_size': 1} Feb 05 21:01:30.131196 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1b4330c6-0793-4961-ae97-da35e12efe08 tempest-VolumesActionsTest-287547343 None] creating volume 'volume-fcd364e2-57d3-409f-97d2-6669c7c2d744' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:01:30.132366 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1b4330c6-0793-4961-ae97-da35e12efe08 tempest-VolumesActionsTest-287547343 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:30.289153 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1b4330c6-0793-4961-ae97-da35e12efe08 tempest-VolumesActionsTest-287547343 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:01:30.289782 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1b4330c6-0793-4961-ae97-da35e12efe08 tempest-VolumesActionsTest-287547343 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:01:30.294513 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1b4330c6-0793-4961-ae97-da35e12efe08 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd2d2d92-9f45-4989-b051-0055bca3ad22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcd364e2-57d3-409f-97d2-6669c7c2d744', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:30.311127 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1b4330c6-0793-4961-ae97-da35e12efe08 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77c0e067-6dfc-46fd-b823-52a2cdc05ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:30.329758 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-1b4330c6-0793-4961-ae97-da35e12efe08 tempest-VolumesActionsTest-287547343 None] Volume volume-fcd364e2-57d3-409f-97d2-6669c7c2d744 (fcd364e2-57d3-409f-97d2-6669c7c2d744): created successfully Feb 05 21:01:30.333988 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1b4330c6-0793-4961-ae97-da35e12efe08 tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77c0e067-6dfc-46fd-b823-52a2cdc05ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:30.352656 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1b4330c6-0793-4961-ae97-da35e12efe08 tempest-VolumesActionsTest-287547343 None] Flow 'volume_create_manager' (28651123-6eb0-43f4-92dd-9ef381818346) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:01:30.363888 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-1b4330c6-0793-4961-ae97-da35e12efe08 tempest-VolumesActionsTest-287547343 None] Created volume successfully. Feb 05 21:01:31.314124 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-c7a585b7-e2cd-4abb-be83-5a16d7c8e033 tempest-VolumesActionsTest-2085274505 None] Lock "b'cinder-fcd364e2-57d3-409f-97d2-6669c7c2d744-delete_volume'" acquired by "delete_volume" :: waited 0.029s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:01:31.421866 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c7a585b7-e2cd-4abb-be83-5a16d7c8e033 tempest-VolumesActionsTest-2085274505 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:31.530698 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c7a585b7-e2cd-4abb-be83-5a16d7c8e033 tempest-VolumesActionsTest-2085274505 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:01:31.531299 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c7a585b7-e2cd-4abb-be83-5a16d7c8e033 tempest-VolumesActionsTest-2085274505 None] Volume volume-fcd364e2-57d3-409f-97d2-6669c7c2d744 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:01:31.546509 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c7a585b7-e2cd-4abb-be83-5a16d7c8e033 tempest-VolumesActionsTest-2085274505 None] deleting rbd volume volume-fcd364e2-57d3-409f-97d2-6669c7c2d744 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:01:32.131751 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-c7a585b7-e2cd-4abb-be83-5a16d7c8e033 tempest-VolumesActionsTest-2085274505 None] Created reservations ['a0ed70ac-c887-4643-924a-0be82fa21721', '054b9974-dcd5-490a-911d-5e5c7a18868b', '9eda1e0f-cdfd-426d-98bb-9b20d9c2f555', '7cea9355-0990-4534-b855-350a5b4663f1'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:01:32.194266 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-a491c254-3052-4bf9-8f28-1b4bd07848ed tempest-VolumesBackupsAdminTest-2077144323 None] Lock "b'cinder-c702e501-f624-45c5-8ff4-1f251b54fbee-delete_volume'" acquired by "delete_volume" :: waited 0.067s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:01:32.392327 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c7a585b7-e2cd-4abb-be83-5a16d7c8e033 tempest-VolumesActionsTest-2085274505 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:32.487847 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c7a585b7-e2cd-4abb-be83-5a16d7c8e033 tempest-VolumesActionsTest-2085274505 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:32.576691 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-c7a585b7-e2cd-4abb-be83-5a16d7c8e033 tempest-VolumesActionsTest-2085274505 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:01:32.586763 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-c7a585b7-e2cd-4abb-be83-5a16d7c8e033 tempest-VolumesActionsTest-2085274505 None] Deleted volume successfully. Feb 05 21:01:32.644147 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-c7a585b7-e2cd-4abb-be83-5a16d7c8e033 tempest-VolumesActionsTest-2085274505 None] Lock "b'cinder-fcd364e2-57d3-409f-97d2-6669c7c2d744-delete_volume'" released by "delete_volume" :: held 1.330s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:01:32.646803 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-a491c254-3052-4bf9-8f28-1b4bd07848ed tempest-VolumesBackupsAdminTest-2077144323 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:33.580764 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-a491c254-3052-4bf9-8f28-1b4bd07848ed tempest-VolumesBackupsAdminTest-2077144323 None] Volume volume-c702e501-f624-45c5-8ff4-1f251b54fbee is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:01:33.617608 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-a491c254-3052-4bf9-8f28-1b4bd07848ed tempest-VolumesBackupsAdminTest-2077144323 None] deleting rbd volume volume-c702e501-f624-45c5-8ff4-1f251b54fbee {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:01:33.703815 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-906609f1-2f5c-409c-ab7b-cb3259024cff tempest-VolumesActionsTest-287547343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:01:33.713768 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-906609f1-2f5c-409c-ab7b-cb3259024cff tempest-VolumesActionsTest-287547343 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:01:33.714260 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-906609f1-2f5c-409c-ab7b-cb3259024cff tempest-VolumesActionsTest-287547343 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:01:33.761321 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-906609f1-2f5c-409c-ab7b-cb3259024cff tempest-VolumesActionsTest-287547343 None] Flow 'volume_create_manager' (bb19ef30-148a-4e79-a646-d379643204a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:01:33.772136 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-906609f1-2f5c-409c-ab7b-cb3259024cff tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f47e6f-7a8d-467c-8920-442ce802c733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:33.781275 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-906609f1-2f5c-409c-ab7b-cb3259024cff tempest-VolumesActionsTest-287547343 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:01:33.821502 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-906609f1-2f5c-409c-ab7b-cb3259024cff tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f47e6f-7a8d-467c-8920-442ce802c733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-226738006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ed6222e1-2ce1-49e1-9789-2443ebcab00f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe86b33bc9674ec59c8749b675f2eff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:01:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:01:33Z,use_quota=True,user_id='e735bee20533455bb3bfcbfb6d664f50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:33.829357 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-906609f1-2f5c-409c-ab7b-cb3259024cff tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85319f46-fa6d-4612-b961-50727d765bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:33.835998 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-906609f1-2f5c-409c-ab7b-cb3259024cff tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85319f46-fa6d-4612-b961-50727d765bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:33.843441 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-906609f1-2f5c-409c-ab7b-cb3259024cff tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ddba949-8780-4200-a1b9-3f344ec344cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:33.848809 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-906609f1-2f5c-409c-ab7b-cb3259024cff tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ddba949-8780-4200-a1b9-3f344ec344cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed6222e1-2ce1-49e1-9789-2443ebcab00f', 'volume_name': 'volume-ed6222e1-2ce1-49e1-9789-2443ebcab00f', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:33.855358 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-906609f1-2f5c-409c-ab7b-cb3259024cff tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea80e632-5100-46c6-a644-e78a816dc1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:33.861389 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-906609f1-2f5c-409c-ab7b-cb3259024cff tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea80e632-5100-46c6-a644-e78a816dc1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:33.868924 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-906609f1-2f5c-409c-ab7b-cb3259024cff tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ccd6047-62d6-41a6-9b5f-d8e158153bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:33.871125 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-906609f1-2f5c-409c-ab7b-cb3259024cff tempest-VolumesActionsTest-287547343 None] Volume ed6222e1-2ce1-49e1-9789-2443ebcab00f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed6222e1-2ce1-49e1-9789-2443ebcab00f', 'volume_size': 1} Feb 05 21:01:33.871807 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-906609f1-2f5c-409c-ab7b-cb3259024cff tempest-VolumesActionsTest-287547343 None] creating volume 'volume-ed6222e1-2ce1-49e1-9789-2443ebcab00f' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:01:33.874107 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-906609f1-2f5c-409c-ab7b-cb3259024cff tempest-VolumesActionsTest-287547343 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:34.036377 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-906609f1-2f5c-409c-ab7b-cb3259024cff tempest-VolumesActionsTest-287547343 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:01:34.037097 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-906609f1-2f5c-409c-ab7b-cb3259024cff tempest-VolumesActionsTest-287547343 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:01:34.042865 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-906609f1-2f5c-409c-ab7b-cb3259024cff tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ccd6047-62d6-41a6-9b5f-d8e158153bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed6222e1-2ce1-49e1-9789-2443ebcab00f', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:34.056042 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-906609f1-2f5c-409c-ab7b-cb3259024cff tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c26ca24-20cd-4565-8995-121ccb144520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:34.082477 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-906609f1-2f5c-409c-ab7b-cb3259024cff tempest-VolumesActionsTest-287547343 None] Volume volume-ed6222e1-2ce1-49e1-9789-2443ebcab00f (ed6222e1-2ce1-49e1-9789-2443ebcab00f): created successfully Feb 05 21:01:34.097145 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-906609f1-2f5c-409c-ab7b-cb3259024cff tempest-VolumesActionsTest-287547343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c26ca24-20cd-4565-8995-121ccb144520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:34.111622 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-906609f1-2f5c-409c-ab7b-cb3259024cff tempest-VolumesActionsTest-287547343 None] Flow 'volume_create_manager' (bb19ef30-148a-4e79-a646-d379643204a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:01:34.157283 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-906609f1-2f5c-409c-ab7b-cb3259024cff tempest-VolumesActionsTest-287547343 None] Created volume successfully. Feb 05 21:01:34.184573 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-a491c254-3052-4bf9-8f28-1b4bd07848ed tempest-VolumesBackupsAdminTest-2077144323 None] Created reservations ['9d5c8526-024c-4eee-83d3-4e8d04a50a53', 'b006eb91-bdfa-43af-a0d1-6298cbe54c41', 'bb662056-c0f3-44a3-87d9-38616d7d8015', 'a7b31889-8a1a-4da3-949a-ddf251e726a1'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:01:34.256055 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-a491c254-3052-4bf9-8f28-1b4bd07848ed tempest-VolumesBackupsAdminTest-2077144323 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:34.335260 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-a491c254-3052-4bf9-8f28-1b4bd07848ed tempest-VolumesBackupsAdminTest-2077144323 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:34.392294 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-a491c254-3052-4bf9-8f28-1b4bd07848ed tempest-VolumesBackupsAdminTest-2077144323 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:01:34.407970 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-a491c254-3052-4bf9-8f28-1b4bd07848ed tempest-VolumesBackupsAdminTest-2077144323 None] Deleted volume successfully. Feb 05 21:01:34.432531 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-c22d5cae-2e45-45f6-98b1-220474e0db46 tempest-VolumesBackupsAdminTest-2077144323 None] Lock "b'cinder-d2ae291c-dfca-46b6-b441-0f74813e2a5c-delete_volume'" acquired by "delete_volume" :: waited 0.033s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:01:34.466107 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-a491c254-3052-4bf9-8f28-1b4bd07848ed tempest-VolumesBackupsAdminTest-2077144323 None] Lock "b'cinder-c702e501-f624-45c5-8ff4-1f251b54fbee-delete_volume'" released by "delete_volume" :: held 2.275s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:01:34.524638 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c22d5cae-2e45-45f6-98b1-220474e0db46 tempest-VolumesBackupsAdminTest-2077144323 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:35.632293 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c22d5cae-2e45-45f6-98b1-220474e0db46 tempest-VolumesBackupsAdminTest-2077144323 None] Volume volume-d2ae291c-dfca-46b6-b441-0f74813e2a5c is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:01:35.660715 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c22d5cae-2e45-45f6-98b1-220474e0db46 tempest-VolumesBackupsAdminTest-2077144323 None] deleting rbd volume volume-d2ae291c-dfca-46b6-b441-0f74813e2a5c {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:01:36.140877 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-c22d5cae-2e45-45f6-98b1-220474e0db46 tempest-VolumesBackupsAdminTest-2077144323 None] Created reservations ['20a5b55b-8016-4de6-a9d7-22785efb0f39', '18d15550-db50-4a54-8110-371e2e434848', 'eec5ce8a-e3ac-4f08-9054-8c9639cb90b6', '0070a3c8-3e2c-47e2-8048-25909d6c8f88'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:01:36.234183 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-4ce85bd4-d04b-4226-bf3a-daf2fbfefa8d tempest-VolumesActionsTest-287547343 None] Lock "b'cinder-ed6222e1-2ce1-49e1-9789-2443ebcab00f-delete_volume'" acquired by "delete_volume" :: waited 0.046s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:01:36.268014 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c22d5cae-2e45-45f6-98b1-220474e0db46 tempest-VolumesBackupsAdminTest-2077144323 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:36.340637 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c22d5cae-2e45-45f6-98b1-220474e0db46 tempest-VolumesBackupsAdminTest-2077144323 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:36.428197 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-c22d5cae-2e45-45f6-98b1-220474e0db46 tempest-VolumesBackupsAdminTest-2077144323 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:01:36.454769 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-c22d5cae-2e45-45f6-98b1-220474e0db46 tempest-VolumesBackupsAdminTest-2077144323 None] Deleted volume successfully. Feb 05 21:01:36.473701 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-4ce85bd4-d04b-4226-bf3a-daf2fbfefa8d tempest-VolumesActionsTest-287547343 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:36.560606 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-4ce85bd4-d04b-4226-bf3a-daf2fbfefa8d tempest-VolumesActionsTest-287547343 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:01:36.561028 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-4ce85bd4-d04b-4226-bf3a-daf2fbfefa8d tempest-VolumesActionsTest-287547343 None] Volume volume-ed6222e1-2ce1-49e1-9789-2443ebcab00f is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:01:36.571837 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-4ce85bd4-d04b-4226-bf3a-daf2fbfefa8d tempest-VolumesActionsTest-287547343 None] deleting rbd volume volume-ed6222e1-2ce1-49e1-9789-2443ebcab00f {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:01:36.578102 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-c22d5cae-2e45-45f6-98b1-220474e0db46 tempest-VolumesBackupsAdminTest-2077144323 None] Lock "b'cinder-d2ae291c-dfca-46b6-b441-0f74813e2a5c-delete_volume'" released by "delete_volume" :: held 2.146s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:01:36.979823 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-4ce85bd4-d04b-4226-bf3a-daf2fbfefa8d tempest-VolumesActionsTest-287547343 None] Created reservations ['d1dc2c8a-1a2e-4e1d-9957-27df2cced96e', '2b7001e7-231a-4e36-a153-8abeb4b52c47', 'aed19d8c-c0e5-4401-94a7-723e1c8b9aa8', 'c7c5d306-39a2-4ac4-bd21-77e41a50cc05'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:01:37.086370 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-4ce85bd4-d04b-4226-bf3a-daf2fbfefa8d tempest-VolumesActionsTest-287547343 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:37.167536 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-4ce85bd4-d04b-4226-bf3a-daf2fbfefa8d tempest-VolumesActionsTest-287547343 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:37.237562 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-4ce85bd4-d04b-4226-bf3a-daf2fbfefa8d tempest-VolumesActionsTest-287547343 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:01:37.242185 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-4ce85bd4-d04b-4226-bf3a-daf2fbfefa8d tempest-VolumesActionsTest-287547343 None] Deleted volume successfully. Feb 05 21:01:37.269282 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-4ce85bd4-d04b-4226-bf3a-daf2fbfefa8d tempest-VolumesActionsTest-287547343 None] Lock "b'cinder-ed6222e1-2ce1-49e1-9789-2443ebcab00f-delete_volume'" released by "delete_volume" :: held 1.035s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:01:37.541329 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-ee6caa70-0b7a-41ac-9e45-82115227106a tempest-VolumesActionsTest-287547343 None] Lock "b'cinder-3c6716ad-0857-4482-82ab-f6e657a48849-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:01:37.635021 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ee6caa70-0b7a-41ac-9e45-82115227106a tempest-VolumesActionsTest-287547343 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:37.710620 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ee6caa70-0b7a-41ac-9e45-82115227106a tempest-VolumesActionsTest-287547343 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:01:37.711017 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ee6caa70-0b7a-41ac-9e45-82115227106a tempest-VolumesActionsTest-287547343 None] Volume volume-3c6716ad-0857-4482-82ab-f6e657a48849 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:01:37.727943 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ee6caa70-0b7a-41ac-9e45-82115227106a tempest-VolumesActionsTest-287547343 None] deleting rbd volume volume-3c6716ad-0857-4482-82ab-f6e657a48849 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:01:38.141481 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-ee6caa70-0b7a-41ac-9e45-82115227106a tempest-VolumesActionsTest-287547343 None] Created reservations ['10b0f553-ff74-4fa4-82cf-5433898b5456', '89edf110-e287-440d-9372-54a2f6ca6dec', '08115804-b34d-49ff-8973-f7abace48d23', '6f62cad1-6d9a-43cc-9ef2-6ce736a921da'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:01:38.218602 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ee6caa70-0b7a-41ac-9e45-82115227106a tempest-VolumesActionsTest-287547343 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:38.264147 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ee6caa70-0b7a-41ac-9e45-82115227106a tempest-VolumesActionsTest-287547343 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:38.361456 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-ee6caa70-0b7a-41ac-9e45-82115227106a tempest-VolumesActionsTest-287547343 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:01:38.383481 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-ee6caa70-0b7a-41ac-9e45-82115227106a tempest-VolumesActionsTest-287547343 None] Deleted volume successfully. Feb 05 21:01:38.415187 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-ee6caa70-0b7a-41ac-9e45-82115227106a tempest-VolumesActionsTest-287547343 None] Lock "b'cinder-3c6716ad-0857-4482-82ab-f6e657a48849-delete_volume'" released by "delete_volume" :: held 0.874s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:01:44.582764 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-d459c9f4-4349-4669-a9b3-22917a160b60 tempest-VolumesListAdminTestJSON-1776435567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:01:44.591367 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-d459c9f4-4349-4669-a9b3-22917a160b60 tempest-VolumesListAdminTestJSON-1776435567 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:01:44.592677 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-d459c9f4-4349-4669-a9b3-22917a160b60 tempest-VolumesListAdminTestJSON-1776435567 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:01:44.642125 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d459c9f4-4349-4669-a9b3-22917a160b60 tempest-VolumesListAdminTestJSON-1776435567 None] Flow 'volume_create_manager' (ecc4921d-be12-41a7-ac10-794adae968d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:01:44.648893 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d459c9f4-4349-4669-a9b3-22917a160b60 tempest-VolumesListAdminTestJSON-1776435567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a941106-d224-45a3-881b-cc75e40fc80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:44.664789 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-d459c9f4-4349-4669-a9b3-22917a160b60 tempest-VolumesListAdminTestJSON-1776435567 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:01:44.687038 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d459c9f4-4349-4669-a9b3-22917a160b60 tempest-VolumesListAdminTestJSON-1776435567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a941106-d224-45a3-881b-cc75e40fc80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-516761040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=65240681-3bc7-48e1-a3fb-ddfeef541fe1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bb9f87bb06145c698c99ef0d2aaeb7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:01:45Z,use_quota=True,user_id='cd063ea6a5cd41fd83498573b2f64e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:44.695844 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d459c9f4-4349-4669-a9b3-22917a160b60 tempest-VolumesListAdminTestJSON-1776435567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (464f3542-5b35-44c5-9616-633947e72410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:44.714139 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d459c9f4-4349-4669-a9b3-22917a160b60 tempest-VolumesListAdminTestJSON-1776435567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (464f3542-5b35-44c5-9616-633947e72410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:44.721273 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d459c9f4-4349-4669-a9b3-22917a160b60 tempest-VolumesListAdminTestJSON-1776435567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fb7041d-452c-45c7-ab6c-5a266f64eba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:44.726017 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d459c9f4-4349-4669-a9b3-22917a160b60 tempest-VolumesListAdminTestJSON-1776435567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fb7041d-452c-45c7-ab6c-5a266f64eba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65240681-3bc7-48e1-a3fb-ddfeef541fe1', 'volume_name': 'volume-65240681-3bc7-48e1-a3fb-ddfeef541fe1', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:44.731481 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d459c9f4-4349-4669-a9b3-22917a160b60 tempest-VolumesListAdminTestJSON-1776435567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c2c065b-19a7-4bd2-8c55-ea20deafc895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:44.736329 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d459c9f4-4349-4669-a9b3-22917a160b60 tempest-VolumesListAdminTestJSON-1776435567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c2c065b-19a7-4bd2-8c55-ea20deafc895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:44.741240 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d459c9f4-4349-4669-a9b3-22917a160b60 tempest-VolumesListAdminTestJSON-1776435567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90ea629c-b852-4972-bae2-4702ef5d32ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:44.742364 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-d459c9f4-4349-4669-a9b3-22917a160b60 tempest-VolumesListAdminTestJSON-1776435567 None] Volume 65240681-3bc7-48e1-a3fb-ddfeef541fe1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65240681-3bc7-48e1-a3fb-ddfeef541fe1', 'volume_size': 1} Feb 05 21:01:44.742960 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-d459c9f4-4349-4669-a9b3-22917a160b60 tempest-VolumesListAdminTestJSON-1776435567 None] creating volume 'volume-65240681-3bc7-48e1-a3fb-ddfeef541fe1' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:01:44.744477 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-d459c9f4-4349-4669-a9b3-22917a160b60 tempest-VolumesListAdminTestJSON-1776435567 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:44.855972 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-d459c9f4-4349-4669-a9b3-22917a160b60 tempest-VolumesListAdminTestJSON-1776435567 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:01:44.857627 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-d459c9f4-4349-4669-a9b3-22917a160b60 tempest-VolumesListAdminTestJSON-1776435567 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:01:44.865348 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d459c9f4-4349-4669-a9b3-22917a160b60 tempest-VolumesListAdminTestJSON-1776435567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90ea629c-b852-4972-bae2-4702ef5d32ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65240681-3bc7-48e1-a3fb-ddfeef541fe1', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:44.887262 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d459c9f4-4349-4669-a9b3-22917a160b60 tempest-VolumesListAdminTestJSON-1776435567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (086ef5c5-f2b8-4d97-b2af-bc5fa4385284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:44.914667 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-d459c9f4-4349-4669-a9b3-22917a160b60 tempest-VolumesListAdminTestJSON-1776435567 None] Volume volume-65240681-3bc7-48e1-a3fb-ddfeef541fe1 (65240681-3bc7-48e1-a3fb-ddfeef541fe1): created successfully Feb 05 21:01:44.923613 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d459c9f4-4349-4669-a9b3-22917a160b60 tempest-VolumesListAdminTestJSON-1776435567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (086ef5c5-f2b8-4d97-b2af-bc5fa4385284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:44.940724 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d459c9f4-4349-4669-a9b3-22917a160b60 tempest-VolumesListAdminTestJSON-1776435567 None] Flow 'volume_create_manager' (ecc4921d-be12-41a7-ac10-794adae968d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:01:44.962716 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-d459c9f4-4349-4669-a9b3-22917a160b60 tempest-VolumesListAdminTestJSON-1776435567 None] Created volume successfully. Feb 05 21:01:45.228079 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-d18520d8-ef21-4afe-8e68-677cc28af4b4 tempest-SnapshotMetadataTestJSON-818219653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:01:45.233657 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-d18520d8-ef21-4afe-8e68-677cc28af4b4 tempest-SnapshotMetadataTestJSON-818219653 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:01:45.234225 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-d18520d8-ef21-4afe-8e68-677cc28af4b4 tempest-SnapshotMetadataTestJSON-818219653 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:01:45.257129 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d18520d8-ef21-4afe-8e68-677cc28af4b4 tempest-SnapshotMetadataTestJSON-818219653 None] Flow 'volume_create_manager' (745036b7-acec-4065-9423-1356dd1189fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:01:45.265950 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d18520d8-ef21-4afe-8e68-677cc28af4b4 tempest-SnapshotMetadataTestJSON-818219653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35296c81-1c47-400a-9058-699f3a08e129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:45.273463 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-d18520d8-ef21-4afe-8e68-677cc28af4b4 tempest-SnapshotMetadataTestJSON-818219653 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:01:45.292106 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d18520d8-ef21-4afe-8e68-677cc28af4b4 tempest-SnapshotMetadataTestJSON-818219653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35296c81-1c47-400a-9058-699f3a08e129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1046946681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=44b46800-24c5-4ed8-9d0e-d2790f0f002b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a42252806ab4146b41f2e70f77e9391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:01:45Z,use_quota=True,user_id='79f9f5f6820649febc741f13148fa17e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:45.300207 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d18520d8-ef21-4afe-8e68-677cc28af4b4 tempest-SnapshotMetadataTestJSON-818219653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f6eb4b5-1698-478f-855e-0cdbb4b83c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:45.304587 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d18520d8-ef21-4afe-8e68-677cc28af4b4 tempest-SnapshotMetadataTestJSON-818219653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f6eb4b5-1698-478f-855e-0cdbb4b83c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:45.311917 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d18520d8-ef21-4afe-8e68-677cc28af4b4 tempest-SnapshotMetadataTestJSON-818219653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca9ca10e-dd1f-4be8-b1c2-2cdbe59d1e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:45.316456 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d18520d8-ef21-4afe-8e68-677cc28af4b4 tempest-SnapshotMetadataTestJSON-818219653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca9ca10e-dd1f-4be8-b1c2-2cdbe59d1e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44b46800-24c5-4ed8-9d0e-d2790f0f002b', 'volume_name': 'volume-44b46800-24c5-4ed8-9d0e-d2790f0f002b', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:45.321387 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d18520d8-ef21-4afe-8e68-677cc28af4b4 tempest-SnapshotMetadataTestJSON-818219653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (227bdec8-bfca-4d11-bb7a-b9503d22dce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:45.326356 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d18520d8-ef21-4afe-8e68-677cc28af4b4 tempest-SnapshotMetadataTestJSON-818219653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (227bdec8-bfca-4d11-bb7a-b9503d22dce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:45.332187 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d18520d8-ef21-4afe-8e68-677cc28af4b4 tempest-SnapshotMetadataTestJSON-818219653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dca8a8ec-04b2-44b3-be05-410f326a9894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:45.333521 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-d18520d8-ef21-4afe-8e68-677cc28af4b4 tempest-SnapshotMetadataTestJSON-818219653 None] Volume 44b46800-24c5-4ed8-9d0e-d2790f0f002b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44b46800-24c5-4ed8-9d0e-d2790f0f002b', 'volume_size': 1} Feb 05 21:01:45.334124 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-d18520d8-ef21-4afe-8e68-677cc28af4b4 tempest-SnapshotMetadataTestJSON-818219653 None] creating volume 'volume-44b46800-24c5-4ed8-9d0e-d2790f0f002b' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:01:45.336136 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-d18520d8-ef21-4afe-8e68-677cc28af4b4 tempest-SnapshotMetadataTestJSON-818219653 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:45.467013 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-d18520d8-ef21-4afe-8e68-677cc28af4b4 tempest-SnapshotMetadataTestJSON-818219653 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:01:45.467013 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-d18520d8-ef21-4afe-8e68-677cc28af4b4 tempest-SnapshotMetadataTestJSON-818219653 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:01:45.470292 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d18520d8-ef21-4afe-8e68-677cc28af4b4 tempest-SnapshotMetadataTestJSON-818219653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dca8a8ec-04b2-44b3-be05-410f326a9894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44b46800-24c5-4ed8-9d0e-d2790f0f002b', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:45.475255 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d18520d8-ef21-4afe-8e68-677cc28af4b4 tempest-SnapshotMetadataTestJSON-818219653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6beb7cf2-a47f-4048-930b-8fb3ed84f7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:45.499070 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-d18520d8-ef21-4afe-8e68-677cc28af4b4 tempest-SnapshotMetadataTestJSON-818219653 None] Volume volume-44b46800-24c5-4ed8-9d0e-d2790f0f002b (44b46800-24c5-4ed8-9d0e-d2790f0f002b): created successfully Feb 05 21:01:45.504631 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d18520d8-ef21-4afe-8e68-677cc28af4b4 tempest-SnapshotMetadataTestJSON-818219653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6beb7cf2-a47f-4048-930b-8fb3ed84f7d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:45.512459 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d18520d8-ef21-4afe-8e68-677cc28af4b4 tempest-SnapshotMetadataTestJSON-818219653 None] Flow 'volume_create_manager' (745036b7-acec-4065-9423-1356dd1189fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:01:45.530061 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-d18520d8-ef21-4afe-8e68-677cc28af4b4 tempest-SnapshotMetadataTestJSON-818219653 None] Created volume successfully. Feb 05 21:01:46.098196 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c015338-03dc-4287-9c80-93bf8e576845 tempest-VolumesListAdminTestJSON-1776435567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:01:46.104170 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-5c015338-03dc-4287-9c80-93bf8e576845 tempest-VolumesListAdminTestJSON-1776435567 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:01:46.104615 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-5c015338-03dc-4287-9c80-93bf8e576845 tempest-VolumesListAdminTestJSON-1776435567 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:01:46.126442 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5c015338-03dc-4287-9c80-93bf8e576845 tempest-VolumesListAdminTestJSON-1776435567 None] Flow 'volume_create_manager' (6b9a6d3a-8662-43dd-8d11-b8450c5ae7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:01:46.133916 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5c015338-03dc-4287-9c80-93bf8e576845 tempest-VolumesListAdminTestJSON-1776435567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e5fac63-d306-4bc8-998a-e0a088f22040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:46.142147 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-5c015338-03dc-4287-9c80-93bf8e576845 tempest-VolumesListAdminTestJSON-1776435567 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:01:46.189892 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5c015338-03dc-4287-9c80-93bf8e576845 tempest-VolumesListAdminTestJSON-1776435567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e5fac63-d306-4bc8-998a-e0a088f22040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1839652673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f3c079e2-4b9b-45f5-ac7c-00decf4e6c59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bb9f87bb06145c698c99ef0d2aaeb7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:01:46Z,use_quota=True,user_id='cd063ea6a5cd41fd83498573b2f64e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:46.196909 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5c015338-03dc-4287-9c80-93bf8e576845 tempest-VolumesListAdminTestJSON-1776435567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f928d418-1cbe-4400-a65f-5b21be9f102d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:46.209166 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5c015338-03dc-4287-9c80-93bf8e576845 tempest-VolumesListAdminTestJSON-1776435567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f928d418-1cbe-4400-a65f-5b21be9f102d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:46.215390 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5c015338-03dc-4287-9c80-93bf8e576845 tempest-VolumesListAdminTestJSON-1776435567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c54a4dca-0e66-4bd9-9fab-0c2bdf99adb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:46.221923 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5c015338-03dc-4287-9c80-93bf8e576845 tempest-VolumesListAdminTestJSON-1776435567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c54a4dca-0e66-4bd9-9fab-0c2bdf99adb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3c079e2-4b9b-45f5-ac7c-00decf4e6c59', 'volume_name': 'volume-f3c079e2-4b9b-45f5-ac7c-00decf4e6c59', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:46.227715 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5c015338-03dc-4287-9c80-93bf8e576845 tempest-VolumesListAdminTestJSON-1776435567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79202282-1f7c-43b7-bbcd-260693373bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:46.233971 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5c015338-03dc-4287-9c80-93bf8e576845 tempest-VolumesListAdminTestJSON-1776435567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79202282-1f7c-43b7-bbcd-260693373bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:46.239279 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5c015338-03dc-4287-9c80-93bf8e576845 tempest-VolumesListAdminTestJSON-1776435567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee316b4a-5af4-4cf3-b392-f00067bcfea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:46.240604 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-5c015338-03dc-4287-9c80-93bf8e576845 tempest-VolumesListAdminTestJSON-1776435567 None] Volume f3c079e2-4b9b-45f5-ac7c-00decf4e6c59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3c079e2-4b9b-45f5-ac7c-00decf4e6c59', 'volume_size': 1} Feb 05 21:01:46.241168 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5c015338-03dc-4287-9c80-93bf8e576845 tempest-VolumesListAdminTestJSON-1776435567 None] creating volume 'volume-f3c079e2-4b9b-45f5-ac7c-00decf4e6c59' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:01:46.242636 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5c015338-03dc-4287-9c80-93bf8e576845 tempest-VolumesListAdminTestJSON-1776435567 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:46.370024 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5c015338-03dc-4287-9c80-93bf8e576845 tempest-VolumesListAdminTestJSON-1776435567 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:01:46.370442 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5c015338-03dc-4287-9c80-93bf8e576845 tempest-VolumesListAdminTestJSON-1776435567 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:01:46.385049 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5c015338-03dc-4287-9c80-93bf8e576845 tempest-VolumesListAdminTestJSON-1776435567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee316b4a-5af4-4cf3-b392-f00067bcfea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3c079e2-4b9b-45f5-ac7c-00decf4e6c59', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:46.396130 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5c015338-03dc-4287-9c80-93bf8e576845 tempest-VolumesListAdminTestJSON-1776435567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ddeae1-365e-45a1-a373-e837cb8d5723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:46.414534 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-5c015338-03dc-4287-9c80-93bf8e576845 tempest-VolumesListAdminTestJSON-1776435567 None] Volume volume-f3c079e2-4b9b-45f5-ac7c-00decf4e6c59 (f3c079e2-4b9b-45f5-ac7c-00decf4e6c59): created successfully Feb 05 21:01:46.420309 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5c015338-03dc-4287-9c80-93bf8e576845 tempest-VolumesListAdminTestJSON-1776435567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ddeae1-365e-45a1-a373-e837cb8d5723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:46.436330 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5c015338-03dc-4287-9c80-93bf8e576845 tempest-VolumesListAdminTestJSON-1776435567 None] Flow 'volume_create_manager' (6b9a6d3a-8662-43dd-8d11-b8450c5ae7bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:01:46.454956 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-5c015338-03dc-4287-9c80-93bf8e576845 tempest-VolumesListAdminTestJSON-1776435567 None] Created volume successfully. Feb 05 21:01:46.547070 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-652fe0ad-1433-4c2e-a060-65349e4bd2d9 tempest-SnapshotMetadataTestJSON-818219653 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:47.243591 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-652fe0ad-1433-4c2e-a060-65349e4bd2d9 tempest-SnapshotMetadataTestJSON-818219653 None] Create snapshot completed successfully Feb 05 21:01:47.782157 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c7d250b-8c6a-401b-b6ce-93aeb365a812 tempest-VolumesListAdminTestJSON-1776435567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:01:47.794051 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-9c7d250b-8c6a-401b-b6ce-93aeb365a812 tempest-VolumesListAdminTestJSON-1776435567 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:01:47.794289 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-9c7d250b-8c6a-401b-b6ce-93aeb365a812 tempest-VolumesListAdminTestJSON-1776435567 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:01:47.835478 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9c7d250b-8c6a-401b-b6ce-93aeb365a812 tempest-VolumesListAdminTestJSON-1776435567 None] Flow 'volume_create_manager' (f7015c7c-6c70-4b10-b950-902b66591727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:01:47.845651 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9c7d250b-8c6a-401b-b6ce-93aeb365a812 tempest-VolumesListAdminTestJSON-1776435567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0810ee04-6464-4771-8d03-206231e58233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:47.871204 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-9c7d250b-8c6a-401b-b6ce-93aeb365a812 tempest-VolumesListAdminTestJSON-1776435567 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:01:47.891628 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9c7d250b-8c6a-401b-b6ce-93aeb365a812 tempest-VolumesListAdminTestJSON-1776435567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0810ee04-6464-4771-8d03-206231e58233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:01:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1345105181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=36d8374d-7d05-4243-978d-5ce0b793d168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bb9f87bb06145c698c99ef0d2aaeb7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:01:48Z,use_quota=True,user_id='cd063ea6a5cd41fd83498573b2f64e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:47.899441 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9c7d250b-8c6a-401b-b6ce-93aeb365a812 tempest-VolumesListAdminTestJSON-1776435567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34365ba7-30fa-47db-9bad-4dc43aff4a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:47.904940 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9c7d250b-8c6a-401b-b6ce-93aeb365a812 tempest-VolumesListAdminTestJSON-1776435567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34365ba7-30fa-47db-9bad-4dc43aff4a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:47.910878 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9c7d250b-8c6a-401b-b6ce-93aeb365a812 tempest-VolumesListAdminTestJSON-1776435567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb36158f-813c-4b58-a5f1-b056b4cfc651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:47.916414 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9c7d250b-8c6a-401b-b6ce-93aeb365a812 tempest-VolumesListAdminTestJSON-1776435567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb36158f-813c-4b58-a5f1-b056b4cfc651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36d8374d-7d05-4243-978d-5ce0b793d168', 'volume_name': 'volume-36d8374d-7d05-4243-978d-5ce0b793d168', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:47.956923 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9c7d250b-8c6a-401b-b6ce-93aeb365a812 tempest-VolumesListAdminTestJSON-1776435567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b77bdfe7-af52-45b5-89e4-5eb18dfa46d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:47.961261 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9c7d250b-8c6a-401b-b6ce-93aeb365a812 tempest-VolumesListAdminTestJSON-1776435567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b77bdfe7-af52-45b5-89e4-5eb18dfa46d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:47.968329 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9c7d250b-8c6a-401b-b6ce-93aeb365a812 tempest-VolumesListAdminTestJSON-1776435567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faab0d55-0048-493d-9f5a-cf5f41459d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:47.976787 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-9c7d250b-8c6a-401b-b6ce-93aeb365a812 tempest-VolumesListAdminTestJSON-1776435567 None] Volume 36d8374d-7d05-4243-978d-5ce0b793d168: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36d8374d-7d05-4243-978d-5ce0b793d168', 'volume_size': 1} Feb 05 21:01:47.977447 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-9c7d250b-8c6a-401b-b6ce-93aeb365a812 tempest-VolumesListAdminTestJSON-1776435567 None] creating volume 'volume-36d8374d-7d05-4243-978d-5ce0b793d168' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:01:47.978995 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-9c7d250b-8c6a-401b-b6ce-93aeb365a812 tempest-VolumesListAdminTestJSON-1776435567 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:48.117274 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-9c7d250b-8c6a-401b-b6ce-93aeb365a812 tempest-VolumesListAdminTestJSON-1776435567 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:01:48.117832 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-9c7d250b-8c6a-401b-b6ce-93aeb365a812 tempest-VolumesListAdminTestJSON-1776435567 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:01:48.125397 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9c7d250b-8c6a-401b-b6ce-93aeb365a812 tempest-VolumesListAdminTestJSON-1776435567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faab0d55-0048-493d-9f5a-cf5f41459d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36d8374d-7d05-4243-978d-5ce0b793d168', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:48.134116 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9c7d250b-8c6a-401b-b6ce-93aeb365a812 tempest-VolumesListAdminTestJSON-1776435567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1596d44e-c39e-4ed2-b12c-4abae44d4172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:48.155425 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-9c7d250b-8c6a-401b-b6ce-93aeb365a812 tempest-VolumesListAdminTestJSON-1776435567 None] Volume volume-36d8374d-7d05-4243-978d-5ce0b793d168 (36d8374d-7d05-4243-978d-5ce0b793d168): created successfully Feb 05 21:01:48.178439 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9c7d250b-8c6a-401b-b6ce-93aeb365a812 tempest-VolumesListAdminTestJSON-1776435567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1596d44e-c39e-4ed2-b12c-4abae44d4172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:48.195116 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9c7d250b-8c6a-401b-b6ce-93aeb365a812 tempest-VolumesListAdminTestJSON-1776435567 None] Flow 'volume_create_manager' (f7015c7c-6c70-4b10-b950-902b66591727) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:01:48.217261 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-9c7d250b-8c6a-401b-b6ce-93aeb365a812 tempest-VolumesListAdminTestJSON-1776435567 None] Created volume successfully. Feb 05 21:01:48.645742 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-b248d4e4-ea3e-46cb-9c7d-ff2dda7f677c tempest-SnapshotMetadataTestJSON-818219653 None] Lock "b'cinder-b631b65f-4ed0-4107-9219-99683731fc3f-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:01:48.647284 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-b248d4e4-ea3e-46cb-9c7d-ff2dda7f677c tempest-SnapshotMetadataTestJSON-818219653 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:49.292186 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-b248d4e4-ea3e-46cb-9c7d-ff2dda7f677c tempest-SnapshotMetadataTestJSON-818219653 None] Created reservations ['8503289b-8ea9-4213-a860-911a52d1e365', 'c940ccb1-f1a8-4cc5-9f8b-5a4218727bbd', 'a46ce60a-8ccb-4468-bc6f-0541843359dd', '9d81ba6d-5fb2-4637-a47f-20f827ffdd23'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:01:49.378601 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-b248d4e4-ea3e-46cb-9c7d-ff2dda7f677c tempest-SnapshotMetadataTestJSON-818219653 None] Delete snapshot completed successfully. Feb 05 21:01:49.393580 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-b248d4e4-ea3e-46cb-9c7d-ff2dda7f677c tempest-SnapshotMetadataTestJSON-818219653 None] Lock "b'cinder-b631b65f-4ed0-4107-9219-99683731fc3f-delete_snapshot'" released by "delete_snapshot" :: held 0.747s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:01:49.735289 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce140e22-cd57-44c8-a922-4f1cbf87b13f tempest-VolumesListAdminTestJSON-1034833716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:01:49.743742 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-ce140e22-cd57-44c8-a922-4f1cbf87b13f tempest-VolumesListAdminTestJSON-1034833716 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:01:49.744601 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-ce140e22-cd57-44c8-a922-4f1cbf87b13f tempest-VolumesListAdminTestJSON-1034833716 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:01:49.823611 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ce140e22-cd57-44c8-a922-4f1cbf87b13f tempest-VolumesListAdminTestJSON-1034833716 None] Flow 'volume_create_manager' (22e7ff6c-6971-4730-bc6a-e37c7dc5930a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:01:49.856229 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ce140e22-cd57-44c8-a922-4f1cbf87b13f tempest-VolumesListAdminTestJSON-1034833716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b18ea52-9507-4d86-804c-d11bf88a7961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:49.892882 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-ed2ba1b3-964f-4550-b173-39f41917fcc5 tempest-SnapshotMetadataTestJSON-818219653 None] Lock "b'cinder-44b46800-24c5-4ed8-9d0e-d2790f0f002b-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:01:49.895702 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-ce140e22-cd57-44c8-a922-4f1cbf87b13f tempest-VolumesListAdminTestJSON-1034833716 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:01:49.923189 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ce140e22-cd57-44c8-a922-4f1cbf87b13f tempest-VolumesListAdminTestJSON-1034833716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b18ea52-9507-4d86-804c-d11bf88a7961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:01:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4a040afa-76e3-41ac-b1a5-111d7aa13d66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd69c2b38c714d1998c0889d6b061bc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:01:50Z,use_quota=True,user_id='ff57fb7ecd9b48a4b814cfd985195142',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:49.929675 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ce140e22-cd57-44c8-a922-4f1cbf87b13f tempest-VolumesListAdminTestJSON-1034833716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3400a512-561a-4cec-a038-41b776ac00bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:49.935832 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ce140e22-cd57-44c8-a922-4f1cbf87b13f tempest-VolumesListAdminTestJSON-1034833716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3400a512-561a-4cec-a038-41b776ac00bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:49.942806 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ce140e22-cd57-44c8-a922-4f1cbf87b13f tempest-VolumesListAdminTestJSON-1034833716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b76dcd57-cd32-4a84-973d-788d6d1604f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:49.964213 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ce140e22-cd57-44c8-a922-4f1cbf87b13f tempest-VolumesListAdminTestJSON-1034833716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b76dcd57-cd32-4a84-973d-788d6d1604f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a040afa-76e3-41ac-b1a5-111d7aa13d66', 'volume_name': 'volume-4a040afa-76e3-41ac-b1a5-111d7aa13d66', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:49.975384 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ce140e22-cd57-44c8-a922-4f1cbf87b13f tempest-VolumesListAdminTestJSON-1034833716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ba48194-c95d-425f-9424-48b515d3ac5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:49.986840 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ce140e22-cd57-44c8-a922-4f1cbf87b13f tempest-VolumesListAdminTestJSON-1034833716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ba48194-c95d-425f-9424-48b515d3ac5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:49.997867 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ce140e22-cd57-44c8-a922-4f1cbf87b13f tempest-VolumesListAdminTestJSON-1034833716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e386f708-b200-48b1-9f43-5558418e9215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:50.000595 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-ce140e22-cd57-44c8-a922-4f1cbf87b13f tempest-VolumesListAdminTestJSON-1034833716 None] Volume 4a040afa-76e3-41ac-b1a5-111d7aa13d66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a040afa-76e3-41ac-b1a5-111d7aa13d66', 'volume_size': 1} Feb 05 21:01:50.001088 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ce140e22-cd57-44c8-a922-4f1cbf87b13f tempest-VolumesListAdminTestJSON-1034833716 None] creating volume 'volume-4a040afa-76e3-41ac-b1a5-111d7aa13d66' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:01:50.006767 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ce140e22-cd57-44c8-a922-4f1cbf87b13f tempest-VolumesListAdminTestJSON-1034833716 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:50.098069 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ed2ba1b3-964f-4550-b173-39f41917fcc5 tempest-SnapshotMetadataTestJSON-818219653 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:50.161890 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ed2ba1b3-964f-4550-b173-39f41917fcc5 tempest-SnapshotMetadataTestJSON-818219653 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:01:50.162414 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ed2ba1b3-964f-4550-b173-39f41917fcc5 tempest-SnapshotMetadataTestJSON-818219653 None] Volume volume-44b46800-24c5-4ed8-9d0e-d2790f0f002b is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:01:50.172642 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ed2ba1b3-964f-4550-b173-39f41917fcc5 tempest-SnapshotMetadataTestJSON-818219653 None] deleting rbd volume volume-44b46800-24c5-4ed8-9d0e-d2790f0f002b {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:01:50.188528 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ce140e22-cd57-44c8-a922-4f1cbf87b13f tempest-VolumesListAdminTestJSON-1034833716 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:01:50.189159 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ce140e22-cd57-44c8-a922-4f1cbf87b13f tempest-VolumesListAdminTestJSON-1034833716 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:01:50.193169 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ce140e22-cd57-44c8-a922-4f1cbf87b13f tempest-VolumesListAdminTestJSON-1034833716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e386f708-b200-48b1-9f43-5558418e9215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a040afa-76e3-41ac-b1a5-111d7aa13d66', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:50.213665 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ce140e22-cd57-44c8-a922-4f1cbf87b13f tempest-VolumesListAdminTestJSON-1034833716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90c8084f-6c0a-4834-a48e-3bbd4bb41435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:50.232004 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-ce140e22-cd57-44c8-a922-4f1cbf87b13f tempest-VolumesListAdminTestJSON-1034833716 None] Volume volume-4a040afa-76e3-41ac-b1a5-111d7aa13d66 (4a040afa-76e3-41ac-b1a5-111d7aa13d66): created successfully Feb 05 21:01:50.236295 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ce140e22-cd57-44c8-a922-4f1cbf87b13f tempest-VolumesListAdminTestJSON-1034833716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90c8084f-6c0a-4834-a48e-3bbd4bb41435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:50.248451 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ce140e22-cd57-44c8-a922-4f1cbf87b13f tempest-VolumesListAdminTestJSON-1034833716 None] Flow 'volume_create_manager' (22e7ff6c-6971-4730-bc6a-e37c7dc5930a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:01:50.277370 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-ce140e22-cd57-44c8-a922-4f1cbf87b13f tempest-VolumesListAdminTestJSON-1034833716 None] Created volume successfully. Feb 05 21:01:50.533873 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-ed2ba1b3-964f-4550-b173-39f41917fcc5 tempest-SnapshotMetadataTestJSON-818219653 None] Created reservations ['69faf7d8-7113-4a90-aebe-5b5ea4f8c21f', '50217d9d-717a-4412-84ca-bf0790a3b78a', '27b81ad8-b58c-49d5-b3c9-179a82e93e09', '954e3db5-f2b8-4c87-a39b-7be020124c6a'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:01:50.610040 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ed2ba1b3-964f-4550-b173-39f41917fcc5 tempest-SnapshotMetadataTestJSON-818219653 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:50.677146 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ed2ba1b3-964f-4550-b173-39f41917fcc5 tempest-SnapshotMetadataTestJSON-818219653 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:50.741997 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-ed2ba1b3-964f-4550-b173-39f41917fcc5 tempest-SnapshotMetadataTestJSON-818219653 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:01:50.747811 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-ed2ba1b3-964f-4550-b173-39f41917fcc5 tempest-SnapshotMetadataTestJSON-818219653 None] Deleted volume successfully. Feb 05 21:01:50.764373 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-ed2ba1b3-964f-4550-b173-39f41917fcc5 tempest-SnapshotMetadataTestJSON-818219653 None] Lock "b'cinder-44b46800-24c5-4ed8-9d0e-d2790f0f002b-delete_volume'" released by "delete_volume" :: held 0.874s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:01:50.901112 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-073ec94e-de9e-457f-b02d-7f5084c7618a tempest-VolumesListAdminTestJSON-1034833716 None] Lock "b'cinder-4a040afa-76e3-41ac-b1a5-111d7aa13d66-delete_volume'" acquired by "delete_volume" :: waited 0.029s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:01:50.961528 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-073ec94e-de9e-457f-b02d-7f5084c7618a tempest-VolumesListAdminTestJSON-1034833716 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:51.069005 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-073ec94e-de9e-457f-b02d-7f5084c7618a tempest-VolumesListAdminTestJSON-1034833716 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:01:51.069812 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-073ec94e-de9e-457f-b02d-7f5084c7618a tempest-VolumesListAdminTestJSON-1034833716 None] Volume volume-4a040afa-76e3-41ac-b1a5-111d7aa13d66 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:01:51.091833 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-073ec94e-de9e-457f-b02d-7f5084c7618a tempest-VolumesListAdminTestJSON-1034833716 None] deleting rbd volume volume-4a040afa-76e3-41ac-b1a5-111d7aa13d66 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:01:51.135073 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-bb85d06b-b6b6-47b4-920d-60ca008cc4cb tempest-VolumesListAdminTestJSON-1776435567 None] Lock "b'cinder-36d8374d-7d05-4243-978d-5ce0b793d168-delete_volume'" acquired by "delete_volume" :: waited 0.032s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:01:51.194227 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-bb85d06b-b6b6-47b4-920d-60ca008cc4cb tempest-VolumesListAdminTestJSON-1776435567 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:51.279927 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-bb85d06b-b6b6-47b4-920d-60ca008cc4cb tempest-VolumesListAdminTestJSON-1776435567 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:01:51.281161 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-bb85d06b-b6b6-47b4-920d-60ca008cc4cb tempest-VolumesListAdminTestJSON-1776435567 None] Volume volume-36d8374d-7d05-4243-978d-5ce0b793d168 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:01:51.295814 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-bb85d06b-b6b6-47b4-920d-60ca008cc4cb tempest-VolumesListAdminTestJSON-1776435567 None] deleting rbd volume volume-36d8374d-7d05-4243-978d-5ce0b793d168 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:01:51.612659 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-073ec94e-de9e-457f-b02d-7f5084c7618a tempest-VolumesListAdminTestJSON-1034833716 None] Created reservations ['6ca57ca6-cf8b-4e9e-a09c-a37cdd6a50d1', 'a2202feb-a07e-49eb-8585-fac9916b8bfc', 'e873848a-92c9-45ba-8cce-3a2afbc71d46', '1bfdba81-d39f-4fe6-9833-5bf302ed5de3'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:01:51.732241 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-073ec94e-de9e-457f-b02d-7f5084c7618a tempest-VolumesListAdminTestJSON-1034833716 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:51.820933 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-073ec94e-de9e-457f-b02d-7f5084c7618a tempest-VolumesListAdminTestJSON-1034833716 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:51.898185 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-073ec94e-de9e-457f-b02d-7f5084c7618a tempest-VolumesListAdminTestJSON-1034833716 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:01:51.915494 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-073ec94e-de9e-457f-b02d-7f5084c7618a tempest-VolumesListAdminTestJSON-1034833716 None] Deleted volume successfully. Feb 05 21:01:51.960261 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-073ec94e-de9e-457f-b02d-7f5084c7618a tempest-VolumesListAdminTestJSON-1034833716 None] Lock "b'cinder-4a040afa-76e3-41ac-b1a5-111d7aa13d66-delete_volume'" released by "delete_volume" :: held 1.058s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:01:52.006712 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-bb85d06b-b6b6-47b4-920d-60ca008cc4cb tempest-VolumesListAdminTestJSON-1776435567 None] Created reservations ['1e774fe9-83b1-4f13-94db-49c1ff9a5039', '70dc9ed0-afa1-411b-bf5f-10f4983e350e', '039d9ce3-a5e9-4916-93cf-678862bd045b', '6da8243c-79da-4076-ab79-f73e137bcf62'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:01:52.115747 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-bb85d06b-b6b6-47b4-920d-60ca008cc4cb tempest-VolumesListAdminTestJSON-1776435567 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:52.177818 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-bb85d06b-b6b6-47b4-920d-60ca008cc4cb tempest-VolumesListAdminTestJSON-1776435567 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:52.220200 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-bb85d06b-b6b6-47b4-920d-60ca008cc4cb tempest-VolumesListAdminTestJSON-1776435567 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:01:52.227217 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-bb85d06b-b6b6-47b4-920d-60ca008cc4cb tempest-VolumesListAdminTestJSON-1776435567 None] Deleted volume successfully. Feb 05 21:01:52.257664 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-bb85d06b-b6b6-47b4-920d-60ca008cc4cb tempest-VolumesListAdminTestJSON-1776435567 None] Lock "b'cinder-36d8374d-7d05-4243-978d-5ce0b793d168-delete_volume'" released by "delete_volume" :: held 1.123s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:01:52.288403 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-1bc1fc9d-c3e9-47a5-abeb-a5524da340a4 tempest-VolumesListAdminTestJSON-1776435567 None] Lock "b'cinder-f3c079e2-4b9b-45f5-ac7c-00decf4e6c59-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:01:52.359548 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1bc1fc9d-c3e9-47a5-abeb-a5524da340a4 tempest-VolumesListAdminTestJSON-1776435567 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:52.442445 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1bc1fc9d-c3e9-47a5-abeb-a5524da340a4 tempest-VolumesListAdminTestJSON-1776435567 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:01:52.444181 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1bc1fc9d-c3e9-47a5-abeb-a5524da340a4 tempest-VolumesListAdminTestJSON-1776435567 None] Volume volume-f3c079e2-4b9b-45f5-ac7c-00decf4e6c59 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:01:52.464484 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1bc1fc9d-c3e9-47a5-abeb-a5524da340a4 tempest-VolumesListAdminTestJSON-1776435567 None] deleting rbd volume volume-f3c079e2-4b9b-45f5-ac7c-00decf4e6c59 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:01:52.576276 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:01:52.578052 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:52.633298 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:52.727948 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:01:53.006296 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-1bc1fc9d-c3e9-47a5-abeb-a5524da340a4 tempest-VolumesListAdminTestJSON-1776435567 None] Created reservations ['db1851df-8792-4d96-ba07-b895783bd143', 'b0d797ea-88ab-41d5-904c-359b6996b485', '7eaf6d60-539e-4384-beaf-c0c97a7b964f', '12bb848e-cf25-4849-8aff-92b2439b4474'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:01:53.077834 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1bc1fc9d-c3e9-47a5-abeb-a5524da340a4 tempest-VolumesListAdminTestJSON-1776435567 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:53.138278 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1bc1fc9d-c3e9-47a5-abeb-a5524da340a4 tempest-VolumesListAdminTestJSON-1776435567 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:53.194014 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-1bc1fc9d-c3e9-47a5-abeb-a5524da340a4 tempest-VolumesListAdminTestJSON-1776435567 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:01:53.198235 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-1bc1fc9d-c3e9-47a5-abeb-a5524da340a4 tempest-VolumesListAdminTestJSON-1776435567 None] Deleted volume successfully. Feb 05 21:01:53.216192 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-1bc1fc9d-c3e9-47a5-abeb-a5524da340a4 tempest-VolumesListAdminTestJSON-1776435567 None] Lock "b'cinder-f3c079e2-4b9b-45f5-ac7c-00decf4e6c59-delete_volume'" released by "delete_volume" :: held 0.930s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:01:53.468529 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-df075c10-96ea-4c50-8c2a-32cee8b74cdd tempest-VolumesListAdminTestJSON-1776435567 None] Lock "b'cinder-65240681-3bc7-48e1-a3fb-ddfeef541fe1-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:01:53.519522 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-df075c10-96ea-4c50-8c2a-32cee8b74cdd tempest-VolumesListAdminTestJSON-1776435567 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:53.603448 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-df075c10-96ea-4c50-8c2a-32cee8b74cdd tempest-VolumesListAdminTestJSON-1776435567 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:01:53.603888 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-df075c10-96ea-4c50-8c2a-32cee8b74cdd tempest-VolumesListAdminTestJSON-1776435567 None] Volume volume-65240681-3bc7-48e1-a3fb-ddfeef541fe1 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:01:53.615780 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-df075c10-96ea-4c50-8c2a-32cee8b74cdd tempest-VolumesListAdminTestJSON-1776435567 None] deleting rbd volume volume-65240681-3bc7-48e1-a3fb-ddfeef541fe1 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:01:54.011179 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-df075c10-96ea-4c50-8c2a-32cee8b74cdd tempest-VolumesListAdminTestJSON-1776435567 None] Created reservations ['96056e9d-2684-4655-8bd4-f8eca4cdf42d', 'bf4f660a-79a4-41ae-b5b7-1285fe7ecfc3', '22092e23-2bde-43b8-9873-d667da9758a3', '7ba9b347-12d3-4d67-afe9-846af3cda286'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:01:54.096589 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-df075c10-96ea-4c50-8c2a-32cee8b74cdd tempest-VolumesListAdminTestJSON-1776435567 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:54.163092 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-df075c10-96ea-4c50-8c2a-32cee8b74cdd tempest-VolumesListAdminTestJSON-1776435567 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:54.240160 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-df075c10-96ea-4c50-8c2a-32cee8b74cdd tempest-VolumesListAdminTestJSON-1776435567 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:01:54.244518 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-df075c10-96ea-4c50-8c2a-32cee8b74cdd tempest-VolumesListAdminTestJSON-1776435567 None] Deleted volume successfully. Feb 05 21:01:54.264904 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-df075c10-96ea-4c50-8c2a-32cee8b74cdd tempest-VolumesListAdminTestJSON-1776435567 None] Lock "b'cinder-65240681-3bc7-48e1-a3fb-ddfeef541fe1-delete_volume'" released by "delete_volume" :: held 0.797s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:01:56.159027 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-927f49f8-3ffe-47a6-b983-9c30a65134e0 tempest-VolumesDeleteCascade-766063424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:01:56.165297 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-927f49f8-3ffe-47a6-b983-9c30a65134e0 tempest-VolumesDeleteCascade-766063424 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:01:56.166138 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-927f49f8-3ffe-47a6-b983-9c30a65134e0 tempest-VolumesDeleteCascade-766063424 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:01:56.214672 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-927f49f8-3ffe-47a6-b983-9c30a65134e0 tempest-VolumesDeleteCascade-766063424 None] Flow 'volume_create_manager' (7718897c-49db-4a8a-8565-e429efd15149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:01:56.229591 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-927f49f8-3ffe-47a6-b983-9c30a65134e0 tempest-VolumesDeleteCascade-766063424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4b1079a-46d6-4cbf-91da-58a9fa97465d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:56.237309 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-927f49f8-3ffe-47a6-b983-9c30a65134e0 tempest-VolumesDeleteCascade-766063424 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:01:56.254959 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-927f49f8-3ffe-47a6-b983-9c30a65134e0 tempest-VolumesDeleteCascade-766063424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4b1079a-46d6-4cbf-91da-58a9fa97465d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-307123139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=114b30c6-4487-474d-88e4-421760d9d2ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0d012d788d14255b07e89902627404f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:01:56Z,use_quota=True,user_id='88d18c0b0b41440d833fa0dd97a5ccc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:56.262708 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-927f49f8-3ffe-47a6-b983-9c30a65134e0 tempest-VolumesDeleteCascade-766063424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caebdd9a-2c1c-455b-b9ef-bc4befef0071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:56.268104 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-927f49f8-3ffe-47a6-b983-9c30a65134e0 tempest-VolumesDeleteCascade-766063424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caebdd9a-2c1c-455b-b9ef-bc4befef0071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:56.274471 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-927f49f8-3ffe-47a6-b983-9c30a65134e0 tempest-VolumesDeleteCascade-766063424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0c91162-7cf7-4c22-8bcf-fbd3f8a552d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:56.281556 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-927f49f8-3ffe-47a6-b983-9c30a65134e0 tempest-VolumesDeleteCascade-766063424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0c91162-7cf7-4c22-8bcf-fbd3f8a552d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '114b30c6-4487-474d-88e4-421760d9d2ae', 'volume_name': 'volume-114b30c6-4487-474d-88e4-421760d9d2ae', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:56.289347 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-927f49f8-3ffe-47a6-b983-9c30a65134e0 tempest-VolumesDeleteCascade-766063424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f4b8135-5dd2-45cd-be67-5eea8cb7cf02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:56.295056 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-927f49f8-3ffe-47a6-b983-9c30a65134e0 tempest-VolumesDeleteCascade-766063424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f4b8135-5dd2-45cd-be67-5eea8cb7cf02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:56.302818 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-927f49f8-3ffe-47a6-b983-9c30a65134e0 tempest-VolumesDeleteCascade-766063424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (617cea62-0dd0-41ff-ad74-d3f6b661b0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:56.304429 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-927f49f8-3ffe-47a6-b983-9c30a65134e0 tempest-VolumesDeleteCascade-766063424 None] Volume 114b30c6-4487-474d-88e4-421760d9d2ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-114b30c6-4487-474d-88e4-421760d9d2ae', 'volume_size': 1} Feb 05 21:01:56.305023 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-927f49f8-3ffe-47a6-b983-9c30a65134e0 tempest-VolumesDeleteCascade-766063424 None] creating volume 'volume-114b30c6-4487-474d-88e4-421760d9d2ae' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:01:56.306402 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-927f49f8-3ffe-47a6-b983-9c30a65134e0 tempest-VolumesDeleteCascade-766063424 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:56.447735 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-927f49f8-3ffe-47a6-b983-9c30a65134e0 tempest-VolumesDeleteCascade-766063424 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:01:56.448037 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-927f49f8-3ffe-47a6-b983-9c30a65134e0 tempest-VolumesDeleteCascade-766063424 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:01:56.452688 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-927f49f8-3ffe-47a6-b983-9c30a65134e0 tempest-VolumesDeleteCascade-766063424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (617cea62-0dd0-41ff-ad74-d3f6b661b0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-114b30c6-4487-474d-88e4-421760d9d2ae', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:56.462147 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-927f49f8-3ffe-47a6-b983-9c30a65134e0 tempest-VolumesDeleteCascade-766063424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf369112-1bc2-4b36-a50b-a9f5dbfa24ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:01:56.492918 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-927f49f8-3ffe-47a6-b983-9c30a65134e0 tempest-VolumesDeleteCascade-766063424 None] Volume volume-114b30c6-4487-474d-88e4-421760d9d2ae (114b30c6-4487-474d-88e4-421760d9d2ae): created successfully Feb 05 21:01:56.507077 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-927f49f8-3ffe-47a6-b983-9c30a65134e0 tempest-VolumesDeleteCascade-766063424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf369112-1bc2-4b36-a50b-a9f5dbfa24ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:01:56.533300 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-927f49f8-3ffe-47a6-b983-9c30a65134e0 tempest-VolumesDeleteCascade-766063424 None] Flow 'volume_create_manager' (7718897c-49db-4a8a-8565-e429efd15149) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:01:56.577929 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-927f49f8-3ffe-47a6-b983-9c30a65134e0 tempest-VolumesDeleteCascade-766063424 None] Created volume successfully. Feb 05 21:01:57.529515 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-413dc118-5bf3-4c7a-a4ba-9b6ff2caa31a tempest-VolumesDeleteCascade-766063424 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:01:58.808057 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-413dc118-5bf3-4c7a-a4ba-9b6ff2caa31a tempest-VolumesDeleteCascade-766063424 None] Create snapshot completed successfully Feb 05 21:01:59.957162 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3bde9d9f-eeeb-481e-830f-87b88975c484 tempest-VolumesDeleteCascade-766063424 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:02:00.856915 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-3bde9d9f-eeeb-481e-830f-87b88975c484 tempest-VolumesDeleteCascade-766063424 None] Create snapshot completed successfully Feb 05 21:02:01.156691 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-18987048-d7c9-4fc0-a90d-51b17d037d68 tempest-VolumesDeleteCascade-766063424 None] Lock "b'cinder-114b30c6-4487-474d-88e4-421760d9d2ae-delete_volume'" acquired by "delete_volume" :: waited 0.040s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:02:01.229161 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-18987048-d7c9-4fc0-a90d-51b17d037d68 tempest-VolumesDeleteCascade-766063424 None] Performing cascade delete. {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/manager.py:959}} Feb 05 21:02:01.259765 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-18987048-d7c9-4fc0-a90d-51b17d037d68 tempest-VolumesDeleteCascade-766063424 None] Lock "b'cinder-a89541d5-38a4-4fc1-ae42-7b2cc0f11779-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.017s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:02:01.286854 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-18987048-d7c9-4fc0-a90d-51b17d037d68 tempest-VolumesDeleteCascade-766063424 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:02:01.956241 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-18987048-d7c9-4fc0-a90d-51b17d037d68 tempest-VolumesDeleteCascade-766063424 None] Created reservations ['a369ae37-b792-4a68-8389-a14beb0907a3', 'b14bd2df-09ff-41c9-ade7-eaa0b99b470a', '09336cc2-5fe8-44fe-ac21-f35d48cb534b', 'f9ceefe0-4e8c-43df-be9b-0b53597976e8'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:02:02.005842 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-18987048-d7c9-4fc0-a90d-51b17d037d68 tempest-VolumesDeleteCascade-766063424 None] Delete snapshot completed successfully. Feb 05 21:02:02.020465 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-18987048-d7c9-4fc0-a90d-51b17d037d68 tempest-VolumesDeleteCascade-766063424 None] Lock "b'cinder-a89541d5-38a4-4fc1-ae42-7b2cc0f11779-delete_snapshot'" released by "delete_snapshot" :: held 0.761s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:02:02.035354 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-18987048-d7c9-4fc0-a90d-51b17d037d68 tempest-VolumesDeleteCascade-766063424 None] Lock "b'cinder-afaa60ba-94e5-470b-b27d-4282d392d549-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:02:02.056252 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-18987048-d7c9-4fc0-a90d-51b17d037d68 tempest-VolumesDeleteCascade-766063424 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:02:02.916447 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-daccc11b-075c-437b-bbb5-f96c38eb303e tempest-VolumesTransfersV355Test-193268592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:02:02.920519 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-daccc11b-075c-437b-bbb5-f96c38eb303e tempest-VolumesTransfersV355Test-193268592 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:02:02.920967 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-daccc11b-075c-437b-bbb5-f96c38eb303e tempest-VolumesTransfersV355Test-193268592 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:02:02.946211 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-daccc11b-075c-437b-bbb5-f96c38eb303e tempest-VolumesTransfersV355Test-193268592 None] Flow 'volume_create_manager' (b7d9333d-84da-4737-bc12-b2b3504c10b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:02:02.954099 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-daccc11b-075c-437b-bbb5-f96c38eb303e tempest-VolumesTransfersV355Test-193268592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01b3838a-e0b7-4a3b-bccd-ec97f50bba80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:02:02.963170 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-18987048-d7c9-4fc0-a90d-51b17d037d68 tempest-VolumesDeleteCascade-766063424 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:02:03.000811 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-18987048-d7c9-4fc0-a90d-51b17d037d68 tempest-VolumesDeleteCascade-766063424 None] Created reservations ['6ebcff6a-a4ae-4155-aa30-f36e188dc602', '32d96f01-4f72-4a94-9267-cef4ae57d622', '10c91153-aead-4490-8a92-97575de950cd', '44a78df9-cd04-458b-aac8-a345aa7ea709'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:02:03.012936 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-daccc11b-075c-437b-bbb5-f96c38eb303e tempest-VolumesTransfersV355Test-193268592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01b3838a-e0b7-4a3b-bccd-ec97f50bba80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-151267279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=592de46e-a4c0-47bb-99be-315094b9656b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9962ee67652b4b04918c6741020b8e2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:02:03Z,use_quota=True,user_id='a1d5ce7397b646439c2e785e8eefa6ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:02:03.018919 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-daccc11b-075c-437b-bbb5-f96c38eb303e tempest-VolumesTransfersV355Test-193268592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b85a33c-5b64-40ce-9420-3e7b55db7bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:02:03.024200 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-daccc11b-075c-437b-bbb5-f96c38eb303e tempest-VolumesTransfersV355Test-193268592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b85a33c-5b64-40ce-9420-3e7b55db7bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:02:03.030329 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-daccc11b-075c-437b-bbb5-f96c38eb303e tempest-VolumesTransfersV355Test-193268592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef39cdca-4483-41d6-86ed-2a2e54d98942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:02:03.035125 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-daccc11b-075c-437b-bbb5-f96c38eb303e tempest-VolumesTransfersV355Test-193268592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef39cdca-4483-41d6-86ed-2a2e54d98942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '592de46e-a4c0-47bb-99be-315094b9656b', 'volume_name': 'volume-592de46e-a4c0-47bb-99be-315094b9656b', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:02:03.040370 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-daccc11b-075c-437b-bbb5-f96c38eb303e tempest-VolumesTransfersV355Test-193268592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a1d8019-e796-4266-9714-73cad35410d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:02:03.045703 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-daccc11b-075c-437b-bbb5-f96c38eb303e tempest-VolumesTransfersV355Test-193268592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a1d8019-e796-4266-9714-73cad35410d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:02:03.050660 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-daccc11b-075c-437b-bbb5-f96c38eb303e tempest-VolumesTransfersV355Test-193268592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fb5f008-521f-4e56-af45-a9045e2d262d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:02:03.052403 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-daccc11b-075c-437b-bbb5-f96c38eb303e tempest-VolumesTransfersV355Test-193268592 None] Volume 592de46e-a4c0-47bb-99be-315094b9656b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-592de46e-a4c0-47bb-99be-315094b9656b', 'volume_size': 1} Feb 05 21:02:03.053348 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-daccc11b-075c-437b-bbb5-f96c38eb303e tempest-VolumesTransfersV355Test-193268592 None] creating volume 'volume-592de46e-a4c0-47bb-99be-315094b9656b' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:02:03.054284 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-daccc11b-075c-437b-bbb5-f96c38eb303e tempest-VolumesTransfersV355Test-193268592 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:02:03.145554 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-daccc11b-075c-437b-bbb5-f96c38eb303e tempest-VolumesTransfersV355Test-193268592 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:02:03.146171 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-daccc11b-075c-437b-bbb5-f96c38eb303e tempest-VolumesTransfersV355Test-193268592 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:02:03.153495 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-daccc11b-075c-437b-bbb5-f96c38eb303e tempest-VolumesTransfersV355Test-193268592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fb5f008-521f-4e56-af45-a9045e2d262d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-592de46e-a4c0-47bb-99be-315094b9656b', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:02:03.158828 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-daccc11b-075c-437b-bbb5-f96c38eb303e tempest-VolumesTransfersV355Test-193268592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2849d508-3770-492e-b703-30e54406ca06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:02:03.170834 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-18987048-d7c9-4fc0-a90d-51b17d037d68 tempest-VolumesDeleteCascade-766063424 None] Delete snapshot completed successfully. Feb 05 21:02:03.177479 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-18987048-d7c9-4fc0-a90d-51b17d037d68 tempest-VolumesDeleteCascade-766063424 None] Lock "b'cinder-afaa60ba-94e5-470b-b27d-4282d392d549-delete_snapshot'" released by "delete_snapshot" :: held 1.142s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:02:03.178417 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-18987048-d7c9-4fc0-a90d-51b17d037d68 tempest-VolumesDeleteCascade-766063424 None] Snapshots deleted, issuing volume delete {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/manager.py:974}} Feb 05 21:02:03.179256 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-18987048-d7c9-4fc0-a90d-51b17d037d68 tempest-VolumesDeleteCascade-766063424 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:02:03.249804 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-18987048-d7c9-4fc0-a90d-51b17d037d68 tempest-VolumesDeleteCascade-766063424 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:02:03.250429 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-18987048-d7c9-4fc0-a90d-51b17d037d68 tempest-VolumesDeleteCascade-766063424 None] Volume volume-114b30c6-4487-474d-88e4-421760d9d2ae is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:02:03.258601 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-18987048-d7c9-4fc0-a90d-51b17d037d68 tempest-VolumesDeleteCascade-766063424 None] deleting rbd volume volume-114b30c6-4487-474d-88e4-421760d9d2ae {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:02:03.259939 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-daccc11b-075c-437b-bbb5-f96c38eb303e tempest-VolumesTransfersV355Test-193268592 None] Volume volume-592de46e-a4c0-47bb-99be-315094b9656b (592de46e-a4c0-47bb-99be-315094b9656b): created successfully Feb 05 21:02:03.269981 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-daccc11b-075c-437b-bbb5-f96c38eb303e tempest-VolumesTransfersV355Test-193268592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2849d508-3770-492e-b703-30e54406ca06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:02:03.286332 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-daccc11b-075c-437b-bbb5-f96c38eb303e tempest-VolumesTransfersV355Test-193268592 None] Flow 'volume_create_manager' (b7d9333d-84da-4737-bc12-b2b3504c10b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:02:03.299180 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-daccc11b-075c-437b-bbb5-f96c38eb303e tempest-VolumesTransfersV355Test-193268592 None] Created volume successfully. Feb 05 21:02:03.619278 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-18987048-d7c9-4fc0-a90d-51b17d037d68 tempest-VolumesDeleteCascade-766063424 None] Created reservations ['8fe33d84-ae7a-4974-a1f6-c76b606d44f4', 'fd5fa21a-75d4-4475-8632-a3e430838776', '12bf9319-1959-4842-bf16-d2013d021d10', '4911aa56-2d2d-4a42-8e22-69b1ceb57129'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:02:03.737300 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-18987048-d7c9-4fc0-a90d-51b17d037d68 tempest-VolumesDeleteCascade-766063424 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:02:03.813352 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-18987048-d7c9-4fc0-a90d-51b17d037d68 tempest-VolumesDeleteCascade-766063424 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:02:03.877071 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-18987048-d7c9-4fc0-a90d-51b17d037d68 tempest-VolumesDeleteCascade-766063424 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:02:03.889498 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-18987048-d7c9-4fc0-a90d-51b17d037d68 tempest-VolumesDeleteCascade-766063424 None] Deleted volume successfully. Feb 05 21:02:03.908115 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-18987048-d7c9-4fc0-a90d-51b17d037d68 tempest-VolumesDeleteCascade-766063424 None] Lock "b'cinder-114b30c6-4487-474d-88e4-421760d9d2ae-delete_volume'" released by "delete_volume" :: held 2.751s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:02:04.834906 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-80ae51fd-2da2-4fcf-b056-30d1ade22c6f tempest-VolumesTransfersV355Test-721753002 None] Transfer volume completed successfully. Feb 05 21:02:05.529519 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-b3d41e19-c76d-4a04-87e3-56658769f9d4 tempest-VolumesTransfersV355Test-722250236 None] Lock "b'cinder-592de46e-a4c0-47bb-99be-315094b9656b-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:02:05.578113 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-b3d41e19-c76d-4a04-87e3-56658769f9d4 tempest-VolumesTransfersV355Test-722250236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:02:05.646170 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-b3d41e19-c76d-4a04-87e3-56658769f9d4 tempest-VolumesTransfersV355Test-722250236 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:02:05.646632 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-b3d41e19-c76d-4a04-87e3-56658769f9d4 tempest-VolumesTransfersV355Test-722250236 None] Volume volume-592de46e-a4c0-47bb-99be-315094b9656b is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:02:05.653884 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-b3d41e19-c76d-4a04-87e3-56658769f9d4 tempest-VolumesTransfersV355Test-722250236 None] deleting rbd volume volume-592de46e-a4c0-47bb-99be-315094b9656b {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:02:05.908918 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-b3d41e19-c76d-4a04-87e3-56658769f9d4 tempest-VolumesTransfersV355Test-722250236 None] Created reservations ['e345cd05-607b-4f69-85d4-7f49bdb09e99', 'bc47b6a4-7c76-4ac0-96ae-cd7d733e28cf', '9081c582-c001-41d1-a75a-8756744bf69b', '73c4bba6-3151-4450-8904-464a0e03a666'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:02:05.964576 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-b3d41e19-c76d-4a04-87e3-56658769f9d4 tempest-VolumesTransfersV355Test-722250236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:02:05.991993 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-b3d41e19-c76d-4a04-87e3-56658769f9d4 tempest-VolumesTransfersV355Test-722250236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:02:06.023820 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-b3d41e19-c76d-4a04-87e3-56658769f9d4 tempest-VolumesTransfersV355Test-722250236 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:02:06.029810 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-b3d41e19-c76d-4a04-87e3-56658769f9d4 tempest-VolumesTransfersV355Test-722250236 None] Deleted volume successfully. Feb 05 21:02:06.044185 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-b3d41e19-c76d-4a04-87e3-56658769f9d4 tempest-VolumesTransfersV355Test-722250236 None] Lock "b'cinder-592de46e-a4c0-47bb-99be-315094b9656b-delete_volume'" released by "delete_volume" :: held 0.514s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:02:07.140450 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-a81cf420-f8e3-4bbc-ba80-4c71fc2a59aa tempest-VolumesTransfersV355Test-193268592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:02:07.144051 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-a81cf420-f8e3-4bbc-ba80-4c71fc2a59aa tempest-VolumesTransfersV355Test-193268592 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:02:07.144653 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-a81cf420-f8e3-4bbc-ba80-4c71fc2a59aa tempest-VolumesTransfersV355Test-193268592 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:02:07.164496 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-a81cf420-f8e3-4bbc-ba80-4c71fc2a59aa tempest-VolumesTransfersV355Test-193268592 None] Flow 'volume_create_manager' (651d6ebc-374c-484f-bcbc-f53acd56caf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:02:07.172308 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-a81cf420-f8e3-4bbc-ba80-4c71fc2a59aa tempest-VolumesTransfersV355Test-193268592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe92f5c2-bda0-45a3-adb4-2328f5193486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:02:07.178965 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-a81cf420-f8e3-4bbc-ba80-4c71fc2a59aa tempest-VolumesTransfersV355Test-193268592 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:02:07.194189 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-a81cf420-f8e3-4bbc-ba80-4c71fc2a59aa tempest-VolumesTransfersV355Test-193268592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe92f5c2-bda0-45a3-adb4-2328f5193486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1171284200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=bc7ef117-e437-4cff-86c4-0e8f784c92db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9962ee67652b4b04918c6741020b8e2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:02:07Z,use_quota=True,user_id='a1d5ce7397b646439c2e785e8eefa6ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:02:07.199935 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-a81cf420-f8e3-4bbc-ba80-4c71fc2a59aa tempest-VolumesTransfersV355Test-193268592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbcd5868-b91f-46a3-9411-2635c85c55ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:02:07.204190 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-a81cf420-f8e3-4bbc-ba80-4c71fc2a59aa tempest-VolumesTransfersV355Test-193268592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbcd5868-b91f-46a3-9411-2635c85c55ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:02:07.209561 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-a81cf420-f8e3-4bbc-ba80-4c71fc2a59aa tempest-VolumesTransfersV355Test-193268592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4075e33e-472b-4f06-898f-7a71d145d99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:02:07.213869 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-a81cf420-f8e3-4bbc-ba80-4c71fc2a59aa tempest-VolumesTransfersV355Test-193268592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4075e33e-472b-4f06-898f-7a71d145d99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc7ef117-e437-4cff-86c4-0e8f784c92db', 'volume_name': 'volume-bc7ef117-e437-4cff-86c4-0e8f784c92db', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:02:07.219202 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-a81cf420-f8e3-4bbc-ba80-4c71fc2a59aa tempest-VolumesTransfersV355Test-193268592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (526ee252-1d26-4121-8854-f605f9eee7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:02:07.223474 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-a81cf420-f8e3-4bbc-ba80-4c71fc2a59aa tempest-VolumesTransfersV355Test-193268592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (526ee252-1d26-4121-8854-f605f9eee7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:02:07.228377 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-a81cf420-f8e3-4bbc-ba80-4c71fc2a59aa tempest-VolumesTransfersV355Test-193268592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (397fccf9-568d-419f-a3c8-53dba4e8b8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:02:07.229629 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-a81cf420-f8e3-4bbc-ba80-4c71fc2a59aa tempest-VolumesTransfersV355Test-193268592 None] Volume bc7ef117-e437-4cff-86c4-0e8f784c92db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc7ef117-e437-4cff-86c4-0e8f784c92db', 'volume_size': 1} Feb 05 21:02:07.230706 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-a81cf420-f8e3-4bbc-ba80-4c71fc2a59aa tempest-VolumesTransfersV355Test-193268592 None] creating volume 'volume-bc7ef117-e437-4cff-86c4-0e8f784c92db' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:02:07.231852 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-a81cf420-f8e3-4bbc-ba80-4c71fc2a59aa tempest-VolumesTransfersV355Test-193268592 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:02:07.290500 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-a81cf420-f8e3-4bbc-ba80-4c71fc2a59aa tempest-VolumesTransfersV355Test-193268592 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:02:07.290889 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-a81cf420-f8e3-4bbc-ba80-4c71fc2a59aa tempest-VolumesTransfersV355Test-193268592 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:02:07.295565 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-a81cf420-f8e3-4bbc-ba80-4c71fc2a59aa tempest-VolumesTransfersV355Test-193268592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (397fccf9-568d-419f-a3c8-53dba4e8b8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc7ef117-e437-4cff-86c4-0e8f784c92db', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:02:07.301396 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-a81cf420-f8e3-4bbc-ba80-4c71fc2a59aa tempest-VolumesTransfersV355Test-193268592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf2a5529-d1b2-4126-8d8e-2b2a178b843a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:02:07.311020 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-a81cf420-f8e3-4bbc-ba80-4c71fc2a59aa tempest-VolumesTransfersV355Test-193268592 None] Volume volume-bc7ef117-e437-4cff-86c4-0e8f784c92db (bc7ef117-e437-4cff-86c4-0e8f784c92db): created successfully Feb 05 21:02:07.314857 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-a81cf420-f8e3-4bbc-ba80-4c71fc2a59aa tempest-VolumesTransfersV355Test-193268592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf2a5529-d1b2-4126-8d8e-2b2a178b843a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:02:07.320741 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-a81cf420-f8e3-4bbc-ba80-4c71fc2a59aa tempest-VolumesTransfersV355Test-193268592 None] Flow 'volume_create_manager' (651d6ebc-374c-484f-bcbc-f53acd56caf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:02:07.331525 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-a81cf420-f8e3-4bbc-ba80-4c71fc2a59aa tempest-VolumesTransfersV355Test-193268592 None] Created volume successfully. Feb 05 21:02:08.928340 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-1532c5d6-d463-4c79-bc62-ca471e32628c tempest-VolumesListTestJSON-535292999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:02:08.973732 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-1532c5d6-d463-4c79-bc62-ca471e32628c tempest-VolumesListTestJSON-535292999 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:02:08.980390 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-1532c5d6-d463-4c79-bc62-ca471e32628c tempest-VolumesListTestJSON-535292999 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:02:09.063734 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1532c5d6-d463-4c79-bc62-ca471e32628c tempest-VolumesListTestJSON-535292999 None] Flow 'volume_create_manager' (230ebf45-fff3-47d3-8480-f7e6ba0e3d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:02:09.081752 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1532c5d6-d463-4c79-bc62-ca471e32628c tempest-VolumesListTestJSON-535292999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (609d1003-6857-42f5-b4d7-0d3b508943ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:02:09.102926 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-a7d4bbb2-be81-4614-97b5-0a26bfbfad75 tempest-VolumesTransfersV355Test-722250236 None] Lock "b'cinder-bc7ef117-e437-4cff-86c4-0e8f784c92db-delete_volume'" acquired by "delete_volume" :: waited 0.188s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:02:09.118789 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-a7d4bbb2-be81-4614-97b5-0a26bfbfad75 tempest-VolumesTransfersV355Test-722250236 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:02:09.189187 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-a7d4bbb2-be81-4614-97b5-0a26bfbfad75 tempest-VolumesTransfersV355Test-722250236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:02:09.323185 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-a7d4bbb2-be81-4614-97b5-0a26bfbfad75 tempest-VolumesTransfersV355Test-722250236 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:02:09.323185 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-a7d4bbb2-be81-4614-97b5-0a26bfbfad75 tempest-VolumesTransfersV355Test-722250236 None] Volume volume-bc7ef117-e437-4cff-86c4-0e8f784c92db is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:02:09.335749 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-a7d4bbb2-be81-4614-97b5-0a26bfbfad75 tempest-VolumesTransfersV355Test-722250236 None] deleting rbd volume volume-bc7ef117-e437-4cff-86c4-0e8f784c92db {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:02:09.385563 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1532c5d6-d463-4c79-bc62-ca471e32628c tempest-VolumesListTestJSON-535292999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (609d1003-6857-42f5-b4d7-0d3b508943ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:02:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-564794193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0af92a9e-46d2-4cfa-a786-79f620685be8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d39662ce89704b108f70b6896bc2c971',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:02:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:02:09Z,use_quota=True,user_id='a31151870a1e41d4ac4a7b0f6f487bcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:02:09.401595 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1532c5d6-d463-4c79-bc62-ca471e32628c tempest-VolumesListTestJSON-535292999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (549e72a4-557b-4f40-bc3a-8701a6ea88ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:02:09.419787 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1532c5d6-d463-4c79-bc62-ca471e32628c tempest-VolumesListTestJSON-535292999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (549e72a4-557b-4f40-bc3a-8701a6ea88ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:02:09.434095 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1532c5d6-d463-4c79-bc62-ca471e32628c tempest-VolumesListTestJSON-535292999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adc3271d-07a5-451d-9b4a-61582775347e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:02:09.447899 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1532c5d6-d463-4c79-bc62-ca471e32628c tempest-VolumesListTestJSON-535292999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adc3271d-07a5-451d-9b4a-61582775347e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0af92a9e-46d2-4cfa-a786-79f620685be8', 'volume_name': 'volume-0af92a9e-46d2-4cfa-a786-79f620685be8', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:02:09.478339 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1532c5d6-d463-4c79-bc62-ca471e32628c tempest-VolumesListTestJSON-535292999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04b5ead4-4ee6-4274-83c5-7bb120c011b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:02:09.497775 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1532c5d6-d463-4c79-bc62-ca471e32628c tempest-VolumesListTestJSON-535292999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04b5ead4-4ee6-4274-83c5-7bb120c011b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:02:09.503345 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1532c5d6-d463-4c79-bc62-ca471e32628c tempest-VolumesListTestJSON-535292999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e6cc2f1-d39f-416f-9e4b-68d97a69dadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:02:09.515289 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-1532c5d6-d463-4c79-bc62-ca471e32628c tempest-VolumesListTestJSON-535292999 None] Volume 0af92a9e-46d2-4cfa-a786-79f620685be8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0af92a9e-46d2-4cfa-a786-79f620685be8', 'volume_size': 1} Feb 05 21:02:09.516759 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1532c5d6-d463-4c79-bc62-ca471e32628c tempest-VolumesListTestJSON-535292999 None] creating volume 'volume-0af92a9e-46d2-4cfa-a786-79f620685be8' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:02:09.517620 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1532c5d6-d463-4c79-bc62-ca471e32628c tempest-VolumesListTestJSON-535292999 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:02:09.678820 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1532c5d6-d463-4c79-bc62-ca471e32628c tempest-VolumesListTestJSON-535292999 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:02:09.679279 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1532c5d6-d463-4c79-bc62-ca471e32628c tempest-VolumesListTestJSON-535292999 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:02:09.684015 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1532c5d6-d463-4c79-bc62-ca471e32628c tempest-VolumesListTestJSON-535292999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e6cc2f1-d39f-416f-9e4b-68d97a69dadf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0af92a9e-46d2-4cfa-a786-79f620685be8', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:02:09.688851 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1532c5d6-d463-4c79-bc62-ca471e32628c tempest-VolumesListTestJSON-535292999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37ac8443-13d6-4df5-8952-9d44d378d423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:02:09.718130 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-1532c5d6-d463-4c79-bc62-ca471e32628c tempest-VolumesListTestJSON-535292999 None] Volume volume-0af92a9e-46d2-4cfa-a786-79f620685be8 (0af92a9e-46d2-4cfa-a786-79f620685be8): created successfully Feb 05 21:02:09.727065 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1532c5d6-d463-4c79-bc62-ca471e32628c tempest-VolumesListTestJSON-535292999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37ac8443-13d6-4df5-8952-9d44d378d423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:02:09.733124 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1532c5d6-d463-4c79-bc62-ca471e32628c tempest-VolumesListTestJSON-535292999 None] Flow 'volume_create_manager' (230ebf45-fff3-47d3-8480-f7e6ba0e3d86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:02:09.767161 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-1532c5d6-d463-4c79-bc62-ca471e32628c tempest-VolumesListTestJSON-535292999 None] Created volume successfully. Feb 05 21:02:09.929817 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-a7d4bbb2-be81-4614-97b5-0a26bfbfad75 tempest-VolumesTransfersV355Test-722250236 None] Created reservations ['c49a6c55-5f02-4a97-ba1d-a3998b456885', 'd30708dd-a92b-430b-ab69-c894dea983c9', '2db6c69b-3b51-447f-9364-1564b0c51947', 'fd36bf6a-17e5-4eca-97da-10cb31adfdbf'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:02:10.062874 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-a7d4bbb2-be81-4614-97b5-0a26bfbfad75 tempest-VolumesTransfersV355Test-722250236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:02:10.158022 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-a7d4bbb2-be81-4614-97b5-0a26bfbfad75 tempest-VolumesTransfersV355Test-722250236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:02:10.236623 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-a7d4bbb2-be81-4614-97b5-0a26bfbfad75 tempest-VolumesTransfersV355Test-722250236 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:02:10.245685 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-a7d4bbb2-be81-4614-97b5-0a26bfbfad75 tempest-VolumesTransfersV355Test-722250236 None] Deleted volume successfully. Feb 05 21:02:10.270650 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-a7d4bbb2-be81-4614-97b5-0a26bfbfad75 tempest-VolumesTransfersV355Test-722250236 None] Lock "b'cinder-bc7ef117-e437-4cff-86c4-0e8f784c92db-delete_volume'" released by "delete_volume" :: held 1.168s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:02:10.744978 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdf24b9c-b7f7-4c44-823d-f6437aa8fabe tempest-VolumesListTestJSON-535292999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:02:10.761219 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-cdf24b9c-b7f7-4c44-823d-f6437aa8fabe tempest-VolumesListTestJSON-535292999 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:02:10.762515 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-cdf24b9c-b7f7-4c44-823d-f6437aa8fabe tempest-VolumesListTestJSON-535292999 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:02:10.812436 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-cdf24b9c-b7f7-4c44-823d-f6437aa8fabe tempest-VolumesListTestJSON-535292999 None] Flow 'volume_create_manager' (10ef0892-2b5d-4c68-9fd1-642f8f247f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:02:10.830982 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-cdf24b9c-b7f7-4c44-823d-f6437aa8fabe tempest-VolumesListTestJSON-535292999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e446136c-6ebb-43f0-b859-92afb2f80bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:02:10.863399 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-cdf24b9c-b7f7-4c44-823d-f6437aa8fabe tempest-VolumesListTestJSON-535292999 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:02:10.893331 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-cdf24b9c-b7f7-4c44-823d-f6437aa8fabe tempest-VolumesListTestJSON-535292999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e446136c-6ebb-43f0-b859-92afb2f80bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1274918434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=39a89c2c-5a59-42e0-a18b-62fc16944555,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d39662ce89704b108f70b6896bc2c971',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:02:11Z,use_quota=True,user_id='a31151870a1e41d4ac4a7b0f6f487bcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:02:10.900975 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-cdf24b9c-b7f7-4c44-823d-f6437aa8fabe tempest-VolumesListTestJSON-535292999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94ac8f89-2d33-46c3-a19e-b3f189c6b9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:02:10.906579 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-cdf24b9c-b7f7-4c44-823d-f6437aa8fabe tempest-VolumesListTestJSON-535292999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94ac8f89-2d33-46c3-a19e-b3f189c6b9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:02:10.916572 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-cdf24b9c-b7f7-4c44-823d-f6437aa8fabe tempest-VolumesListTestJSON-535292999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1234e16-448c-4b98-b28e-aa25b5b7d9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:02:10.925852 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-cdf24b9c-b7f7-4c44-823d-f6437aa8fabe tempest-VolumesListTestJSON-535292999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1234e16-448c-4b98-b28e-aa25b5b7d9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39a89c2c-5a59-42e0-a18b-62fc16944555', 'volume_name': 'volume-39a89c2c-5a59-42e0-a18b-62fc16944555', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:02:10.932456 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-cdf24b9c-b7f7-4c44-823d-f6437aa8fabe tempest-VolumesListTestJSON-535292999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3f4bfab-e873-4762-bce7-cd39ce453bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:02:10.938586 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-cdf24b9c-b7f7-4c44-823d-f6437aa8fabe tempest-VolumesListTestJSON-535292999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3f4bfab-e873-4762-bce7-cd39ce453bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:02:10.944531 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-cdf24b9c-b7f7-4c44-823d-f6437aa8fabe tempest-VolumesListTestJSON-535292999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f98f079-7348-48a3-8e05-b89aa17a7272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:02:10.946173 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-cdf24b9c-b7f7-4c44-823d-f6437aa8fabe tempest-VolumesListTestJSON-535292999 None] Volume 39a89c2c-5a59-42e0-a18b-62fc16944555: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39a89c2c-5a59-42e0-a18b-62fc16944555', 'volume_size': 1} Feb 05 21:02:10.946875 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-cdf24b9c-b7f7-4c44-823d-f6437aa8fabe tempest-VolumesListTestJSON-535292999 None] creating volume 'volume-39a89c2c-5a59-42e0-a18b-62fc16944555' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:02:10.948145 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-cdf24b9c-b7f7-4c44-823d-f6437aa8fabe tempest-VolumesListTestJSON-535292999 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:02:11.047402 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-cdf24b9c-b7f7-4c44-823d-f6437aa8fabe tempest-VolumesListTestJSON-535292999 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:02:11.047868 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-cdf24b9c-b7f7-4c44-823d-f6437aa8fabe tempest-VolumesListTestJSON-535292999 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:02:11.051745 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-cdf24b9c-b7f7-4c44-823d-f6437aa8fabe tempest-VolumesListTestJSON-535292999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f98f079-7348-48a3-8e05-b89aa17a7272) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39a89c2c-5a59-42e0-a18b-62fc16944555', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:02:11.059602 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-cdf24b9c-b7f7-4c44-823d-f6437aa8fabe tempest-VolumesListTestJSON-535292999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20ba7c8f-f811-4122-947d-b22a4e2e8764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:02:11.078333 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-cdf24b9c-b7f7-4c44-823d-f6437aa8fabe tempest-VolumesListTestJSON-535292999 None] Volume volume-39a89c2c-5a59-42e0-a18b-62fc16944555 (39a89c2c-5a59-42e0-a18b-62fc16944555): created successfully Feb 05 21:02:11.089122 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-cdf24b9c-b7f7-4c44-823d-f6437aa8fabe tempest-VolumesListTestJSON-535292999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20ba7c8f-f811-4122-947d-b22a4e2e8764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:02:11.100581 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-cdf24b9c-b7f7-4c44-823d-f6437aa8fabe tempest-VolumesListTestJSON-535292999 None] Flow 'volume_create_manager' (10ef0892-2b5d-4c68-9fd1-642f8f247f31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:02:11.116350 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-cdf24b9c-b7f7-4c44-823d-f6437aa8fabe tempest-VolumesListTestJSON-535292999 None] Created volume successfully. Feb 05 21:02:11.511473 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-a18d5aa6-5e4d-44bd-b246-85d618342475 req-54cb0ec8-fb70-487e-a544-14ed8f1e25e7 tempest-AttachVolumeTestJSON-2131176214 None] Terminate volume connection completed successfully. Feb 05 21:02:11.511887 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-a18d5aa6-5e4d-44bd-b246-85d618342475 req-54cb0ec8-fb70-487e-a544-14ed8f1e25e7 tempest-AttachVolumeTestJSON-2131176214 None] Deleting attachment 027c3063-3a3f-434f-a54c-6e6fe9c70dbd. {{(pid=122683) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 05 21:02:12.663258 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-404c40cc-34b7-451a-aaaf-03235532635f tempest-VolumesListTestJSON-535292999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:02:12.681339 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-404c40cc-34b7-451a-aaaf-03235532635f tempest-VolumesListTestJSON-535292999 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:02:12.685908 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-404c40cc-34b7-451a-aaaf-03235532635f tempest-VolumesListTestJSON-535292999 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:02:12.765749 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-404c40cc-34b7-451a-aaaf-03235532635f tempest-VolumesListTestJSON-535292999 None] Flow 'volume_create_manager' (6ce3d77b-ca71-41db-b56b-dc9bad21aaca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:02:12.783451 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-404c40cc-34b7-451a-aaaf-03235532635f tempest-VolumesListTestJSON-535292999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (846222f4-5a61-4885-a4a7-0bed4665a89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:02:12.809654 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-404c40cc-34b7-451a-aaaf-03235532635f tempest-VolumesListTestJSON-535292999 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:02:12.843552 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-404c40cc-34b7-451a-aaaf-03235532635f tempest-VolumesListTestJSON-535292999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (846222f4-5a61-4885-a4a7-0bed4665a89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:02:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-106835472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=48b00b7b-f2fc-43b6-aade-2ab9c0846123,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d39662ce89704b108f70b6896bc2c971',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:02:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:02:13Z,use_quota=True,user_id='a31151870a1e41d4ac4a7b0f6f487bcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:02:12.854621 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-404c40cc-34b7-451a-aaaf-03235532635f tempest-VolumesListTestJSON-535292999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19d51d24-5675-4d59-b4b1-983f8db089af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:02:12.863397 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-404c40cc-34b7-451a-aaaf-03235532635f tempest-VolumesListTestJSON-535292999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19d51d24-5675-4d59-b4b1-983f8db089af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:02:12.869144 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-404c40cc-34b7-451a-aaaf-03235532635f tempest-VolumesListTestJSON-535292999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fc22cc6-5d43-44ae-ab52-69fedcf5cf46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:02:12.875738 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-404c40cc-34b7-451a-aaaf-03235532635f tempest-VolumesListTestJSON-535292999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fc22cc6-5d43-44ae-ab52-69fedcf5cf46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48b00b7b-f2fc-43b6-aade-2ab9c0846123', 'volume_name': 'volume-48b00b7b-f2fc-43b6-aade-2ab9c0846123', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:02:12.882428 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-404c40cc-34b7-451a-aaaf-03235532635f tempest-VolumesListTestJSON-535292999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b82e3242-b349-433c-a53b-e505411fe502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:02:12.887951 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-404c40cc-34b7-451a-aaaf-03235532635f tempest-VolumesListTestJSON-535292999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b82e3242-b349-433c-a53b-e505411fe502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:02:12.893497 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-404c40cc-34b7-451a-aaaf-03235532635f tempest-VolumesListTestJSON-535292999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d595f743-a171-46ee-a264-0cc20bb8f0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:02:12.894795 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-404c40cc-34b7-451a-aaaf-03235532635f tempest-VolumesListTestJSON-535292999 None] Volume 48b00b7b-f2fc-43b6-aade-2ab9c0846123: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48b00b7b-f2fc-43b6-aade-2ab9c0846123', 'volume_size': 1} Feb 05 21:02:12.895218 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-404c40cc-34b7-451a-aaaf-03235532635f tempest-VolumesListTestJSON-535292999 None] creating volume 'volume-48b00b7b-f2fc-43b6-aade-2ab9c0846123' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:02:12.896230 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-404c40cc-34b7-451a-aaaf-03235532635f tempest-VolumesListTestJSON-535292999 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:02:12.999871 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-404c40cc-34b7-451a-aaaf-03235532635f tempest-VolumesListTestJSON-535292999 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:02:13.000704 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-404c40cc-34b7-451a-aaaf-03235532635f tempest-VolumesListTestJSON-535292999 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:02:13.007676 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-404c40cc-34b7-451a-aaaf-03235532635f tempest-VolumesListTestJSON-535292999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d595f743-a171-46ee-a264-0cc20bb8f0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48b00b7b-f2fc-43b6-aade-2ab9c0846123', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:02:13.015500 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-404c40cc-34b7-451a-aaaf-03235532635f tempest-VolumesListTestJSON-535292999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08fc82db-234e-42f5-864f-a9aa2ac96c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:02:13.032537 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-404c40cc-34b7-451a-aaaf-03235532635f tempest-VolumesListTestJSON-535292999 None] Volume volume-48b00b7b-f2fc-43b6-aade-2ab9c0846123 (48b00b7b-f2fc-43b6-aade-2ab9c0846123): created successfully Feb 05 21:02:13.039599 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-404c40cc-34b7-451a-aaaf-03235532635f tempest-VolumesListTestJSON-535292999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08fc82db-234e-42f5-864f-a9aa2ac96c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:02:13.049233 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-404c40cc-34b7-451a-aaaf-03235532635f tempest-VolumesListTestJSON-535292999 None] Flow 'volume_create_manager' (6ce3d77b-ca71-41db-b56b-dc9bad21aaca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:02:13.064895 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-404c40cc-34b7-451a-aaaf-03235532635f tempest-VolumesListTestJSON-535292999 None] Created volume successfully. Feb 05 21:02:18.221246 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-0ed265a2-66c4-485d-84b1-5f8f412c0d9b tempest-VolumesListTestJSON-535292999 None] Lock "b'cinder-48b00b7b-f2fc-43b6-aade-2ab9c0846123-delete_volume'" acquired by "delete_volume" :: waited 0.027s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:02:18.319951 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-0ed265a2-66c4-485d-84b1-5f8f412c0d9b tempest-VolumesListTestJSON-535292999 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:02:18.416905 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-0ed265a2-66c4-485d-84b1-5f8f412c0d9b tempest-VolumesListTestJSON-535292999 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:02:18.418121 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-0ed265a2-66c4-485d-84b1-5f8f412c0d9b tempest-VolumesListTestJSON-535292999 None] Volume volume-48b00b7b-f2fc-43b6-aade-2ab9c0846123 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:02:18.431513 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-0ed265a2-66c4-485d-84b1-5f8f412c0d9b tempest-VolumesListTestJSON-535292999 None] deleting rbd volume volume-48b00b7b-f2fc-43b6-aade-2ab9c0846123 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:02:18.967667 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-0ed265a2-66c4-485d-84b1-5f8f412c0d9b tempest-VolumesListTestJSON-535292999 None] Created reservations ['dc2cb346-40af-4964-b1ed-d38f72625db1', '40478de3-26af-4666-a537-81a5148af456', '7239c363-7641-4c2f-9148-b8262733b771', '6b1e4e9d-e05c-42c1-88f3-c2469034eaf6'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:02:19.040115 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-0ed265a2-66c4-485d-84b1-5f8f412c0d9b tempest-VolumesListTestJSON-535292999 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:02:19.137250 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-0ed265a2-66c4-485d-84b1-5f8f412c0d9b tempest-VolumesListTestJSON-535292999 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:02:19.220895 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-0ed265a2-66c4-485d-84b1-5f8f412c0d9b tempest-VolumesListTestJSON-535292999 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:02:19.227351 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-0ed265a2-66c4-485d-84b1-5f8f412c0d9b tempest-VolumesListTestJSON-535292999 None] Deleted volume successfully. Feb 05 21:02:19.256661 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-0ed265a2-66c4-485d-84b1-5f8f412c0d9b tempest-VolumesListTestJSON-535292999 None] Lock "b'cinder-48b00b7b-f2fc-43b6-aade-2ab9c0846123-delete_volume'" released by "delete_volume" :: held 1.035s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:02:19.522290 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-257a3b4c-9ec5-434a-a943-3d8bea52290c tempest-VolumesListTestJSON-535292999 None] Lock "b'cinder-39a89c2c-5a59-42e0-a18b-62fc16944555-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:02:19.596631 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-257a3b4c-9ec5-434a-a943-3d8bea52290c tempest-VolumesListTestJSON-535292999 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:02:19.706461 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-257a3b4c-9ec5-434a-a943-3d8bea52290c tempest-VolumesListTestJSON-535292999 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:02:19.707749 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-257a3b4c-9ec5-434a-a943-3d8bea52290c tempest-VolumesListTestJSON-535292999 None] Volume volume-39a89c2c-5a59-42e0-a18b-62fc16944555 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:02:19.721649 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-257a3b4c-9ec5-434a-a943-3d8bea52290c tempest-VolumesListTestJSON-535292999 None] deleting rbd volume volume-39a89c2c-5a59-42e0-a18b-62fc16944555 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:02:20.167214 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-257a3b4c-9ec5-434a-a943-3d8bea52290c tempest-VolumesListTestJSON-535292999 None] Created reservations ['c935814c-aaeb-4c0c-acb5-e459cd32e4d2', 'd9dadb94-e5d6-4d28-b9fc-a9a097a8d5ad', '945c5da6-e1b6-4ecb-9e7f-624a8b749b33', 'bfd7d78b-4541-453d-a67e-c096d243fef0'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:02:20.255445 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-257a3b4c-9ec5-434a-a943-3d8bea52290c tempest-VolumesListTestJSON-535292999 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:02:20.315490 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-257a3b4c-9ec5-434a-a943-3d8bea52290c tempest-VolumesListTestJSON-535292999 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:02:20.393164 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-257a3b4c-9ec5-434a-a943-3d8bea52290c tempest-VolumesListTestJSON-535292999 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:02:20.397789 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-257a3b4c-9ec5-434a-a943-3d8bea52290c tempest-VolumesListTestJSON-535292999 None] Deleted volume successfully. Feb 05 21:02:20.416419 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-257a3b4c-9ec5-434a-a943-3d8bea52290c tempest-VolumesListTestJSON-535292999 None] Lock "b'cinder-39a89c2c-5a59-42e0-a18b-62fc16944555-delete_volume'" released by "delete_volume" :: held 0.894s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:02:20.809617 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-dab35ae7-135a-4bba-899a-0d9a89a735e5 tempest-VolumesListTestJSON-535292999 None] Lock "b'cinder-0af92a9e-46d2-4cfa-a786-79f620685be8-delete_volume'" acquired by "delete_volume" :: waited 0.033s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:02:20.907172 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-dab35ae7-135a-4bba-899a-0d9a89a735e5 tempest-VolumesListTestJSON-535292999 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:02:21.130681 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-dab35ae7-135a-4bba-899a-0d9a89a735e5 tempest-VolumesListTestJSON-535292999 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:02:21.131383 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-dab35ae7-135a-4bba-899a-0d9a89a735e5 tempest-VolumesListTestJSON-535292999 None] Volume volume-0af92a9e-46d2-4cfa-a786-79f620685be8 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:02:21.150472 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-dab35ae7-135a-4bba-899a-0d9a89a735e5 tempest-VolumesListTestJSON-535292999 None] deleting rbd volume volume-0af92a9e-46d2-4cfa-a786-79f620685be8 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:02:21.668140 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-dab35ae7-135a-4bba-899a-0d9a89a735e5 tempest-VolumesListTestJSON-535292999 None] Created reservations ['96e0ef19-6f20-462e-a632-785e6671c695', '7db7c994-1a9d-4777-80e6-e6c10b101aa2', '9a1a0806-7dbb-44dd-b819-2d2b0ef1f7b7', '543852f6-5717-4645-b8e7-bb1b2516a270'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:02:21.792855 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-dab35ae7-135a-4bba-899a-0d9a89a735e5 tempest-VolumesListTestJSON-535292999 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:02:21.856305 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-dab35ae7-135a-4bba-899a-0d9a89a735e5 tempest-VolumesListTestJSON-535292999 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:02:21.923490 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-dab35ae7-135a-4bba-899a-0d9a89a735e5 tempest-VolumesListTestJSON-535292999 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:02:21.929254 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-dab35ae7-135a-4bba-899a-0d9a89a735e5 tempest-VolumesListTestJSON-535292999 None] Deleted volume successfully. Feb 05 21:02:21.971776 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-dab35ae7-135a-4bba-899a-0d9a89a735e5 tempest-VolumesListTestJSON-535292999 None] Lock "b'cinder-0af92a9e-46d2-4cfa-a786-79f620685be8-delete_volume'" released by "delete_volume" :: held 1.162s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:02:52.574003 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:02:52.575570 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:02:52.651331 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:02:52.770702 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:03:52.569931 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:03:52.570786 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:03:52.627120 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:03:52.713971 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:03:58.961745 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-6941ef0d-6faa-41cd-aa59-08679a6281e9 tempest-AttachVolumeTestJSON-2131176214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:03:58.965768 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-6941ef0d-6faa-41cd-aa59-08679a6281e9 tempest-AttachVolumeTestJSON-2131176214 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:03:58.966341 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-6941ef0d-6faa-41cd-aa59-08679a6281e9 tempest-AttachVolumeTestJSON-2131176214 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:03:58.987182 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6941ef0d-6faa-41cd-aa59-08679a6281e9 tempest-AttachVolumeTestJSON-2131176214 None] Flow 'volume_create_manager' (c2543503-5235-4c72-8f7a-91b91a54da5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:03:58.995688 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6941ef0d-6faa-41cd-aa59-08679a6281e9 tempest-AttachVolumeTestJSON-2131176214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03297592-e7b8-4100-9c3f-9c40a24966e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:03:59.003016 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-6941ef0d-6faa-41cd-aa59-08679a6281e9 tempest-AttachVolumeTestJSON-2131176214 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:03:59.020140 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6941ef0d-6faa-41cd-aa59-08679a6281e9 tempest-AttachVolumeTestJSON-2131176214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03297592-e7b8-4100-9c3f-9c40a24966e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-911602745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=fcec885d-6024-46e4-ad8e-7932368f9e41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2211e554783435c9b7af885ea20e242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:03:59Z,use_quota=True,user_id='61514eb86ceb4233a4ee71650879a0e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:03:59.027363 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6941ef0d-6faa-41cd-aa59-08679a6281e9 tempest-AttachVolumeTestJSON-2131176214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab2f7c3f-bdc1-483a-a39e-1c2f06b54b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:03:59.032000 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6941ef0d-6faa-41cd-aa59-08679a6281e9 tempest-AttachVolumeTestJSON-2131176214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab2f7c3f-bdc1-483a-a39e-1c2f06b54b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:03:59.038018 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6941ef0d-6faa-41cd-aa59-08679a6281e9 tempest-AttachVolumeTestJSON-2131176214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6acdca3b-4805-4717-af1f-d0b5059d63f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:03:59.043847 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6941ef0d-6faa-41cd-aa59-08679a6281e9 tempest-AttachVolumeTestJSON-2131176214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6acdca3b-4805-4717-af1f-d0b5059d63f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcec885d-6024-46e4-ad8e-7932368f9e41', 'volume_name': 'volume-fcec885d-6024-46e4-ad8e-7932368f9e41', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:03:59.051340 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6941ef0d-6faa-41cd-aa59-08679a6281e9 tempest-AttachVolumeTestJSON-2131176214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86dbf067-8f42-4407-b992-4bd8e1b2ae5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:03:59.057575 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6941ef0d-6faa-41cd-aa59-08679a6281e9 tempest-AttachVolumeTestJSON-2131176214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86dbf067-8f42-4407-b992-4bd8e1b2ae5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:03:59.064175 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6941ef0d-6faa-41cd-aa59-08679a6281e9 tempest-AttachVolumeTestJSON-2131176214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32b9b37b-8058-4fea-9968-b37de70e2778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:03:59.065367 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-6941ef0d-6faa-41cd-aa59-08679a6281e9 tempest-AttachVolumeTestJSON-2131176214 None] Volume fcec885d-6024-46e4-ad8e-7932368f9e41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcec885d-6024-46e4-ad8e-7932368f9e41', 'volume_size': 1} Feb 05 21:03:59.066070 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6941ef0d-6faa-41cd-aa59-08679a6281e9 tempest-AttachVolumeTestJSON-2131176214 None] creating volume 'volume-fcec885d-6024-46e4-ad8e-7932368f9e41' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:03:59.067378 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6941ef0d-6faa-41cd-aa59-08679a6281e9 tempest-AttachVolumeTestJSON-2131176214 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:03:59.142462 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6941ef0d-6faa-41cd-aa59-08679a6281e9 tempest-AttachVolumeTestJSON-2131176214 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:03:59.143016 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6941ef0d-6faa-41cd-aa59-08679a6281e9 tempest-AttachVolumeTestJSON-2131176214 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:03:59.146881 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6941ef0d-6faa-41cd-aa59-08679a6281e9 tempest-AttachVolumeTestJSON-2131176214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32b9b37b-8058-4fea-9968-b37de70e2778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcec885d-6024-46e4-ad8e-7932368f9e41', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:03:59.153022 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6941ef0d-6faa-41cd-aa59-08679a6281e9 tempest-AttachVolumeTestJSON-2131176214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94911e56-6b56-4820-a68d-6a6cce638b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:03:59.163500 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-6941ef0d-6faa-41cd-aa59-08679a6281e9 tempest-AttachVolumeTestJSON-2131176214 None] Volume volume-fcec885d-6024-46e4-ad8e-7932368f9e41 (fcec885d-6024-46e4-ad8e-7932368f9e41): created successfully Feb 05 21:03:59.168166 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6941ef0d-6faa-41cd-aa59-08679a6281e9 tempest-AttachVolumeTestJSON-2131176214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94911e56-6b56-4820-a68d-6a6cce638b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:03:59.173940 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6941ef0d-6faa-41cd-aa59-08679a6281e9 tempest-AttachVolumeTestJSON-2131176214 None] Flow 'volume_create_manager' (c2543503-5235-4c72-8f7a-91b91a54da5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:03:59.185735 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-6941ef0d-6faa-41cd-aa59-08679a6281e9 tempest-AttachVolumeTestJSON-2131176214 None] Created volume successfully. Feb 05 21:04:00.698832 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-0cf4b70a-9ccc-4b2c-9335-6c01eb552d90 req-bf5332c8-0b76-4911-8ead-e4d57ad54141 tempest-AttachVolumeTestJSON-2131176214 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 21:04:01.770700 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-0cf4b70a-9ccc-4b2c-9335-6c01eb552d90 req-bf5332c8-0b76-4911-8ead-e4d57ad54141 tempest-AttachVolumeTestJSON-2131176214 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.071s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 21:04:01.771488 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-0cf4b70a-9ccc-4b2c-9335-6c01eb552d90 req-bf5332c8-0b76-4911-8ead-e4d57ad54141 tempest-AttachVolumeTestJSON-2131176214 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-fcec885d-6024-46e4-ad8e-7932368f9e41', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': 'fcec885d-6024-46e4-ad8e-7932368f9e41', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 21:04:01.842924 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-0cf4b70a-9ccc-4b2c-9335-6c01eb552d90 req-bf5332c8-0b76-4911-8ead-e4d57ad54141 tempest-AttachVolumeTestJSON-2131176214 None] Connection info returned from driver {'name': 'volumes/volume-fcec885d-6024-46e4-ad8e-7932368f9e41', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'fcec885d-6024-46e4-ad8e-7932368f9e41', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '2b0fe0ad-b96b-4e29-aeb5-0215a4226751'} {{(pid=122683) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 05 21:04:01.954102 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-0cf4b70a-9ccc-4b2c-9335-6c01eb552d90 req-bf5332c8-0b76-4911-8ead-e4d57ad54141 tempest-AttachVolumeTestJSON-2131176214 None] attachment_update completed successfully. Feb 05 21:04:04.858247 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb050e6c-67c6-48eb-ad58-50446c0a8db2 tempest-AttachVolumeTestJSON-2131176214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:04:04.864562 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-eb050e6c-67c6-48eb-ad58-50446c0a8db2 tempest-AttachVolumeTestJSON-2131176214 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:04:04.866157 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-eb050e6c-67c6-48eb-ad58-50446c0a8db2 tempest-AttachVolumeTestJSON-2131176214 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:04:04.895161 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-eb050e6c-67c6-48eb-ad58-50446c0a8db2 tempest-AttachVolumeTestJSON-2131176214 None] Flow 'volume_create_manager' (be7f4d99-d4af-4289-bac6-e3f742e38719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:04:04.904829 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-eb050e6c-67c6-48eb-ad58-50446c0a8db2 tempest-AttachVolumeTestJSON-2131176214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e36761c7-a14e-4ab4-8784-5259215bd8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:04:04.913003 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-eb050e6c-67c6-48eb-ad58-50446c0a8db2 tempest-AttachVolumeTestJSON-2131176214 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:04:04.935352 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-eb050e6c-67c6-48eb-ad58-50446c0a8db2 tempest-AttachVolumeTestJSON-2131176214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e36761c7-a14e-4ab4-8784-5259215bd8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-584015630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9e98f228-aabb-4246-a192-79a2c72db218,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2211e554783435c9b7af885ea20e242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:04:05Z,use_quota=True,user_id='61514eb86ceb4233a4ee71650879a0e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:04:04.943605 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-eb050e6c-67c6-48eb-ad58-50446c0a8db2 tempest-AttachVolumeTestJSON-2131176214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f817d807-78ef-498f-b90a-cd97cac8389c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:04:04.949859 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-eb050e6c-67c6-48eb-ad58-50446c0a8db2 tempest-AttachVolumeTestJSON-2131176214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f817d807-78ef-498f-b90a-cd97cac8389c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:04:04.955961 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-eb050e6c-67c6-48eb-ad58-50446c0a8db2 tempest-AttachVolumeTestJSON-2131176214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8094af0-538a-4974-ab3a-6ddf825e58ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:04:04.962122 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-eb050e6c-67c6-48eb-ad58-50446c0a8db2 tempest-AttachVolumeTestJSON-2131176214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8094af0-538a-4974-ab3a-6ddf825e58ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e98f228-aabb-4246-a192-79a2c72db218', 'volume_name': 'volume-9e98f228-aabb-4246-a192-79a2c72db218', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:04:04.969605 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-eb050e6c-67c6-48eb-ad58-50446c0a8db2 tempest-AttachVolumeTestJSON-2131176214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d020e46e-c41a-4b97-aab6-fd400bdb2fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:04:04.974475 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-eb050e6c-67c6-48eb-ad58-50446c0a8db2 tempest-AttachVolumeTestJSON-2131176214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d020e46e-c41a-4b97-aab6-fd400bdb2fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:04:04.982616 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-eb050e6c-67c6-48eb-ad58-50446c0a8db2 tempest-AttachVolumeTestJSON-2131176214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c82b9587-d74c-4f3a-8399-d7ba90cf74cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:04:04.984611 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-eb050e6c-67c6-48eb-ad58-50446c0a8db2 tempest-AttachVolumeTestJSON-2131176214 None] Volume 9e98f228-aabb-4246-a192-79a2c72db218: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e98f228-aabb-4246-a192-79a2c72db218', 'volume_size': 1} Feb 05 21:04:04.985217 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-eb050e6c-67c6-48eb-ad58-50446c0a8db2 tempest-AttachVolumeTestJSON-2131176214 None] creating volume 'volume-9e98f228-aabb-4246-a192-79a2c72db218' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:04:04.986578 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-eb050e6c-67c6-48eb-ad58-50446c0a8db2 tempest-AttachVolumeTestJSON-2131176214 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:04:05.095412 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-eb050e6c-67c6-48eb-ad58-50446c0a8db2 tempest-AttachVolumeTestJSON-2131176214 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:04:05.096309 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-eb050e6c-67c6-48eb-ad58-50446c0a8db2 tempest-AttachVolumeTestJSON-2131176214 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:04:05.102710 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-eb050e6c-67c6-48eb-ad58-50446c0a8db2 tempest-AttachVolumeTestJSON-2131176214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c82b9587-d74c-4f3a-8399-d7ba90cf74cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e98f228-aabb-4246-a192-79a2c72db218', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:04:05.120716 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-eb050e6c-67c6-48eb-ad58-50446c0a8db2 tempest-AttachVolumeTestJSON-2131176214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (766e2e67-26b8-42ed-a79e-645176944068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:04:05.136338 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-eb050e6c-67c6-48eb-ad58-50446c0a8db2 tempest-AttachVolumeTestJSON-2131176214 None] Volume volume-9e98f228-aabb-4246-a192-79a2c72db218 (9e98f228-aabb-4246-a192-79a2c72db218): created successfully Feb 05 21:04:05.141933 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-eb050e6c-67c6-48eb-ad58-50446c0a8db2 tempest-AttachVolumeTestJSON-2131176214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (766e2e67-26b8-42ed-a79e-645176944068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:04:05.149564 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-eb050e6c-67c6-48eb-ad58-50446c0a8db2 tempest-AttachVolumeTestJSON-2131176214 None] Flow 'volume_create_manager' (be7f4d99-d4af-4289-bac6-e3f742e38719) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:04:05.162828 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-eb050e6c-67c6-48eb-ad58-50446c0a8db2 tempest-AttachVolumeTestJSON-2131176214 None] Created volume successfully. Feb 05 21:04:06.594116 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-4882b173-08c0-4864-bb40-3a5c6711ec41 req-08eebb6f-88d8-4f84-b2f0-655b3833830c tempest-AttachVolumeTestJSON-2131176214 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 21:04:08.123979 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-4882b173-08c0-4864-bb40-3a5c6711ec41 req-08eebb6f-88d8-4f84-b2f0-655b3833830c tempest-AttachVolumeTestJSON-2131176214 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.527s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 21:04:08.127616 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-4882b173-08c0-4864-bb40-3a5c6711ec41 req-08eebb6f-88d8-4f84-b2f0-655b3833830c tempest-AttachVolumeTestJSON-2131176214 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9e98f228-aabb-4246-a192-79a2c72db218', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': '9e98f228-aabb-4246-a192-79a2c72db218', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 21:04:08.161291 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-4882b173-08c0-4864-bb40-3a5c6711ec41 req-08eebb6f-88d8-4f84-b2f0-655b3833830c tempest-AttachVolumeTestJSON-2131176214 None] Connection info returned from driver {'name': 'volumes/volume-9e98f228-aabb-4246-a192-79a2c72db218', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '9e98f228-aabb-4246-a192-79a2c72db218', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '5e971822-41c8-49fc-8bb9-a7ba8d4b01b3'} {{(pid=122683) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 05 21:04:08.309344 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-4882b173-08c0-4864-bb40-3a5c6711ec41 req-08eebb6f-88d8-4f84-b2f0-655b3833830c tempest-AttachVolumeTestJSON-2131176214 None] attachment_update completed successfully. Feb 05 21:04:24.875459 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-f4381898-1875-4f8e-b791-6a6b90026b6f req-2d96479d-3d2b-440d-8e3b-83746a323622 tempest-AttachVolumeTestJSON-2131176214 None] Terminate volume connection completed successfully. Feb 05 21:04:24.876166 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-f4381898-1875-4f8e-b791-6a6b90026b6f req-2d96479d-3d2b-440d-8e3b-83746a323622 tempest-AttachVolumeTestJSON-2131176214 None] Deleting attachment 2b0fe0ad-b96b-4e29-aeb5-0215a4226751. {{(pid=122683) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 05 21:04:26.679216 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-6734f119-b784-4652-90b6-e17455f05b21 req-6db2c2cb-9de4-49de-b3ae-6275ec05b647 tempest-AttachVolumeTestJSON-2131176214 None] Terminate volume connection completed successfully. Feb 05 21:04:26.681179 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-6734f119-b784-4652-90b6-e17455f05b21 req-6db2c2cb-9de4-49de-b3ae-6275ec05b647 tempest-AttachVolumeTestJSON-2131176214 None] Deleting attachment 5e971822-41c8-49fc-8bb9-a7ba8d4b01b3. {{(pid=122683) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 05 21:04:38.663108 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-23be2dca-04cc-4755-815f-56797655cde5 tempest-AttachVolumeTestJSON-2131176214 None] Lock "b'cinder-9e98f228-aabb-4246-a192-79a2c72db218-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:04:38.747755 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-23be2dca-04cc-4755-815f-56797655cde5 tempest-AttachVolumeTestJSON-2131176214 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:04:38.831947 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-23be2dca-04cc-4755-815f-56797655cde5 tempest-AttachVolumeTestJSON-2131176214 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:04:38.832486 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-23be2dca-04cc-4755-815f-56797655cde5 tempest-AttachVolumeTestJSON-2131176214 None] Volume volume-9e98f228-aabb-4246-a192-79a2c72db218 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:04:38.848503 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-23be2dca-04cc-4755-815f-56797655cde5 tempest-AttachVolumeTestJSON-2131176214 None] deleting rbd volume volume-9e98f228-aabb-4246-a192-79a2c72db218 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:04:39.402028 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-23be2dca-04cc-4755-815f-56797655cde5 tempest-AttachVolumeTestJSON-2131176214 None] Created reservations ['72d48364-17bc-4ac4-9e00-7a6dcb52e6a2', '2351c383-c38b-437f-9873-ee49c7471dcc', '39f10684-9141-434a-ac61-90c5be21706b', '5ea2ab87-ccd4-4d84-8892-de6511164237'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:04:39.496684 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-23be2dca-04cc-4755-815f-56797655cde5 tempest-AttachVolumeTestJSON-2131176214 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:04:39.564949 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-23be2dca-04cc-4755-815f-56797655cde5 tempest-AttachVolumeTestJSON-2131176214 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:04:39.672220 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-23be2dca-04cc-4755-815f-56797655cde5 tempest-AttachVolumeTestJSON-2131176214 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:04:39.686849 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-23be2dca-04cc-4755-815f-56797655cde5 tempest-AttachVolumeTestJSON-2131176214 None] Deleted volume successfully. Feb 05 21:04:39.717153 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-23be2dca-04cc-4755-815f-56797655cde5 tempest-AttachVolumeTestJSON-2131176214 None] Lock "b'cinder-9e98f228-aabb-4246-a192-79a2c72db218-delete_volume'" released by "delete_volume" :: held 1.054s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:04:39.972481 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-a2233d0d-16db-4374-b0c6-5caff2c18d0e tempest-AttachVolumeTestJSON-2131176214 None] Lock "b'cinder-fcec885d-6024-46e4-ad8e-7932368f9e41-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:04:40.108112 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-a2233d0d-16db-4374-b0c6-5caff2c18d0e tempest-AttachVolumeTestJSON-2131176214 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:04:40.229386 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-a2233d0d-16db-4374-b0c6-5caff2c18d0e tempest-AttachVolumeTestJSON-2131176214 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:04:40.229810 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-a2233d0d-16db-4374-b0c6-5caff2c18d0e tempest-AttachVolumeTestJSON-2131176214 None] Volume volume-fcec885d-6024-46e4-ad8e-7932368f9e41 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:04:40.254823 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-a2233d0d-16db-4374-b0c6-5caff2c18d0e tempest-AttachVolumeTestJSON-2131176214 None] deleting rbd volume volume-fcec885d-6024-46e4-ad8e-7932368f9e41 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:04:40.803784 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-748f9642-20ef-40f5-a9a7-9c79aa58bd75 tempest-TestVolumeBootPattern-571902767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:04:40.815799 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-748f9642-20ef-40f5-a9a7-9c79aa58bd75 tempest-TestVolumeBootPattern-571902767 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:04:40.816547 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-748f9642-20ef-40f5-a9a7-9c79aa58bd75 tempest-TestVolumeBootPattern-571902767 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:04:40.846246 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-748f9642-20ef-40f5-a9a7-9c79aa58bd75 tempest-TestVolumeBootPattern-571902767 None] Flow 'volume_create_manager' (bc52404b-4af2-4699-95c3-26615ec87a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:04:40.853766 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-748f9642-20ef-40f5-a9a7-9c79aa58bd75 tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (529fde80-a65d-4bac-b116-4eec724392ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:04:40.867514 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-748f9642-20ef-40f5-a9a7-9c79aa58bd75 tempest-TestVolumeBootPattern-571902767 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:04:40.893967 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-748f9642-20ef-40f5-a9a7-9c79aa58bd75 tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (529fde80-a65d-4bac-b116-4eec724392ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-361000880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a596a35e-6272-4148-8fc7-5af03589cd32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af1c8d8fd0ce4d51947fd02afc3a9fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:04:41Z,use_quota=True,user_id='2a43cfedc8824ef8a0dd76c24ed654c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:04:40.902922 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-748f9642-20ef-40f5-a9a7-9c79aa58bd75 tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89b28e17-bd35-4908-86ab-0daaeb72529c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:04:40.909779 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-748f9642-20ef-40f5-a9a7-9c79aa58bd75 tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89b28e17-bd35-4908-86ab-0daaeb72529c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:04:40.917542 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-748f9642-20ef-40f5-a9a7-9c79aa58bd75 tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b02e76fe-d8d1-426e-bb2e-bb2f00967af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:04:40.997865 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-a2233d0d-16db-4374-b0c6-5caff2c18d0e tempest-AttachVolumeTestJSON-2131176214 None] Created reservations ['d18cc41c-0f2a-4ad7-a062-2eedb14472a6', '236f4ff1-f0ff-4629-b3cc-2842880da943', '984c0415-1b9b-47c9-bd27-a7ed8aa8e8f4', '45b7a8e8-6d59-4d2d-8b0c-4968886228e8'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:04:41.108057 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-748f9642-20ef-40f5-a9a7-9c79aa58bd75 tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b02e76fe-d8d1-426e-bb2e-bb2f00967af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a596a35e-6272-4148-8fc7-5af03589cd32', 'volume_name': 'volume-a596a35e-6272-4148-8fc7-5af03589cd32', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:04:41.116576 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-748f9642-20ef-40f5-a9a7-9c79aa58bd75 tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (045ba392-3b80-4524-984a-c2d06486512b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:04:41.121603 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-748f9642-20ef-40f5-a9a7-9c79aa58bd75 tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (045ba392-3b80-4524-984a-c2d06486512b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:04:41.126794 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-748f9642-20ef-40f5-a9a7-9c79aa58bd75 tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cebd467e-ff5c-499f-8a65-468b0b0854fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:04:41.128803 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-748f9642-20ef-40f5-a9a7-9c79aa58bd75 tempest-TestVolumeBootPattern-571902767 None] Volume a596a35e-6272-4148-8fc7-5af03589cd32: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a596a35e-6272-4148-8fc7-5af03589cd32', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 05 21:04:41.129467 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-748f9642-20ef-40f5-a9a7-9c79aa58bd75 tempest-TestVolumeBootPattern-571902767 None] Cloning a596a35e-6272-4148-8fc7-5af03589cd32 from image e66a3a3b-d2f9-4d5d-8021-a6001dff419f at location (None, None). {{(pid=122683) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 05 21:04:41.147519 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-748f9642-20ef-40f5-a9a7-9c79aa58bd75 tempest-TestVolumeBootPattern-571902767 None] Lock "b'cinder-e66a3a3b-d2f9-4d5d-8021-a6001dff419f'" acquired by "_prepare_image_cache_entry" :: waited 0.016s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:04:41.166075 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-a2233d0d-16db-4374-b0c6-5caff2c18d0e tempest-AttachVolumeTestJSON-2131176214 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:04:41.253637 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-a2233d0d-16db-4374-b0c6-5caff2c18d0e tempest-AttachVolumeTestJSON-2131176214 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:04:41.375019 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-a2233d0d-16db-4374-b0c6-5caff2c18d0e tempest-AttachVolumeTestJSON-2131176214 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:04:41.378013 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-748f9642-20ef-40f5-a9a7-9c79aa58bd75 tempest-TestVolumeBootPattern-571902767 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'volume_id': '311ef4be-45fd-4167-a3ad-6251d56550a7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57), 'last_used': datetime.datetime(2022, 2, 5, 21, 4, 41, 159373)}. {{(pid=122683) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 05 21:04:41.379038 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-748f9642-20ef-40f5-a9a7-9c79aa58bd75 tempest-TestVolumeBootPattern-571902767 None] Image-volume cache entry image_update_at = 2022-02-05 20:37:57+00:00, requested image updated_at = 2022-02-05 20:37:57+00:00. {{(pid=122683) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 05 21:04:41.379837 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-748f9642-20ef-40f5-a9a7-9c79aa58bd75 tempest-TestVolumeBootPattern-571902767 None] Found cache entry for image = e66a3a3b-d2f9-4d5d-8021-a6001dff419f on host ncdv-master-1@ceph#ceph. {{(pid=122683) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Feb 05 21:04:41.387462 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-a2233d0d-16db-4374-b0c6-5caff2c18d0e tempest-AttachVolumeTestJSON-2131176214 None] Deleted volume successfully. Feb 05 21:04:41.398214 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-748f9642-20ef-40f5-a9a7-9c79aa58bd75 tempest-TestVolumeBootPattern-571902767 None] Lock "b'cinder-e66a3a3b-d2f9-4d5d-8021-a6001dff419f'" released by "_prepare_image_cache_entry" :: held 0.251s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:04:41.399747 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-748f9642-20ef-40f5-a9a7-9c79aa58bd75 tempest-TestVolumeBootPattern-571902767 None] Attempting to retrieve cache entry for image = e66a3a3b-d2f9-4d5d-8021-a6001dff419f on host ncdv-master-1@ceph#ceph. {{(pid=122683) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 05 21:04:41.437763 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-3c17c1e2-1fe2-4eb9-9ab4-473cb2091fb5 tempest-AttachVolumeTestJSON-2131176214 None] Lock "b'cinder-e5398d21-0e5f-4120-80c1-9b1f3521b9c4-delete_volume'" acquired by "delete_volume" :: waited 0.033s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:04:41.455106 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-748f9642-20ef-40f5-a9a7-9c79aa58bd75 tempest-TestVolumeBootPattern-571902767 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'volume_id': '311ef4be-45fd-4167-a3ad-6251d56550a7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57), 'last_used': datetime.datetime(2022, 2, 5, 21, 4, 41, 417210)}. {{(pid=122683) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 05 21:04:41.455779 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-748f9642-20ef-40f5-a9a7-9c79aa58bd75 tempest-TestVolumeBootPattern-571902767 None] Image-volume cache entry image_update_at = 2022-02-05 20:37:57+00:00, requested image updated_at = 2022-02-05 20:37:57+00:00. {{(pid=122683) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 05 21:04:41.456352 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-748f9642-20ef-40f5-a9a7-9c79aa58bd75 tempest-TestVolumeBootPattern-571902767 None] Creating from source image-volume 311ef4be-45fd-4167-a3ad-6251d56550a7 {{(pid=122683) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Feb 05 21:04:41.469203 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-a2233d0d-16db-4374-b0c6-5caff2c18d0e tempest-AttachVolumeTestJSON-2131176214 None] Lock "b'cinder-fcec885d-6024-46e4-ad8e-7932368f9e41-delete_volume'" released by "delete_volume" :: held 1.497s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:04:41.518997 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-748f9642-20ef-40f5-a9a7-9c79aa58bd75 tempest-TestVolumeBootPattern-571902767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:04:41.634367 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-748f9642-20ef-40f5-a9a7-9c79aa58bd75 tempest-TestVolumeBootPattern-571902767 None] creating snapshot='volume-a596a35e-6272-4148-8fc7-5af03589cd32.clone_snap' {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 05 21:04:42.339430 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-748f9642-20ef-40f5-a9a7-9c79aa58bd75 tempest-TestVolumeBootPattern-571902767 None] cloning 'volume-311ef4be-45fd-4167-a3ad-6251d56550a7@volume-a596a35e-6272-4148-8fc7-5af03589cd32.clone_snap' to 'volume-a596a35e-6272-4148-8fc7-5af03589cd32' {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 05 21:04:42.495174 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3c17c1e2-1fe2-4eb9-9ab4-473cb2091fb5 tempest-AttachVolumeTestJSON-2131176214 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:04:42.629061 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3c17c1e2-1fe2-4eb9-9ab4-473cb2091fb5 tempest-AttachVolumeTestJSON-2131176214 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:04:42.629797 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3c17c1e2-1fe2-4eb9-9ab4-473cb2091fb5 tempest-AttachVolumeTestJSON-2131176214 None] Volume volume-e5398d21-0e5f-4120-80c1-9b1f3521b9c4 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:04:42.649853 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3c17c1e2-1fe2-4eb9-9ab4-473cb2091fb5 tempest-AttachVolumeTestJSON-2131176214 None] deleting rbd volume volume-e5398d21-0e5f-4120-80c1-9b1f3521b9c4 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:04:42.721373 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-748f9642-20ef-40f5-a9a7-9c79aa58bd75 tempest-TestVolumeBootPattern-571902767 None] Volume volume-35445a36-a76c-48db-a9c5-3b58646c1e7b.deleted is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:04:42.722704 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-748f9642-20ef-40f5-a9a7-9c79aa58bd75 tempest-TestVolumeBootPattern-571902767 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:04:42.727494 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-748f9642-20ef-40f5-a9a7-9c79aa58bd75 tempest-TestVolumeBootPattern-571902767 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:04:42.763090 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-748f9642-20ef-40f5-a9a7-9c79aa58bd75 tempest-TestVolumeBootPattern-571902767 None] clone created successfully {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 05 21:04:42.764463 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.volume_utils [None req-748f9642-20ef-40f5-a9a7-9c79aa58bd75 tempest-TestVolumeBootPattern-571902767 None] Marking volume a596a35e-6272-4148-8fc7-5af03589cd32 as bootable. {{(pid=122683) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Feb 05 21:04:42.787093 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-748f9642-20ef-40f5-a9a7-9c79aa58bd75 tempest-TestVolumeBootPattern-571902767 None] Copying metadata from image e66a3a3b-d2f9-4d5d-8021-a6001dff419f to a596a35e-6272-4148-8fc7-5af03589cd32. {{(pid=122683) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 05 21:04:42.788828 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-748f9642-20ef-40f5-a9a7-9c79aa58bd75 tempest-TestVolumeBootPattern-571902767 None] Creating volume glance metadata for volume a596a35e-6272-4148-8fc7-5af03589cd32 backed by image e66a3a3b-d2f9-4d5d-8021-a6001dff419f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=122683) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 05 21:04:43.013421 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-748f9642-20ef-40f5-a9a7-9c79aa58bd75 tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cebd467e-ff5c-499f-8a65-468b0b0854fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a596a35e-6272-4148-8fc7-5af03589cd32', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:04:43.024317 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-748f9642-20ef-40f5-a9a7-9c79aa58bd75 tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4970517b-3969-4335-992b-9a1da7898845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:04:43.045174 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-748f9642-20ef-40f5-a9a7-9c79aa58bd75 tempest-TestVolumeBootPattern-571902767 None] Volume volume-a596a35e-6272-4148-8fc7-5af03589cd32 (a596a35e-6272-4148-8fc7-5af03589cd32): created successfully Feb 05 21:04:43.056468 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-748f9642-20ef-40f5-a9a7-9c79aa58bd75 tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4970517b-3969-4335-992b-9a1da7898845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:04:43.119328 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-748f9642-20ef-40f5-a9a7-9c79aa58bd75 tempest-TestVolumeBootPattern-571902767 None] Flow 'volume_create_manager' (bc52404b-4af2-4699-95c3-26615ec87a3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:04:43.195309 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-748f9642-20ef-40f5-a9a7-9c79aa58bd75 tempest-TestVolumeBootPattern-571902767 None] Created volume successfully. Feb 05 21:04:43.295068 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-3c17c1e2-1fe2-4eb9-9ab4-473cb2091fb5 tempest-AttachVolumeTestJSON-2131176214 None] Created reservations ['dc9ec1de-97e5-4338-8b07-a9cd92ca3faf', '61eb6f31-4b17-4a5a-8221-b2e2660b530e', 'd332e8f1-0a89-488f-acd4-14d2fc9f436f', 'a22f4499-22fc-41d3-8af5-65702ece9556'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:04:43.415897 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3c17c1e2-1fe2-4eb9-9ab4-473cb2091fb5 tempest-AttachVolumeTestJSON-2131176214 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:04:43.493090 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3c17c1e2-1fe2-4eb9-9ab4-473cb2091fb5 tempest-AttachVolumeTestJSON-2131176214 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:04:43.551186 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-3c17c1e2-1fe2-4eb9-9ab4-473cb2091fb5 tempest-AttachVolumeTestJSON-2131176214 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:04:43.556882 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-3c17c1e2-1fe2-4eb9-9ab4-473cb2091fb5 tempest-AttachVolumeTestJSON-2131176214 None] Deleted volume successfully. Feb 05 21:04:43.577558 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-3c17c1e2-1fe2-4eb9-9ab4-473cb2091fb5 tempest-AttachVolumeTestJSON-2131176214 None] Lock "b'cinder-e5398d21-0e5f-4120-80c1-9b1f3521b9c4-delete_volume'" released by "delete_volume" :: held 2.139s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:04:44.610557 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c10a7f65-e3c0-4413-a8ec-32b810d62dd7 tempest-TestVolumeBootPattern-571902767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:04:45.563485 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-c10a7f65-e3c0-4413-a8ec-32b810d62dd7 tempest-TestVolumeBootPattern-571902767 None] Create snapshot completed successfully Feb 05 21:04:52.414006 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [req-1549e9dc-a54b-4310-bc7a-07670d01d836 req-a36d1299-1eab-4546-85a6-50f6733410d8 tempest-TestVolumeBootPattern-571902767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:04:52.419691 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [req-1549e9dc-a54b-4310-bc7a-07670d01d836 req-a36d1299-1eab-4546-85a6-50f6733410d8 tempest-TestVolumeBootPattern-571902767 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:04:52.420413 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [req-1549e9dc-a54b-4310-bc7a-07670d01d836 req-a36d1299-1eab-4546-85a6-50f6733410d8 tempest-TestVolumeBootPattern-571902767 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:04:52.537018 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-1549e9dc-a54b-4310-bc7a-07670d01d836 req-a36d1299-1eab-4546-85a6-50f6733410d8 tempest-TestVolumeBootPattern-571902767 None] Flow 'volume_create_manager' (0b8dc16d-7148-4929-9f2c-4333d1a83e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:04:52.547425 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-1549e9dc-a54b-4310-bc7a-07670d01d836 req-a36d1299-1eab-4546-85a6-50f6733410d8 tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93df2e94-50fe-4e0e-8ee5-e722cb23bfa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:04:52.558149 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [req-1549e9dc-a54b-4310-bc7a-07670d01d836 req-a36d1299-1eab-4546-85a6-50f6733410d8 tempest-TestVolumeBootPattern-571902767 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:04:52.573491 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:04:52.575374 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:04:52.671411 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:04:52.743358 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:04:52.750324 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-1549e9dc-a54b-4310-bc7a-07670d01d836 req-a36d1299-1eab-4546-85a6-50f6733410d8 tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93df2e94-50fe-4e0e-8ee5-e722cb23bfa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:04:52Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7a0600c5-964a-4c9d-96d8-3b4ade9665f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af1c8d8fd0ce4d51947fd02afc3a9fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:04:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=68d59b2d-0108-4dde-8271-9eee8f5518d9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:04:52Z,use_quota=True,user_id='2a43cfedc8824ef8a0dd76c24ed654c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:04:52.765557 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-1549e9dc-a54b-4310-bc7a-07670d01d836 req-a36d1299-1eab-4546-85a6-50f6733410d8 tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec33f88a-557f-4f04-beba-5a783403a591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:04:52.770083 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-1549e9dc-a54b-4310-bc7a-07670d01d836 req-a36d1299-1eab-4546-85a6-50f6733410d8 tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec33f88a-557f-4f04-beba-5a783403a591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:04:52.786203 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-1549e9dc-a54b-4310-bc7a-07670d01d836 req-a36d1299-1eab-4546-85a6-50f6733410d8 tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cab9858a-1b3b-450a-8852-f888d35bb4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:04:52.798167 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-1549e9dc-a54b-4310-bc7a-07670d01d836 req-a36d1299-1eab-4546-85a6-50f6733410d8 tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cab9858a-1b3b-450a-8852-f888d35bb4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7a0600c5-964a-4c9d-96d8-3b4ade9665f2', 'volume_name': 'volume-7a0600c5-964a-4c9d-96d8-3b4ade9665f2', 'volume_size': 1, 'snapshot_id': '68d59b2d-0108-4dde-8271-9eee8f5518d9'}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:04:52.803544 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-1549e9dc-a54b-4310-bc7a-07670d01d836 req-a36d1299-1eab-4546-85a6-50f6733410d8 tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a559259-7c16-4b1a-93d7-9c5c5066bb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:04:52.807933 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-1549e9dc-a54b-4310-bc7a-07670d01d836 req-a36d1299-1eab-4546-85a6-50f6733410d8 tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a559259-7c16-4b1a-93d7-9c5c5066bb64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:04:52.825137 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-1549e9dc-a54b-4310-bc7a-07670d01d836 req-a36d1299-1eab-4546-85a6-50f6733410d8 tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc479938-e95d-411f-926d-ca52f62f29a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:04:52.826277 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [req-1549e9dc-a54b-4310-bc7a-07670d01d836 req-a36d1299-1eab-4546-85a6-50f6733410d8 tempest-TestVolumeBootPattern-571902767 None] Volume 7a0600c5-964a-4c9d-96d8-3b4ade9665f2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7a0600c5-964a-4c9d-96d8-3b4ade9665f2', 'volume_size': 1, 'snapshot_id': '68d59b2d-0108-4dde-8271-9eee8f5518d9'} Feb 05 21:04:52.862712 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-1549e9dc-a54b-4310-bc7a-07670d01d836 req-a36d1299-1eab-4546-85a6-50f6733410d8 tempest-TestVolumeBootPattern-571902767 None] cloning volumes/volume-a596a35e-6272-4148-8fc7-5af03589cd32@snapshot-68d59b2d-0108-4dde-8271-9eee8f5518d9 to volume-7a0600c5-964a-4c9d-96d8-3b4ade9665f2 {{(pid=122683) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Feb 05 21:04:52.863654 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-1549e9dc-a54b-4310-bc7a-07670d01d836 req-a36d1299-1eab-4546-85a6-50f6733410d8 tempest-TestVolumeBootPattern-571902767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:04:52.977537 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-1549e9dc-a54b-4310-bc7a-07670d01d836 req-a36d1299-1eab-4546-85a6-50f6733410d8 tempest-TestVolumeBootPattern-571902767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:04:53.242278 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-1549e9dc-a54b-4310-bc7a-07670d01d836 req-a36d1299-1eab-4546-85a6-50f6733410d8 tempest-TestVolumeBootPattern-571902767 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:04:53.242728 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-1549e9dc-a54b-4310-bc7a-07670d01d836 req-a36d1299-1eab-4546-85a6-50f6733410d8 tempest-TestVolumeBootPattern-571902767 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:04:53.264767 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.volume_utils [req-1549e9dc-a54b-4310-bc7a-07670d01d836 req-a36d1299-1eab-4546-85a6-50f6733410d8 tempest-TestVolumeBootPattern-571902767 None] Marking volume 7a0600c5-964a-4c9d-96d8-3b4ade9665f2 as bootable. {{(pid=122683) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Feb 05 21:04:53.285787 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [req-1549e9dc-a54b-4310-bc7a-07670d01d836 req-a36d1299-1eab-4546-85a6-50f6733410d8 tempest-TestVolumeBootPattern-571902767 None] Copying metadata from snapshot 68d59b2d-0108-4dde-8271-9eee8f5518d9 to 7a0600c5-964a-4c9d-96d8-3b4ade9665f2. {{(pid=122683) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:422}} Feb 05 21:04:53.351628 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-1549e9dc-a54b-4310-bc7a-07670d01d836 req-a36d1299-1eab-4546-85a6-50f6733410d8 tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc479938-e95d-411f-926d-ca52f62f29a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a0600c5-964a-4c9d-96d8-3b4ade9665f2', 'volume_size': 1, 'snapshot_id': '68d59b2d-0108-4dde-8271-9eee8f5518d9'}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:04:53.358573 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-1549e9dc-a54b-4310-bc7a-07670d01d836 req-a36d1299-1eab-4546-85a6-50f6733410d8 tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (568fe3b5-7c31-442c-99ef-741525220d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:04:53.370177 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [req-1549e9dc-a54b-4310-bc7a-07670d01d836 req-a36d1299-1eab-4546-85a6-50f6733410d8 tempest-TestVolumeBootPattern-571902767 None] Volume volume-7a0600c5-964a-4c9d-96d8-3b4ade9665f2 (7a0600c5-964a-4c9d-96d8-3b4ade9665f2): created successfully Feb 05 21:04:53.375405 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-1549e9dc-a54b-4310-bc7a-07670d01d836 req-a36d1299-1eab-4546-85a6-50f6733410d8 tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (568fe3b5-7c31-442c-99ef-741525220d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:04:53.384217 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-1549e9dc-a54b-4310-bc7a-07670d01d836 req-a36d1299-1eab-4546-85a6-50f6733410d8 tempest-TestVolumeBootPattern-571902767 None] Flow 'volume_create_manager' (0b8dc16d-7148-4929-9f2c-4333d1a83e11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:04:53.420909 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-1549e9dc-a54b-4310-bc7a-07670d01d836 req-a36d1299-1eab-4546-85a6-50f6733410d8 tempest-TestVolumeBootPattern-571902767 None] Created volume successfully. Feb 05 21:04:55.695846 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-1549e9dc-a54b-4310-bc7a-07670d01d836 req-fdc5a3e8-d4b8-41f7-b827-7f7755c4c869 tempest-TestVolumeBootPattern-571902767 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 21:04:56.711336 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-1549e9dc-a54b-4310-bc7a-07670d01d836 req-fdc5a3e8-d4b8-41f7-b827-7f7755c4c869 tempest-TestVolumeBootPattern-571902767 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.014s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 21:04:56.713165 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-1549e9dc-a54b-4310-bc7a-07670d01d836 req-fdc5a3e8-d4b8-41f7-b827-7f7755c4c869 tempest-TestVolumeBootPattern-571902767 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7a0600c5-964a-4c9d-96d8-3b4ade9665f2', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': '7a0600c5-964a-4c9d-96d8-3b4ade9665f2', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 21:04:56.788679 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-1549e9dc-a54b-4310-bc7a-07670d01d836 req-fdc5a3e8-d4b8-41f7-b827-7f7755c4c869 tempest-TestVolumeBootPattern-571902767 None] Connection info returned from driver {'name': 'volumes/volume-7a0600c5-964a-4c9d-96d8-3b4ade9665f2', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '7a0600c5-964a-4c9d-96d8-3b4ade9665f2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '83c40bd1-c81f-431b-b157-0c952ab87105'} {{(pid=122683) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 05 21:04:56.920503 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-1549e9dc-a54b-4310-bc7a-07670d01d836 req-fdc5a3e8-d4b8-41f7-b827-7f7755c4c869 tempest-TestVolumeBootPattern-571902767 None] attachment_update completed successfully. Feb 05 21:05:03.561865 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b20fb40-9550-4722-9931-f670da82cb56 tempest-VolumesTestJSON-264528339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:05:03.585527 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-7b20fb40-9550-4722-9931-f670da82cb56 tempest-VolumesTestJSON-264528339 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:05:03.586920 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-7b20fb40-9550-4722-9931-f670da82cb56 tempest-VolumesTestJSON-264528339 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:05:03.622913 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-7b20fb40-9550-4722-9931-f670da82cb56 tempest-VolumesTestJSON-264528339 None] Flow 'volume_create_manager' (754dcd44-71fb-4436-bb7d-b759974a6b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:05:03.632715 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-7b20fb40-9550-4722-9931-f670da82cb56 tempest-VolumesTestJSON-264528339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa3e3566-9517-436c-a4b7-1980b8992588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:05:03.643031 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-7b20fb40-9550-4722-9931-f670da82cb56 tempest-VolumesTestJSON-264528339 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:05:03.659213 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-7b20fb40-9550-4722-9931-f670da82cb56 tempest-VolumesTestJSON-264528339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa3e3566-9517-436c-a4b7-1980b8992588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-812587119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=91210d21-fd0c-4d04-9153-ba9723ffd8cb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='53f7696bbd8d45ff99afc8a35095f07b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:05:03Z,use_quota=True,user_id='309bfbbfdb984bb69dbb73ed56b8d4be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:05:03.665899 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-7b20fb40-9550-4722-9931-f670da82cb56 tempest-VolumesTestJSON-264528339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c1189e-71a4-419f-8e85-6519b942f81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:05:03.670188 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-7b20fb40-9550-4722-9931-f670da82cb56 tempest-VolumesTestJSON-264528339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c1189e-71a4-419f-8e85-6519b942f81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:05:03.675735 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-7b20fb40-9550-4722-9931-f670da82cb56 tempest-VolumesTestJSON-264528339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f95fd2b-9cbb-46e9-970e-da9652a9e10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:05:03.680725 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-7b20fb40-9550-4722-9931-f670da82cb56 tempest-VolumesTestJSON-264528339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f95fd2b-9cbb-46e9-970e-da9652a9e10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91210d21-fd0c-4d04-9153-ba9723ffd8cb', 'volume_name': 'volume-91210d21-fd0c-4d04-9153-ba9723ffd8cb', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:05:03.686316 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-7b20fb40-9550-4722-9931-f670da82cb56 tempest-VolumesTestJSON-264528339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd013269-2b1c-44b8-87d7-58c05d2cedcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:05:03.694667 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-7b20fb40-9550-4722-9931-f670da82cb56 tempest-VolumesTestJSON-264528339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd013269-2b1c-44b8-87d7-58c05d2cedcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:05:03.704669 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-7b20fb40-9550-4722-9931-f670da82cb56 tempest-VolumesTestJSON-264528339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11b6483d-1ad9-451e-910b-54f0c2fb07be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:05:03.706110 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-7b20fb40-9550-4722-9931-f670da82cb56 tempest-VolumesTestJSON-264528339 None] Volume 91210d21-fd0c-4d04-9153-ba9723ffd8cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91210d21-fd0c-4d04-9153-ba9723ffd8cb', 'volume_size': 1} Feb 05 21:05:03.717299 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-7b20fb40-9550-4722-9931-f670da82cb56 tempest-VolumesTestJSON-264528339 None] creating volume 'volume-91210d21-fd0c-4d04-9153-ba9723ffd8cb' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:05:03.722687 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-7b20fb40-9550-4722-9931-f670da82cb56 tempest-VolumesTestJSON-264528339 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:05:03.869526 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-7b20fb40-9550-4722-9931-f670da82cb56 tempest-VolumesTestJSON-264528339 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:05:03.870319 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-7b20fb40-9550-4722-9931-f670da82cb56 tempest-VolumesTestJSON-264528339 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:05:03.875429 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-7b20fb40-9550-4722-9931-f670da82cb56 tempest-VolumesTestJSON-264528339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11b6483d-1ad9-451e-910b-54f0c2fb07be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91210d21-fd0c-4d04-9153-ba9723ffd8cb', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:05:03.883731 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-7b20fb40-9550-4722-9931-f670da82cb56 tempest-VolumesTestJSON-264528339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5a1ba10-9d6f-4247-8925-09b68a72b4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:05:03.906412 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-7b20fb40-9550-4722-9931-f670da82cb56 tempest-VolumesTestJSON-264528339 None] Volume volume-91210d21-fd0c-4d04-9153-ba9723ffd8cb (91210d21-fd0c-4d04-9153-ba9723ffd8cb): created successfully Feb 05 21:05:03.914862 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-7b20fb40-9550-4722-9931-f670da82cb56 tempest-VolumesTestJSON-264528339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5a1ba10-9d6f-4247-8925-09b68a72b4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:05:03.942898 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-7b20fb40-9550-4722-9931-f670da82cb56 tempest-VolumesTestJSON-264528339 None] Flow 'volume_create_manager' (754dcd44-71fb-4436-bb7d-b759974a6b26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:05:03.964456 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-7b20fb40-9550-4722-9931-f670da82cb56 tempest-VolumesTestJSON-264528339 None] Created volume successfully. Feb 05 21:05:05.332522 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb951541-28cb-45af-8928-d3b3d77a64bf tempest-VolumesTestJSON-264528339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:05:05.336996 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-fb951541-28cb-45af-8928-d3b3d77a64bf tempest-VolumesTestJSON-264528339 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:05:05.337454 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-fb951541-28cb-45af-8928-d3b3d77a64bf tempest-VolumesTestJSON-264528339 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:05:05.388703 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-fb951541-28cb-45af-8928-d3b3d77a64bf tempest-VolumesTestJSON-264528339 None] Flow 'volume_create_manager' (576f4d68-1b84-4ffb-b5c0-1847798ad78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:05:05.398860 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-fb951541-28cb-45af-8928-d3b3d77a64bf tempest-VolumesTestJSON-264528339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d0e960f-21c7-4d48-a521-5d10307accd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:05:05.408614 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-fb951541-28cb-45af-8928-d3b3d77a64bf tempest-VolumesTestJSON-264528339 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:05:05.457985 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-fb951541-28cb-45af-8928-d3b3d77a64bf tempest-VolumesTestJSON-264528339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d0e960f-21c7-4d48-a521-5d10307accd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-742351992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f7534662-be42-4b68-adc3-0c9abe0ec612,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='53f7696bbd8d45ff99afc8a35095f07b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:05:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:05:05Z,use_quota=True,user_id='309bfbbfdb984bb69dbb73ed56b8d4be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:05:05.466594 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-fb951541-28cb-45af-8928-d3b3d77a64bf tempest-VolumesTestJSON-264528339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b47dc298-ba9c-4c86-8f44-ad1ab37cae5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:05:05.474972 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-fb951541-28cb-45af-8928-d3b3d77a64bf tempest-VolumesTestJSON-264528339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b47dc298-ba9c-4c86-8f44-ad1ab37cae5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:05:05.482129 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-fb951541-28cb-45af-8928-d3b3d77a64bf tempest-VolumesTestJSON-264528339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46d5f633-d8be-49a5-ba7e-c883846a4022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:05:05.487683 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-fb951541-28cb-45af-8928-d3b3d77a64bf tempest-VolumesTestJSON-264528339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46d5f633-d8be-49a5-ba7e-c883846a4022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7534662-be42-4b68-adc3-0c9abe0ec612', 'volume_name': 'volume-f7534662-be42-4b68-adc3-0c9abe0ec612', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:05:05.497931 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-fb951541-28cb-45af-8928-d3b3d77a64bf tempest-VolumesTestJSON-264528339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9fab43c-c0ca-45aa-9193-20ac42eed94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:05:05.510674 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-fb951541-28cb-45af-8928-d3b3d77a64bf tempest-VolumesTestJSON-264528339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9fab43c-c0ca-45aa-9193-20ac42eed94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:05:05.515188 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-fb951541-28cb-45af-8928-d3b3d77a64bf tempest-VolumesTestJSON-264528339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf14e66e-f2e2-4ac4-8bd6-f56c7daa2703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:05:05.517372 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-fb951541-28cb-45af-8928-d3b3d77a64bf tempest-VolumesTestJSON-264528339 None] Volume f7534662-be42-4b68-adc3-0c9abe0ec612: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7534662-be42-4b68-adc3-0c9abe0ec612', 'volume_size': 1} Feb 05 21:05:05.517829 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-fb951541-28cb-45af-8928-d3b3d77a64bf tempest-VolumesTestJSON-264528339 None] creating volume 'volume-f7534662-be42-4b68-adc3-0c9abe0ec612' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:05:05.518869 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-fb951541-28cb-45af-8928-d3b3d77a64bf tempest-VolumesTestJSON-264528339 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:05:05.651372 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-fb951541-28cb-45af-8928-d3b3d77a64bf tempest-VolumesTestJSON-264528339 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:05:05.651815 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-fb951541-28cb-45af-8928-d3b3d77a64bf tempest-VolumesTestJSON-264528339 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:05:05.656527 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-fb951541-28cb-45af-8928-d3b3d77a64bf tempest-VolumesTestJSON-264528339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf14e66e-f2e2-4ac4-8bd6-f56c7daa2703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7534662-be42-4b68-adc3-0c9abe0ec612', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:05:05.671123 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-fb951541-28cb-45af-8928-d3b3d77a64bf tempest-VolumesTestJSON-264528339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4e68515-17fb-4657-a0af-524c050544bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:05:05.684016 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-fb951541-28cb-45af-8928-d3b3d77a64bf tempest-VolumesTestJSON-264528339 None] Volume volume-f7534662-be42-4b68-adc3-0c9abe0ec612 (f7534662-be42-4b68-adc3-0c9abe0ec612): created successfully Feb 05 21:05:05.689689 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-fb951541-28cb-45af-8928-d3b3d77a64bf tempest-VolumesTestJSON-264528339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4e68515-17fb-4657-a0af-524c050544bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:05:05.702904 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-fb951541-28cb-45af-8928-d3b3d77a64bf tempest-VolumesTestJSON-264528339 None] Flow 'volume_create_manager' (576f4d68-1b84-4ffb-b5c0-1847798ad78f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:05:05.726409 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-fb951541-28cb-45af-8928-d3b3d77a64bf tempest-VolumesTestJSON-264528339 None] Created volume successfully. Feb 05 21:05:07.582476 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-21857326-2138-41dc-9b5f-4090f358de55 tempest-VolumesTestJSON-264528339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:05:07.590406 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-21857326-2138-41dc-9b5f-4090f358de55 tempest-VolumesTestJSON-264528339 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:05:07.590867 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-21857326-2138-41dc-9b5f-4090f358de55 tempest-VolumesTestJSON-264528339 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:05:07.639444 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-21857326-2138-41dc-9b5f-4090f358de55 tempest-VolumesTestJSON-264528339 None] Flow 'volume_create_manager' (13fe002f-60e1-4bbf-825e-e27a2c4b814a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:05:07.647271 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-21857326-2138-41dc-9b5f-4090f358de55 tempest-VolumesTestJSON-264528339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e11d1558-eec7-48c1-b2b3-1bbe83e9adc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:05:07.654796 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-21857326-2138-41dc-9b5f-4090f358de55 tempest-VolumesTestJSON-264528339 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:05:07.682161 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-21857326-2138-41dc-9b5f-4090f358de55 tempest-VolumesTestJSON-264528339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e11d1558-eec7-48c1-b2b3-1bbe83e9adc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-46747106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=25c64276-c12d-43ed-a0fe-5fc19583e6f8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='53f7696bbd8d45ff99afc8a35095f07b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:05:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:05:08Z,use_quota=True,user_id='309bfbbfdb984bb69dbb73ed56b8d4be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:05:07.687937 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-21857326-2138-41dc-9b5f-4090f358de55 tempest-VolumesTestJSON-264528339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db61925b-5f18-4b56-868d-cb7e06af2660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:05:07.692486 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-21857326-2138-41dc-9b5f-4090f358de55 tempest-VolumesTestJSON-264528339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db61925b-5f18-4b56-868d-cb7e06af2660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:05:07.699113 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-21857326-2138-41dc-9b5f-4090f358de55 tempest-VolumesTestJSON-264528339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2daf9259-9f62-4d37-9130-f4960499cc1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:05:07.704029 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-21857326-2138-41dc-9b5f-4090f358de55 tempest-VolumesTestJSON-264528339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2daf9259-9f62-4d37-9130-f4960499cc1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25c64276-c12d-43ed-a0fe-5fc19583e6f8', 'volume_name': 'volume-25c64276-c12d-43ed-a0fe-5fc19583e6f8', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:05:07.711917 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-21857326-2138-41dc-9b5f-4090f358de55 tempest-VolumesTestJSON-264528339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afccae7d-9a0e-43a1-89ec-0140ec8aa316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:05:07.721235 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-21857326-2138-41dc-9b5f-4090f358de55 tempest-VolumesTestJSON-264528339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afccae7d-9a0e-43a1-89ec-0140ec8aa316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:05:07.733747 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-21857326-2138-41dc-9b5f-4090f358de55 tempest-VolumesTestJSON-264528339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1781709-cc27-4d34-adbb-84b266f57405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:05:07.735146 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-21857326-2138-41dc-9b5f-4090f358de55 tempest-VolumesTestJSON-264528339 None] Volume 25c64276-c12d-43ed-a0fe-5fc19583e6f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25c64276-c12d-43ed-a0fe-5fc19583e6f8', 'volume_size': 1} Feb 05 21:05:07.735797 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-21857326-2138-41dc-9b5f-4090f358de55 tempest-VolumesTestJSON-264528339 None] creating volume 'volume-25c64276-c12d-43ed-a0fe-5fc19583e6f8' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:05:07.736991 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-21857326-2138-41dc-9b5f-4090f358de55 tempest-VolumesTestJSON-264528339 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:05:07.830242 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-21857326-2138-41dc-9b5f-4090f358de55 tempest-VolumesTestJSON-264528339 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:05:07.830834 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-21857326-2138-41dc-9b5f-4090f358de55 tempest-VolumesTestJSON-264528339 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:05:07.839283 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-21857326-2138-41dc-9b5f-4090f358de55 tempest-VolumesTestJSON-264528339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1781709-cc27-4d34-adbb-84b266f57405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25c64276-c12d-43ed-a0fe-5fc19583e6f8', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:05:07.862720 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-21857326-2138-41dc-9b5f-4090f358de55 tempest-VolumesTestJSON-264528339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6187fdef-97d6-460d-932a-ebfc4426d8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:05:07.896868 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-21857326-2138-41dc-9b5f-4090f358de55 tempest-VolumesTestJSON-264528339 None] Volume volume-25c64276-c12d-43ed-a0fe-5fc19583e6f8 (25c64276-c12d-43ed-a0fe-5fc19583e6f8): created successfully Feb 05 21:05:07.901887 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-21857326-2138-41dc-9b5f-4090f358de55 tempest-VolumesTestJSON-264528339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6187fdef-97d6-460d-932a-ebfc4426d8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:05:07.919947 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-21857326-2138-41dc-9b5f-4090f358de55 tempest-VolumesTestJSON-264528339 None] Flow 'volume_create_manager' (13fe002f-60e1-4bbf-825e-e27a2c4b814a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:05:07.946104 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-21857326-2138-41dc-9b5f-4090f358de55 tempest-VolumesTestJSON-264528339 None] Created volume successfully. Feb 05 21:05:11.360963 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-805e84e2-24b8-466e-bcea-d7c1841a1f54 tempest-VolumesTestJSON-264528339 None] Lock "b'cinder-25c64276-c12d-43ed-a0fe-5fc19583e6f8-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:05:11.421416 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-805e84e2-24b8-466e-bcea-d7c1841a1f54 tempest-VolumesTestJSON-264528339 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:05:11.518727 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-805e84e2-24b8-466e-bcea-d7c1841a1f54 tempest-VolumesTestJSON-264528339 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:05:11.519429 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-805e84e2-24b8-466e-bcea-d7c1841a1f54 tempest-VolumesTestJSON-264528339 None] Volume volume-25c64276-c12d-43ed-a0fe-5fc19583e6f8 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:05:11.531368 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-805e84e2-24b8-466e-bcea-d7c1841a1f54 tempest-VolumesTestJSON-264528339 None] deleting rbd volume volume-25c64276-c12d-43ed-a0fe-5fc19583e6f8 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:05:12.046024 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-805e84e2-24b8-466e-bcea-d7c1841a1f54 tempest-VolumesTestJSON-264528339 None] Created reservations ['9c8c44d2-1ffe-42fc-aefd-4d544f853dcc', '2308dead-05f8-4c53-b7f0-31c2f7721f0d', '387643e8-6ee8-46c9-9905-f035d107c492', '05767c1b-c2e7-47a9-980f-28a68f9d7cdc'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:05:12.125082 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-805e84e2-24b8-466e-bcea-d7c1841a1f54 tempest-VolumesTestJSON-264528339 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:05:12.236731 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-805e84e2-24b8-466e-bcea-d7c1841a1f54 tempest-VolumesTestJSON-264528339 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:05:12.291201 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-805e84e2-24b8-466e-bcea-d7c1841a1f54 tempest-VolumesTestJSON-264528339 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:05:12.302479 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-805e84e2-24b8-466e-bcea-d7c1841a1f54 tempest-VolumesTestJSON-264528339 None] Deleted volume successfully. Feb 05 21:05:12.327738 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-805e84e2-24b8-466e-bcea-d7c1841a1f54 tempest-VolumesTestJSON-264528339 None] Lock "b'cinder-25c64276-c12d-43ed-a0fe-5fc19583e6f8-delete_volume'" released by "delete_volume" :: held 0.967s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:05:12.586954 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-1c89d8cf-382a-4f6b-aa0e-95e339651896 tempest-VolumesTestJSON-264528339 None] Lock "b'cinder-f7534662-be42-4b68-adc3-0c9abe0ec612-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:05:12.644356 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1c89d8cf-382a-4f6b-aa0e-95e339651896 tempest-VolumesTestJSON-264528339 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:05:12.734726 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1c89d8cf-382a-4f6b-aa0e-95e339651896 tempest-VolumesTestJSON-264528339 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:05:12.735286 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1c89d8cf-382a-4f6b-aa0e-95e339651896 tempest-VolumesTestJSON-264528339 None] Volume volume-f7534662-be42-4b68-adc3-0c9abe0ec612 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:05:12.746513 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1c89d8cf-382a-4f6b-aa0e-95e339651896 tempest-VolumesTestJSON-264528339 None] deleting rbd volume volume-f7534662-be42-4b68-adc3-0c9abe0ec612 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:05:13.277993 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-1c89d8cf-382a-4f6b-aa0e-95e339651896 tempest-VolumesTestJSON-264528339 None] Created reservations ['d634d84c-e01e-4574-a1bd-90dc2fadd884', 'ad507052-a01d-4555-8ab0-02ba9d6dc62c', '1bd1e405-940b-4754-a227-75e6979e3474', 'e0f3fcc4-e011-4d78-a44d-9ff0c6b061c1'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:05:13.378583 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1c89d8cf-382a-4f6b-aa0e-95e339651896 tempest-VolumesTestJSON-264528339 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:05:13.431445 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1c89d8cf-382a-4f6b-aa0e-95e339651896 tempest-VolumesTestJSON-264528339 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:05:13.493859 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-1c89d8cf-382a-4f6b-aa0e-95e339651896 tempest-VolumesTestJSON-264528339 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:05:13.499912 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-1c89d8cf-382a-4f6b-aa0e-95e339651896 tempest-VolumesTestJSON-264528339 None] Deleted volume successfully. Feb 05 21:05:13.519398 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-1c89d8cf-382a-4f6b-aa0e-95e339651896 tempest-VolumesTestJSON-264528339 None] Lock "b'cinder-f7534662-be42-4b68-adc3-0c9abe0ec612-delete_volume'" released by "delete_volume" :: held 0.932s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:05:13.948212 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-4c986dcc-fde7-41b3-bfc9-2eb69c008d5c tempest-VolumesTestJSON-264528339 None] Lock "b'cinder-91210d21-fd0c-4d04-9153-ba9723ffd8cb-delete_volume'" acquired by "delete_volume" :: waited 0.053s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:05:14.014838 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-4c986dcc-fde7-41b3-bfc9-2eb69c008d5c tempest-VolumesTestJSON-264528339 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:05:14.145282 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-4c986dcc-fde7-41b3-bfc9-2eb69c008d5c tempest-VolumesTestJSON-264528339 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:05:14.146368 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-4c986dcc-fde7-41b3-bfc9-2eb69c008d5c tempest-VolumesTestJSON-264528339 None] Volume volume-91210d21-fd0c-4d04-9153-ba9723ffd8cb is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:05:14.160378 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-4c986dcc-fde7-41b3-bfc9-2eb69c008d5c tempest-VolumesTestJSON-264528339 None] deleting rbd volume volume-91210d21-fd0c-4d04-9153-ba9723ffd8cb {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:05:14.577735 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-4c986dcc-fde7-41b3-bfc9-2eb69c008d5c tempest-VolumesTestJSON-264528339 None] Created reservations ['b8a42320-768d-4629-a9f9-6b2cff9e7ab2', 'd7582188-de78-42c3-8b4a-fdfa70484ba0', '1f6ed7ab-02e0-4fe6-8217-94500e0a115f', 'aec6a8c9-4d83-49ab-915a-43ba0da57183'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:05:14.652922 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-4c986dcc-fde7-41b3-bfc9-2eb69c008d5c tempest-VolumesTestJSON-264528339 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:05:14.715739 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-4c986dcc-fde7-41b3-bfc9-2eb69c008d5c tempest-VolumesTestJSON-264528339 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:05:14.781765 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-4c986dcc-fde7-41b3-bfc9-2eb69c008d5c tempest-VolumesTestJSON-264528339 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:05:14.796164 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-4c986dcc-fde7-41b3-bfc9-2eb69c008d5c tempest-VolumesTestJSON-264528339 None] Deleted volume successfully. Feb 05 21:05:14.839726 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-4c986dcc-fde7-41b3-bfc9-2eb69c008d5c tempest-VolumesTestJSON-264528339 None] Lock "b'cinder-91210d21-fd0c-4d04-9153-ba9723ffd8cb-delete_volume'" released by "delete_volume" :: held 0.892s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:05:19.827467 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-a9f99c0e-9c14-467c-97db-20eadeeba377 req-1e1ff2ea-2ef1-4b29-a828-df18252f4a45 tempest-TestVolumeBootPattern-571902767 None] Terminate volume connection completed successfully. Feb 05 21:05:19.832085 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-a9f99c0e-9c14-467c-97db-20eadeeba377 req-1e1ff2ea-2ef1-4b29-a828-df18252f4a45 tempest-TestVolumeBootPattern-571902767 None] Deleting attachment 83c40bd1-c81f-431b-b157-0c952ab87105. {{(pid=122683) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 05 21:05:20.075559 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [req-a9f99c0e-9c14-467c-97db-20eadeeba377 req-7e4b2318-7c11-4871-9baf-848518be792c tempest-TestVolumeBootPattern-571902767 None] Lock "b'cinder-7a0600c5-964a-4c9d-96d8-3b4ade9665f2-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:05:20.121408 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-a9f99c0e-9c14-467c-97db-20eadeeba377 req-7e4b2318-7c11-4871-9baf-848518be792c tempest-TestVolumeBootPattern-571902767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:05:20.261481 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-a9f99c0e-9c14-467c-97db-20eadeeba377 req-7e4b2318-7c11-4871-9baf-848518be792c tempest-TestVolumeBootPattern-571902767 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:05:20.278091 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-a9f99c0e-9c14-467c-97db-20eadeeba377 req-7e4b2318-7c11-4871-9baf-848518be792c tempest-TestVolumeBootPattern-571902767 None] deleting rbd volume volume-7a0600c5-964a-4c9d-96d8-3b4ade9665f2 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:05:20.730914 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [req-a9f99c0e-9c14-467c-97db-20eadeeba377 req-7e4b2318-7c11-4871-9baf-848518be792c tempest-TestVolumeBootPattern-571902767 None] Created reservations ['fc0c0733-3b9f-41d8-b871-d20948245e5f', '7bc88ee2-e975-4d04-8827-27c740220bdf', 'd419290c-7ca0-4bf9-8231-fce68f31dc39', '2bec18bb-1da7-4a92-ad49-61a2d45b0bdc'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:05:20.810155 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-a9f99c0e-9c14-467c-97db-20eadeeba377 req-7e4b2318-7c11-4871-9baf-848518be792c tempest-TestVolumeBootPattern-571902767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:05:20.876159 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-a9f99c0e-9c14-467c-97db-20eadeeba377 req-7e4b2318-7c11-4871-9baf-848518be792c tempest-TestVolumeBootPattern-571902767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:05:20.934293 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [req-a9f99c0e-9c14-467c-97db-20eadeeba377 req-7e4b2318-7c11-4871-9baf-848518be792c tempest-TestVolumeBootPattern-571902767 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:05:20.939237 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-a9f99c0e-9c14-467c-97db-20eadeeba377 req-7e4b2318-7c11-4871-9baf-848518be792c tempest-TestVolumeBootPattern-571902767 None] Deleted volume successfully. Feb 05 21:05:20.962803 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [req-a9f99c0e-9c14-467c-97db-20eadeeba377 req-7e4b2318-7c11-4871-9baf-848518be792c tempest-TestVolumeBootPattern-571902767 None] Lock "b'cinder-7a0600c5-964a-4c9d-96d8-3b4ade9665f2-delete_volume'" released by "delete_volume" :: held 0.892s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:05:22.047945 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-a297df42-a10f-4229-8edf-84b6741b6917 tempest-TestVolumeBootPattern-571902767 None] Lock "b'cinder-68d59b2d-0108-4dde-8271-9eee8f5518d9-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:05:22.053071 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-a297df42-a10f-4229-8edf-84b6741b6917 tempest-TestVolumeBootPattern-571902767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:05:22.564103 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-a297df42-a10f-4229-8edf-84b6741b6917 tempest-TestVolumeBootPattern-571902767 None] Created reservations ['27fd600d-011f-4487-8b7e-5a6354a2b75b', '4acf19d3-d051-49fa-94dd-30c0d3dcfbb6', '830de6ed-bd5f-4a5d-86ae-135bae03c22e', '7ea20857-e8bf-43af-b151-f323ffa53446'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:05:22.631398 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-a297df42-a10f-4229-8edf-84b6741b6917 tempest-TestVolumeBootPattern-571902767 None] Delete snapshot completed successfully. Feb 05 21:05:22.639228 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-a297df42-a10f-4229-8edf-84b6741b6917 tempest-TestVolumeBootPattern-571902767 None] Lock "b'cinder-68d59b2d-0108-4dde-8271-9eee8f5518d9-delete_snapshot'" released by "delete_snapshot" :: held 0.593s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:05:23.279464 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-8980c7e0-bbca-4d3d-bf4f-99d8d0ef8498 tempest-TestVolumeBootPattern-571902767 None] Lock "b'cinder-a596a35e-6272-4148-8fc7-5af03589cd32-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:05:23.360935 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8980c7e0-bbca-4d3d-bf4f-99d8d0ef8498 tempest-TestVolumeBootPattern-571902767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:05:23.482486 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8980c7e0-bbca-4d3d-bf4f-99d8d0ef8498 tempest-TestVolumeBootPattern-571902767 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:05:23.491903 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8980c7e0-bbca-4d3d-bf4f-99d8d0ef8498 tempest-TestVolumeBootPattern-571902767 None] deleting rbd volume volume-a596a35e-6272-4148-8fc7-5af03589cd32 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:05:23.902545 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8980c7e0-bbca-4d3d-bf4f-99d8d0ef8498 tempest-TestVolumeBootPattern-571902767 None] volume is a clone so cleaning references {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 05 21:05:23.953413 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8980c7e0-bbca-4d3d-bf4f-99d8d0ef8498 tempest-TestVolumeBootPattern-571902767 None] deleting parent snapshot volume-a596a35e-6272-4148-8fc7-5af03589cd32.clone_snap {{(pid=122683) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 05 21:05:25.182824 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-8980c7e0-bbca-4d3d-bf4f-99d8d0ef8498 tempest-TestVolumeBootPattern-571902767 None] Created reservations ['f725d02c-a3ff-439e-a0ad-96c59039eb16', '38f93c60-3b2f-411b-9e12-fea5ccb57792', '3dfc5a2c-3194-4317-9e07-6e3577913847', 'd51e1306-22a2-43d1-89a2-02530d34e0fc'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:05:25.277747 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8980c7e0-bbca-4d3d-bf4f-99d8d0ef8498 tempest-TestVolumeBootPattern-571902767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:05:25.373932 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8980c7e0-bbca-4d3d-bf4f-99d8d0ef8498 tempest-TestVolumeBootPattern-571902767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:05:25.478029 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-8980c7e0-bbca-4d3d-bf4f-99d8d0ef8498 tempest-TestVolumeBootPattern-571902767 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:05:25.484311 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-8980c7e0-bbca-4d3d-bf4f-99d8d0ef8498 tempest-TestVolumeBootPattern-571902767 None] Deleted volume successfully. Feb 05 21:05:25.506075 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-8980c7e0-bbca-4d3d-bf4f-99d8d0ef8498 tempest-TestVolumeBootPattern-571902767 None] Lock "b'cinder-a596a35e-6272-4148-8fc7-5af03589cd32-delete_volume'" released by "delete_volume" :: held 2.226s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:05:26.608740 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-65342f8f-d8bd-4fb1-8cef-bf26f5921793 tempest-TestVolumeBootPattern-571902767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:05:26.620970 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-65342f8f-d8bd-4fb1-8cef-bf26f5921793 tempest-TestVolumeBootPattern-571902767 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:05:26.621524 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-65342f8f-d8bd-4fb1-8cef-bf26f5921793 tempest-TestVolumeBootPattern-571902767 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:05:26.672389 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-65342f8f-d8bd-4fb1-8cef-bf26f5921793 tempest-TestVolumeBootPattern-571902767 None] Flow 'volume_create_manager' (6fab9c18-869e-416e-8242-34d7fe08e813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:05:26.709021 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-65342f8f-d8bd-4fb1-8cef-bf26f5921793 tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7b48f01-a950-42cc-9d3b-c647e551f208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:05:26.719229 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-65342f8f-d8bd-4fb1-8cef-bf26f5921793 tempest-TestVolumeBootPattern-571902767 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:05:26.746277 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-65342f8f-d8bd-4fb1-8cef-bf26f5921793 tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7b48f01-a950-42cc-9d3b-c647e551f208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:05:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-977407865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=82cd874e-4c8f-47e9-ac0c-6fa79d8984fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af1c8d8fd0ce4d51947fd02afc3a9fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:05:27Z,use_quota=True,user_id='2a43cfedc8824ef8a0dd76c24ed654c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:05:26.762196 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-65342f8f-d8bd-4fb1-8cef-bf26f5921793 tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (697a3f8b-db9c-47fe-ac34-ffe43a19d4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:05:26.776515 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-65342f8f-d8bd-4fb1-8cef-bf26f5921793 tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (697a3f8b-db9c-47fe-ac34-ffe43a19d4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:05:26.796990 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-65342f8f-d8bd-4fb1-8cef-bf26f5921793 tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d62685-9a3c-469c-8646-d45c53a4029c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:05:26.968259 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-65342f8f-d8bd-4fb1-8cef-bf26f5921793 tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d62685-9a3c-469c-8646-d45c53a4029c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '82cd874e-4c8f-47e9-ac0c-6fa79d8984fd', 'volume_name': 'volume-82cd874e-4c8f-47e9-ac0c-6fa79d8984fd', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:05:26.995970 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-65342f8f-d8bd-4fb1-8cef-bf26f5921793 tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9bdb303-a765-45c1-963a-2b81d37bf0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:05:27.013962 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-65342f8f-d8bd-4fb1-8cef-bf26f5921793 tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9bdb303-a765-45c1-963a-2b81d37bf0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:05:27.023937 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-65342f8f-d8bd-4fb1-8cef-bf26f5921793 tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (680bbf0b-17d2-446c-996d-33da5e8301a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:05:27.028572 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-65342f8f-d8bd-4fb1-8cef-bf26f5921793 tempest-TestVolumeBootPattern-571902767 None] Volume 82cd874e-4c8f-47e9-ac0c-6fa79d8984fd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-82cd874e-4c8f-47e9-ac0c-6fa79d8984fd', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 05 21:05:27.030265 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-65342f8f-d8bd-4fb1-8cef-bf26f5921793 tempest-TestVolumeBootPattern-571902767 None] Cloning 82cd874e-4c8f-47e9-ac0c-6fa79d8984fd from image e66a3a3b-d2f9-4d5d-8021-a6001dff419f at location (None, None). {{(pid=122683) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 05 21:05:27.053576 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-65342f8f-d8bd-4fb1-8cef-bf26f5921793 tempest-TestVolumeBootPattern-571902767 None] Lock "b'cinder-e66a3a3b-d2f9-4d5d-8021-a6001dff419f'" acquired by "_prepare_image_cache_entry" :: waited 0.021s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:05:27.074868 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-65342f8f-d8bd-4fb1-8cef-bf26f5921793 tempest-TestVolumeBootPattern-571902767 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'volume_id': '311ef4be-45fd-4167-a3ad-6251d56550a7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57), 'last_used': datetime.datetime(2022, 2, 5, 21, 5, 27, 62169)}. {{(pid=122683) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 05 21:05:27.075475 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-65342f8f-d8bd-4fb1-8cef-bf26f5921793 tempest-TestVolumeBootPattern-571902767 None] Image-volume cache entry image_update_at = 2022-02-05 20:37:57+00:00, requested image updated_at = 2022-02-05 20:37:57+00:00. {{(pid=122683) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 05 21:05:27.076441 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-65342f8f-d8bd-4fb1-8cef-bf26f5921793 tempest-TestVolumeBootPattern-571902767 None] Found cache entry for image = e66a3a3b-d2f9-4d5d-8021-a6001dff419f on host ncdv-master-1@ceph#ceph. {{(pid=122683) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Feb 05 21:05:27.089165 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-65342f8f-d8bd-4fb1-8cef-bf26f5921793 tempest-TestVolumeBootPattern-571902767 None] Lock "b'cinder-e66a3a3b-d2f9-4d5d-8021-a6001dff419f'" released by "_prepare_image_cache_entry" :: held 0.036s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:05:27.090728 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-65342f8f-d8bd-4fb1-8cef-bf26f5921793 tempest-TestVolumeBootPattern-571902767 None] Attempting to retrieve cache entry for image = e66a3a3b-d2f9-4d5d-8021-a6001dff419f on host ncdv-master-1@ceph#ceph. {{(pid=122683) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 05 21:05:27.098139 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-65342f8f-d8bd-4fb1-8cef-bf26f5921793 tempest-TestVolumeBootPattern-571902767 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'volume_id': '311ef4be-45fd-4167-a3ad-6251d56550a7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57), 'last_used': datetime.datetime(2022, 2, 5, 21, 5, 27, 95575)}. {{(pid=122683) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 05 21:05:27.099933 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-65342f8f-d8bd-4fb1-8cef-bf26f5921793 tempest-TestVolumeBootPattern-571902767 None] Image-volume cache entry image_update_at = 2022-02-05 20:37:57+00:00, requested image updated_at = 2022-02-05 20:37:57+00:00. {{(pid=122683) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 05 21:05:27.100497 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-65342f8f-d8bd-4fb1-8cef-bf26f5921793 tempest-TestVolumeBootPattern-571902767 None] Creating from source image-volume 311ef4be-45fd-4167-a3ad-6251d56550a7 {{(pid=122683) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Feb 05 21:05:27.130752 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-65342f8f-d8bd-4fb1-8cef-bf26f5921793 tempest-TestVolumeBootPattern-571902767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:05:27.246246 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-65342f8f-d8bd-4fb1-8cef-bf26f5921793 tempest-TestVolumeBootPattern-571902767 None] creating snapshot='volume-82cd874e-4c8f-47e9-ac0c-6fa79d8984fd.clone_snap' {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 05 21:05:28.098068 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-65342f8f-d8bd-4fb1-8cef-bf26f5921793 tempest-TestVolumeBootPattern-571902767 None] cloning 'volume-311ef4be-45fd-4167-a3ad-6251d56550a7@volume-82cd874e-4c8f-47e9-ac0c-6fa79d8984fd.clone_snap' to 'volume-82cd874e-4c8f-47e9-ac0c-6fa79d8984fd' {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 05 21:05:28.340132 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-65342f8f-d8bd-4fb1-8cef-bf26f5921793 tempest-TestVolumeBootPattern-571902767 None] Volume volume-35445a36-a76c-48db-a9c5-3b58646c1e7b.deleted is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:05:28.341746 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-65342f8f-d8bd-4fb1-8cef-bf26f5921793 tempest-TestVolumeBootPattern-571902767 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:05:28.342027 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-65342f8f-d8bd-4fb1-8cef-bf26f5921793 tempest-TestVolumeBootPattern-571902767 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:05:28.374618 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-65342f8f-d8bd-4fb1-8cef-bf26f5921793 tempest-TestVolumeBootPattern-571902767 None] clone created successfully {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 05 21:05:28.375564 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.volume_utils [None req-65342f8f-d8bd-4fb1-8cef-bf26f5921793 tempest-TestVolumeBootPattern-571902767 None] Marking volume 82cd874e-4c8f-47e9-ac0c-6fa79d8984fd as bootable. {{(pid=122683) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Feb 05 21:05:28.387770 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-65342f8f-d8bd-4fb1-8cef-bf26f5921793 tempest-TestVolumeBootPattern-571902767 None] Copying metadata from image e66a3a3b-d2f9-4d5d-8021-a6001dff419f to 82cd874e-4c8f-47e9-ac0c-6fa79d8984fd. {{(pid=122683) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 05 21:05:28.388511 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-65342f8f-d8bd-4fb1-8cef-bf26f5921793 tempest-TestVolumeBootPattern-571902767 None] Creating volume glance metadata for volume 82cd874e-4c8f-47e9-ac0c-6fa79d8984fd backed by image e66a3a3b-d2f9-4d5d-8021-a6001dff419f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=122683) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 05 21:05:28.504403 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-65342f8f-d8bd-4fb1-8cef-bf26f5921793 tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (680bbf0b-17d2-446c-996d-33da5e8301a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82cd874e-4c8f-47e9-ac0c-6fa79d8984fd', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:05:28.510255 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-65342f8f-d8bd-4fb1-8cef-bf26f5921793 tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96ab7619-7e01-491a-a6ca-515e605de9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:05:28.540063 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-65342f8f-d8bd-4fb1-8cef-bf26f5921793 tempest-TestVolumeBootPattern-571902767 None] Volume volume-82cd874e-4c8f-47e9-ac0c-6fa79d8984fd (82cd874e-4c8f-47e9-ac0c-6fa79d8984fd): created successfully Feb 05 21:05:28.548892 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-65342f8f-d8bd-4fb1-8cef-bf26f5921793 tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96ab7619-7e01-491a-a6ca-515e605de9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:05:28.555137 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-65342f8f-d8bd-4fb1-8cef-bf26f5921793 tempest-TestVolumeBootPattern-571902767 None] Flow 'volume_create_manager' (6fab9c18-869e-416e-8242-34d7fe08e813) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:05:28.584012 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-65342f8f-d8bd-4fb1-8cef-bf26f5921793 tempest-TestVolumeBootPattern-571902767 None] Created volume successfully. Feb 05 21:05:33.070496 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-2534679d-4489-4392-a889-c7aa1d94608f req-0a12c2e8-d3e7-4672-8cee-e24dab68d4c1 tempest-TestVolumeBootPattern-571902767 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 21:05:34.202056 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-2534679d-4489-4392-a889-c7aa1d94608f req-0a12c2e8-d3e7-4672-8cee-e24dab68d4c1 tempest-TestVolumeBootPattern-571902767 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.133s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 21:05:34.203046 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-2534679d-4489-4392-a889-c7aa1d94608f req-0a12c2e8-d3e7-4672-8cee-e24dab68d4c1 tempest-TestVolumeBootPattern-571902767 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-82cd874e-4c8f-47e9-ac0c-6fa79d8984fd', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': '82cd874e-4c8f-47e9-ac0c-6fa79d8984fd', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 21:05:34.269490 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-2534679d-4489-4392-a889-c7aa1d94608f req-0a12c2e8-d3e7-4672-8cee-e24dab68d4c1 tempest-TestVolumeBootPattern-571902767 None] Connection info returned from driver {'name': 'volumes/volume-82cd874e-4c8f-47e9-ac0c-6fa79d8984fd', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '82cd874e-4c8f-47e9-ac0c-6fa79d8984fd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '8abfc010-ba7b-41ee-b6a9-40608b66f280'} {{(pid=122683) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 05 21:05:34.402144 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-2534679d-4489-4392-a889-c7aa1d94608f req-0a12c2e8-d3e7-4672-8cee-e24dab68d4c1 tempest-TestVolumeBootPattern-571902767 None] attachment_update completed successfully. Feb 05 21:05:47.170231 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-174d5cca-fafa-4026-808e-399f94f3f2fa req-2b57d4d2-35f1-4968-803c-900340729383 tempest-TestVolumeBootPattern-571902767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:05:48.481648 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-174d5cca-fafa-4026-808e-399f94f3f2fa req-2b57d4d2-35f1-4968-803c-900340729383 tempest-TestVolumeBootPattern-571902767 None] Create snapshot completed successfully Feb 05 21:05:52.570161 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:05:52.571843 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:05:52.667726 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:05:52.701335 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:05:52.732165 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [req-d4ba398d-3226-48c1-9b90-5f2ff0cc3ef1 req-d87ed93d-5967-4ace-9b65-042f6daec39d tempest-TestVolumeBootPattern-571902767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:05:52.737026 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [req-d4ba398d-3226-48c1-9b90-5f2ff0cc3ef1 req-d87ed93d-5967-4ace-9b65-042f6daec39d tempest-TestVolumeBootPattern-571902767 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:05:52.747854 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [req-d4ba398d-3226-48c1-9b90-5f2ff0cc3ef1 req-d87ed93d-5967-4ace-9b65-042f6daec39d tempest-TestVolumeBootPattern-571902767 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:05:52.786275 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-d4ba398d-3226-48c1-9b90-5f2ff0cc3ef1 req-d87ed93d-5967-4ace-9b65-042f6daec39d tempest-TestVolumeBootPattern-571902767 None] Flow 'volume_create_manager' (af1c4301-48a3-466f-aaec-d82007a39e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:05:52.796057 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-d4ba398d-3226-48c1-9b90-5f2ff0cc3ef1 req-d87ed93d-5967-4ace-9b65-042f6daec39d tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f421f14-e570-47a5-a7e3-f89c9c88b9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:05:52.817536 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [req-d4ba398d-3226-48c1-9b90-5f2ff0cc3ef1 req-d87ed93d-5967-4ace-9b65-042f6daec39d tempest-TestVolumeBootPattern-571902767 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:05:52.843937 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-d4ba398d-3226-48c1-9b90-5f2ff0cc3ef1 req-d87ed93d-5967-4ace-9b65-042f6daec39d tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f421f14-e570-47a5-a7e3-f89c9c88b9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:05:52Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7408264e-92f8-468e-aee0-1e51ecd0e652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af1c8d8fd0ce4d51947fd02afc3a9fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:05:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0e45b216-d2ff-4394-8ab7-56ae46741403,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:05:53Z,use_quota=True,user_id='2a43cfedc8824ef8a0dd76c24ed654c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:05:52.850946 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-d4ba398d-3226-48c1-9b90-5f2ff0cc3ef1 req-d87ed93d-5967-4ace-9b65-042f6daec39d tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12ef1573-dc92-47ee-b52c-589661c4c8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:05:52.856586 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-d4ba398d-3226-48c1-9b90-5f2ff0cc3ef1 req-d87ed93d-5967-4ace-9b65-042f6daec39d tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12ef1573-dc92-47ee-b52c-589661c4c8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:05:52.862899 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-d4ba398d-3226-48c1-9b90-5f2ff0cc3ef1 req-d87ed93d-5967-4ace-9b65-042f6daec39d tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59e54663-ac27-4cd5-9364-f88c246889f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:05:52.870534 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-d4ba398d-3226-48c1-9b90-5f2ff0cc3ef1 req-d87ed93d-5967-4ace-9b65-042f6daec39d tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59e54663-ac27-4cd5-9364-f88c246889f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7408264e-92f8-468e-aee0-1e51ecd0e652', 'volume_name': 'volume-7408264e-92f8-468e-aee0-1e51ecd0e652', 'volume_size': 1, 'snapshot_id': '0e45b216-d2ff-4394-8ab7-56ae46741403'}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:05:52.876426 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-d4ba398d-3226-48c1-9b90-5f2ff0cc3ef1 req-d87ed93d-5967-4ace-9b65-042f6daec39d tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66c666fc-59e9-425c-895a-14835305771a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:05:52.881444 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-d4ba398d-3226-48c1-9b90-5f2ff0cc3ef1 req-d87ed93d-5967-4ace-9b65-042f6daec39d tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66c666fc-59e9-425c-895a-14835305771a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:05:52.887474 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-d4ba398d-3226-48c1-9b90-5f2ff0cc3ef1 req-d87ed93d-5967-4ace-9b65-042f6daec39d tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5b18544-6855-4599-beef-d7251e05e2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:05:52.888667 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [req-d4ba398d-3226-48c1-9b90-5f2ff0cc3ef1 req-d87ed93d-5967-4ace-9b65-042f6daec39d tempest-TestVolumeBootPattern-571902767 None] Volume 7408264e-92f8-468e-aee0-1e51ecd0e652: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7408264e-92f8-468e-aee0-1e51ecd0e652', 'volume_size': 1, 'snapshot_id': '0e45b216-d2ff-4394-8ab7-56ae46741403'} Feb 05 21:05:52.918826 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-d4ba398d-3226-48c1-9b90-5f2ff0cc3ef1 req-d87ed93d-5967-4ace-9b65-042f6daec39d tempest-TestVolumeBootPattern-571902767 None] cloning volumes/volume-82cd874e-4c8f-47e9-ac0c-6fa79d8984fd@snapshot-0e45b216-d2ff-4394-8ab7-56ae46741403 to volume-7408264e-92f8-468e-aee0-1e51ecd0e652 {{(pid=122683) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Feb 05 21:05:52.920132 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-d4ba398d-3226-48c1-9b90-5f2ff0cc3ef1 req-d87ed93d-5967-4ace-9b65-042f6daec39d tempest-TestVolumeBootPattern-571902767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:05:53.051369 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-d4ba398d-3226-48c1-9b90-5f2ff0cc3ef1 req-d87ed93d-5967-4ace-9b65-042f6daec39d tempest-TestVolumeBootPattern-571902767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:05:53.297531 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-d4ba398d-3226-48c1-9b90-5f2ff0cc3ef1 req-d87ed93d-5967-4ace-9b65-042f6daec39d tempest-TestVolumeBootPattern-571902767 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:05:53.298231 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-d4ba398d-3226-48c1-9b90-5f2ff0cc3ef1 req-d87ed93d-5967-4ace-9b65-042f6daec39d tempest-TestVolumeBootPattern-571902767 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:05:53.324838 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.volume_utils [req-d4ba398d-3226-48c1-9b90-5f2ff0cc3ef1 req-d87ed93d-5967-4ace-9b65-042f6daec39d tempest-TestVolumeBootPattern-571902767 None] Marking volume 7408264e-92f8-468e-aee0-1e51ecd0e652 as bootable. {{(pid=122683) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Feb 05 21:05:53.329951 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [req-d4ba398d-3226-48c1-9b90-5f2ff0cc3ef1 req-d87ed93d-5967-4ace-9b65-042f6daec39d tempest-TestVolumeBootPattern-571902767 None] Copying metadata from snapshot 0e45b216-d2ff-4394-8ab7-56ae46741403 to 7408264e-92f8-468e-aee0-1e51ecd0e652. {{(pid=122683) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:422}} Feb 05 21:05:53.388190 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-d4ba398d-3226-48c1-9b90-5f2ff0cc3ef1 req-d87ed93d-5967-4ace-9b65-042f6daec39d tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5b18544-6855-4599-beef-d7251e05e2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7408264e-92f8-468e-aee0-1e51ecd0e652', 'volume_size': 1, 'snapshot_id': '0e45b216-d2ff-4394-8ab7-56ae46741403'}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:05:53.394972 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-d4ba398d-3226-48c1-9b90-5f2ff0cc3ef1 req-d87ed93d-5967-4ace-9b65-042f6daec39d tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fa03d12-6afc-4e8b-a8dd-56f139bcdbf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:05:53.410355 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [req-d4ba398d-3226-48c1-9b90-5f2ff0cc3ef1 req-d87ed93d-5967-4ace-9b65-042f6daec39d tempest-TestVolumeBootPattern-571902767 None] Volume volume-7408264e-92f8-468e-aee0-1e51ecd0e652 (7408264e-92f8-468e-aee0-1e51ecd0e652): created successfully Feb 05 21:05:53.414936 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-d4ba398d-3226-48c1-9b90-5f2ff0cc3ef1 req-d87ed93d-5967-4ace-9b65-042f6daec39d tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fa03d12-6afc-4e8b-a8dd-56f139bcdbf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:05:53.439651 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-d4ba398d-3226-48c1-9b90-5f2ff0cc3ef1 req-d87ed93d-5967-4ace-9b65-042f6daec39d tempest-TestVolumeBootPattern-571902767 None] Flow 'volume_create_manager' (af1c4301-48a3-466f-aaec-d82007a39e68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:05:53.460569 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-d4ba398d-3226-48c1-9b90-5f2ff0cc3ef1 req-d87ed93d-5967-4ace-9b65-042f6daec39d tempest-TestVolumeBootPattern-571902767 None] Created volume successfully. Feb 05 21:05:56.173594 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-d4ba398d-3226-48c1-9b90-5f2ff0cc3ef1 req-2add8cd3-b752-47bb-b0fa-99c63c2d8742 tempest-TestVolumeBootPattern-571902767 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 21:05:57.512640 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-d4ba398d-3226-48c1-9b90-5f2ff0cc3ef1 req-2add8cd3-b752-47bb-b0fa-99c63c2d8742 tempest-TestVolumeBootPattern-571902767 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.338s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 21:05:57.515210 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-d4ba398d-3226-48c1-9b90-5f2ff0cc3ef1 req-2add8cd3-b752-47bb-b0fa-99c63c2d8742 tempest-TestVolumeBootPattern-571902767 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7408264e-92f8-468e-aee0-1e51ecd0e652', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': '7408264e-92f8-468e-aee0-1e51ecd0e652', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 21:05:57.569696 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-d4ba398d-3226-48c1-9b90-5f2ff0cc3ef1 req-2add8cd3-b752-47bb-b0fa-99c63c2d8742 tempest-TestVolumeBootPattern-571902767 None] Connection info returned from driver {'name': 'volumes/volume-7408264e-92f8-468e-aee0-1e51ecd0e652', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '7408264e-92f8-468e-aee0-1e51ecd0e652', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'fe096eaf-2b53-450d-be58-3dd9e603dcf4'} {{(pid=122683) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 05 21:05:57.686889 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-d4ba398d-3226-48c1-9b90-5f2ff0cc3ef1 req-2add8cd3-b752-47bb-b0fa-99c63c2d8742 tempest-TestVolumeBootPattern-571902767 None] attachment_update completed successfully. Feb 05 21:06:19.950889 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-3992ab71-4890-47f8-a5c4-a878ed44d2b0 req-d1ba2e31-102f-4c99-a648-9b887e56f649 tempest-TestVolumeBootPattern-571902767 None] Terminate volume connection completed successfully. Feb 05 21:06:19.951953 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-3992ab71-4890-47f8-a5c4-a878ed44d2b0 req-d1ba2e31-102f-4c99-a648-9b887e56f649 tempest-TestVolumeBootPattern-571902767 None] Deleting attachment fe096eaf-2b53-450d-be58-3dd9e603dcf4. {{(pid=122683) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 05 21:06:20.215078 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [req-3992ab71-4890-47f8-a5c4-a878ed44d2b0 req-acc221d2-6755-4e06-8bd5-1bd554524866 tempest-TestVolumeBootPattern-571902767 None] Lock "b'cinder-7408264e-92f8-468e-aee0-1e51ecd0e652-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:06:20.302112 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-3992ab71-4890-47f8-a5c4-a878ed44d2b0 req-acc221d2-6755-4e06-8bd5-1bd554524866 tempest-TestVolumeBootPattern-571902767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:06:20.443038 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-3992ab71-4890-47f8-a5c4-a878ed44d2b0 req-acc221d2-6755-4e06-8bd5-1bd554524866 tempest-TestVolumeBootPattern-571902767 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:06:20.478767 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-3992ab71-4890-47f8-a5c4-a878ed44d2b0 req-acc221d2-6755-4e06-8bd5-1bd554524866 tempest-TestVolumeBootPattern-571902767 None] deleting rbd volume volume-7408264e-92f8-468e-aee0-1e51ecd0e652 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:06:21.249121 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [req-3992ab71-4890-47f8-a5c4-a878ed44d2b0 req-acc221d2-6755-4e06-8bd5-1bd554524866 tempest-TestVolumeBootPattern-571902767 None] Created reservations ['b3c51dca-e04d-4978-a1d2-47172add6bd3', '02f2c20e-09e5-4488-bce7-74d696d800c5', '7afb0ccb-957f-4348-b1bc-9cc0cd6ebb1a', 'd4b9c57c-0d4e-4e5f-80ea-16ec96eadafd'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:06:21.326733 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-3992ab71-4890-47f8-a5c4-a878ed44d2b0 req-acc221d2-6755-4e06-8bd5-1bd554524866 tempest-TestVolumeBootPattern-571902767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:06:21.401264 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-3992ab71-4890-47f8-a5c4-a878ed44d2b0 req-acc221d2-6755-4e06-8bd5-1bd554524866 tempest-TestVolumeBootPattern-571902767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:06:21.468371 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [req-3992ab71-4890-47f8-a5c4-a878ed44d2b0 req-acc221d2-6755-4e06-8bd5-1bd554524866 tempest-TestVolumeBootPattern-571902767 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:06:21.508141 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-3992ab71-4890-47f8-a5c4-a878ed44d2b0 req-acc221d2-6755-4e06-8bd5-1bd554524866 tempest-TestVolumeBootPattern-571902767 None] Deleted volume successfully. Feb 05 21:06:21.552473 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [req-3992ab71-4890-47f8-a5c4-a878ed44d2b0 req-acc221d2-6755-4e06-8bd5-1bd554524866 tempest-TestVolumeBootPattern-571902767 None] Lock "b'cinder-7408264e-92f8-468e-aee0-1e51ecd0e652-delete_volume'" released by "delete_volume" :: held 1.330s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:06:21.801671 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-2cb94310-81cc-48c0-ac38-62a801eb389f tempest-TestVolumeBootPattern-571902767 None] Lock "b'cinder-0e45b216-d2ff-4394-8ab7-56ae46741403-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.016s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:06:21.805876 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-2cb94310-81cc-48c0-ac38-62a801eb389f tempest-TestVolumeBootPattern-571902767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:06:52.269803 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-2cb94310-81cc-48c0-ac38-62a801eb389f tempest-TestVolumeBootPattern-571902767 None] Created reservations ['025f1d00-f332-4da4-8d5d-d560a483be9a', 'a40199d1-0c53-4114-85d1-5ccfe3c36ab8', '8b1a626f-c046-455b-9a18-bd86c974ca16', '526bdfbb-7294-411e-ae51-3408dfe9ed10'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:06:52.355319 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-2cb94310-81cc-48c0-ac38-62a801eb389f tempest-TestVolumeBootPattern-571902767 None] Delete snapshot completed successfully. Feb 05 21:06:52.374009 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-2cb94310-81cc-48c0-ac38-62a801eb389f tempest-TestVolumeBootPattern-571902767 None] Lock "b'cinder-0e45b216-d2ff-4394-8ab7-56ae46741403-delete_snapshot'" released by "delete_snapshot" :: held 30.572s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:06:52.570828 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:06:52.571906 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:06:52.621365 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:06:52.701436 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:06:57.594903 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-3ed13f20-69f6-4dd2-92ac-5432e520d94f req-c215d81e-3f0f-4797-b0cb-9bfe9c182cda tempest-TestVolumeBootPattern-571902767 None] Terminate volume connection completed successfully. Feb 05 21:06:57.597001 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-3ed13f20-69f6-4dd2-92ac-5432e520d94f req-c215d81e-3f0f-4797-b0cb-9bfe9c182cda tempest-TestVolumeBootPattern-571902767 None] Deleting attachment 8abfc010-ba7b-41ee-b6a9-40608b66f280. {{(pid=122683) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 05 21:06:57.801612 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [req-3ed13f20-69f6-4dd2-92ac-5432e520d94f req-38a39eb9-7dee-4a0d-b386-4027d36e721a tempest-TestVolumeBootPattern-571902767 None] Lock "b'cinder-82cd874e-4c8f-47e9-ac0c-6fa79d8984fd-delete_volume'" acquired by "delete_volume" :: waited 0.029s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:06:57.908193 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-3ed13f20-69f6-4dd2-92ac-5432e520d94f req-38a39eb9-7dee-4a0d-b386-4027d36e721a tempest-TestVolumeBootPattern-571902767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:06:58.074419 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-3ed13f20-69f6-4dd2-92ac-5432e520d94f req-38a39eb9-7dee-4a0d-b386-4027d36e721a tempest-TestVolumeBootPattern-571902767 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:06:58.091811 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-3ed13f20-69f6-4dd2-92ac-5432e520d94f req-38a39eb9-7dee-4a0d-b386-4027d36e721a tempest-TestVolumeBootPattern-571902767 None] deleting rbd volume volume-82cd874e-4c8f-47e9-ac0c-6fa79d8984fd {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:06:58.664691 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-3ed13f20-69f6-4dd2-92ac-5432e520d94f req-38a39eb9-7dee-4a0d-b386-4027d36e721a tempest-TestVolumeBootPattern-571902767 None] volume is a clone so cleaning references {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 05 21:06:58.704210 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-3ed13f20-69f6-4dd2-92ac-5432e520d94f req-38a39eb9-7dee-4a0d-b386-4027d36e721a tempest-TestVolumeBootPattern-571902767 None] deleting parent snapshot volume-82cd874e-4c8f-47e9-ac0c-6fa79d8984fd.clone_snap {{(pid=122683) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 05 21:06:59.591193 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [req-3ed13f20-69f6-4dd2-92ac-5432e520d94f req-38a39eb9-7dee-4a0d-b386-4027d36e721a tempest-TestVolumeBootPattern-571902767 None] Created reservations ['d43d8e09-0c92-4ece-b747-090bf7ababca', 'c1267ec3-519c-4743-ab1a-ba79ef8ff530', '11e2a32f-66d1-4273-a8f7-fe7aeec4f885', '5a8d05cb-c1e1-4b1b-b63c-c9feba8bf61d'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:06:59.698206 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-3ed13f20-69f6-4dd2-92ac-5432e520d94f req-38a39eb9-7dee-4a0d-b386-4027d36e721a tempest-TestVolumeBootPattern-571902767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:06:59.810724 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-3ed13f20-69f6-4dd2-92ac-5432e520d94f req-38a39eb9-7dee-4a0d-b386-4027d36e721a tempest-TestVolumeBootPattern-571902767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:06:59.905335 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [req-3ed13f20-69f6-4dd2-92ac-5432e520d94f req-38a39eb9-7dee-4a0d-b386-4027d36e721a tempest-TestVolumeBootPattern-571902767 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:06:59.916623 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-3ed13f20-69f6-4dd2-92ac-5432e520d94f req-38a39eb9-7dee-4a0d-b386-4027d36e721a tempest-TestVolumeBootPattern-571902767 None] Deleted volume successfully. Feb 05 21:06:59.938438 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [req-3ed13f20-69f6-4dd2-92ac-5432e520d94f req-38a39eb9-7dee-4a0d-b386-4027d36e721a tempest-TestVolumeBootPattern-571902767 None] Lock "b'cinder-82cd874e-4c8f-47e9-ac0c-6fa79d8984fd-delete_volume'" released by "delete_volume" :: held 2.137s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:07:06.242162 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd45a305-fbe2-40f1-8dba-90edd502c5fc tempest-TestVolumeBootPattern-571902767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:07:06.253306 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-bd45a305-fbe2-40f1-8dba-90edd502c5fc tempest-TestVolumeBootPattern-571902767 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:07:06.253798 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-bd45a305-fbe2-40f1-8dba-90edd502c5fc tempest-TestVolumeBootPattern-571902767 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:07:06.285200 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-bd45a305-fbe2-40f1-8dba-90edd502c5fc tempest-TestVolumeBootPattern-571902767 None] Flow 'volume_create_manager' (c7e56e24-81ba-4195-98cf-f4d239f2a936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:07:06.299716 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-bd45a305-fbe2-40f1-8dba-90edd502c5fc tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (388d6fd1-4eb1-4c39-8ea3-b6a6d57cef40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:07:06.307835 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-bd45a305-fbe2-40f1-8dba-90edd502c5fc tempest-TestVolumeBootPattern-571902767 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:07:06.327520 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-bd45a305-fbe2-40f1-8dba-90edd502c5fc tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (388d6fd1-4eb1-4c39-8ea3-b6a6d57cef40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1412223484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=882c36fd-3df2-4b63-92a4-d96715cad128,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af1c8d8fd0ce4d51947fd02afc3a9fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:07:06Z,use_quota=True,user_id='2a43cfedc8824ef8a0dd76c24ed654c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:07:06.336285 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-bd45a305-fbe2-40f1-8dba-90edd502c5fc tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (997c1819-6c74-4dde-b3f0-9a5de4ca33e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:07:06.341773 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-bd45a305-fbe2-40f1-8dba-90edd502c5fc tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (997c1819-6c74-4dde-b3f0-9a5de4ca33e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:07:06.351791 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-bd45a305-fbe2-40f1-8dba-90edd502c5fc tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fba271e8-74e3-4f34-9720-4647a87c2d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:07:06.494461 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-bd45a305-fbe2-40f1-8dba-90edd502c5fc tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fba271e8-74e3-4f34-9720-4647a87c2d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '882c36fd-3df2-4b63-92a4-d96715cad128', 'volume_name': 'volume-882c36fd-3df2-4b63-92a4-d96715cad128', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:07:06.505586 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-bd45a305-fbe2-40f1-8dba-90edd502c5fc tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b5450ca-8e7d-4ff9-acbe-0e73a36f6e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:07:06.513589 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-bd45a305-fbe2-40f1-8dba-90edd502c5fc tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b5450ca-8e7d-4ff9-acbe-0e73a36f6e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:07:06.520600 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-bd45a305-fbe2-40f1-8dba-90edd502c5fc tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f84cc132-4c9b-459b-bd14-07114c50b2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:07:06.521998 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-bd45a305-fbe2-40f1-8dba-90edd502c5fc tempest-TestVolumeBootPattern-571902767 None] Volume 882c36fd-3df2-4b63-92a4-d96715cad128: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-882c36fd-3df2-4b63-92a4-d96715cad128', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 05 21:07:06.522916 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd45a305-fbe2-40f1-8dba-90edd502c5fc tempest-TestVolumeBootPattern-571902767 None] Cloning 882c36fd-3df2-4b63-92a4-d96715cad128 from image e66a3a3b-d2f9-4d5d-8021-a6001dff419f at location (None, None). {{(pid=122683) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 05 21:07:06.538420 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-bd45a305-fbe2-40f1-8dba-90edd502c5fc tempest-TestVolumeBootPattern-571902767 None] Lock "b'cinder-e66a3a3b-d2f9-4d5d-8021-a6001dff419f'" acquired by "_prepare_image_cache_entry" :: waited 0.013s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:07:06.553867 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-bd45a305-fbe2-40f1-8dba-90edd502c5fc tempest-TestVolumeBootPattern-571902767 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'volume_id': '311ef4be-45fd-4167-a3ad-6251d56550a7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57), 'last_used': datetime.datetime(2022, 2, 5, 21, 7, 6, 544107)}. {{(pid=122683) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 05 21:07:06.554332 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-bd45a305-fbe2-40f1-8dba-90edd502c5fc tempest-TestVolumeBootPattern-571902767 None] Image-volume cache entry image_update_at = 2022-02-05 20:37:57+00:00, requested image updated_at = 2022-02-05 20:37:57+00:00. {{(pid=122683) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 05 21:07:06.555005 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd45a305-fbe2-40f1-8dba-90edd502c5fc tempest-TestVolumeBootPattern-571902767 None] Found cache entry for image = e66a3a3b-d2f9-4d5d-8021-a6001dff419f on host ncdv-master-1@ceph#ceph. {{(pid=122683) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Feb 05 21:07:06.581724 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-bd45a305-fbe2-40f1-8dba-90edd502c5fc tempest-TestVolumeBootPattern-571902767 None] Lock "b'cinder-e66a3a3b-d2f9-4d5d-8021-a6001dff419f'" released by "_prepare_image_cache_entry" :: held 0.044s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:07:06.583474 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd45a305-fbe2-40f1-8dba-90edd502c5fc tempest-TestVolumeBootPattern-571902767 None] Attempting to retrieve cache entry for image = e66a3a3b-d2f9-4d5d-8021-a6001dff419f on host ncdv-master-1@ceph#ceph. {{(pid=122683) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 05 21:07:06.592419 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-bd45a305-fbe2-40f1-8dba-90edd502c5fc tempest-TestVolumeBootPattern-571902767 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'volume_id': '311ef4be-45fd-4167-a3ad-6251d56550a7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57), 'last_used': datetime.datetime(2022, 2, 5, 21, 7, 6, 588250)}. {{(pid=122683) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 05 21:07:06.593232 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-bd45a305-fbe2-40f1-8dba-90edd502c5fc tempest-TestVolumeBootPattern-571902767 None] Image-volume cache entry image_update_at = 2022-02-05 20:37:57+00:00, requested image updated_at = 2022-02-05 20:37:57+00:00. {{(pid=122683) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 05 21:07:06.593764 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd45a305-fbe2-40f1-8dba-90edd502c5fc tempest-TestVolumeBootPattern-571902767 None] Creating from source image-volume 311ef4be-45fd-4167-a3ad-6251d56550a7 {{(pid=122683) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Feb 05 21:07:06.624613 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-bd45a305-fbe2-40f1-8dba-90edd502c5fc tempest-TestVolumeBootPattern-571902767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:07:06.722792 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-bd45a305-fbe2-40f1-8dba-90edd502c5fc tempest-TestVolumeBootPattern-571902767 None] creating snapshot='volume-882c36fd-3df2-4b63-92a4-d96715cad128.clone_snap' {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 05 21:07:07.532112 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-bd45a305-fbe2-40f1-8dba-90edd502c5fc tempest-TestVolumeBootPattern-571902767 None] cloning 'volume-311ef4be-45fd-4167-a3ad-6251d56550a7@volume-882c36fd-3df2-4b63-92a4-d96715cad128.clone_snap' to 'volume-882c36fd-3df2-4b63-92a4-d96715cad128' {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 05 21:07:07.795836 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-bd45a305-fbe2-40f1-8dba-90edd502c5fc tempest-TestVolumeBootPattern-571902767 None] Volume volume-35445a36-a76c-48db-a9c5-3b58646c1e7b.deleted is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:07:07.797115 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-bd45a305-fbe2-40f1-8dba-90edd502c5fc tempest-TestVolumeBootPattern-571902767 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:07:07.797509 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-bd45a305-fbe2-40f1-8dba-90edd502c5fc tempest-TestVolumeBootPattern-571902767 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:07:07.837690 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-bd45a305-fbe2-40f1-8dba-90edd502c5fc tempest-TestVolumeBootPattern-571902767 None] clone created successfully {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 05 21:07:07.840178 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.volume_utils [None req-bd45a305-fbe2-40f1-8dba-90edd502c5fc tempest-TestVolumeBootPattern-571902767 None] Marking volume 882c36fd-3df2-4b63-92a4-d96715cad128 as bootable. {{(pid=122683) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Feb 05 21:07:07.852237 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd45a305-fbe2-40f1-8dba-90edd502c5fc tempest-TestVolumeBootPattern-571902767 None] Copying metadata from image e66a3a3b-d2f9-4d5d-8021-a6001dff419f to 882c36fd-3df2-4b63-92a4-d96715cad128. {{(pid=122683) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 05 21:07:07.852869 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd45a305-fbe2-40f1-8dba-90edd502c5fc tempest-TestVolumeBootPattern-571902767 None] Creating volume glance metadata for volume 882c36fd-3df2-4b63-92a4-d96715cad128 backed by image e66a3a3b-d2f9-4d5d-8021-a6001dff419f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=122683) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 05 21:07:07.929601 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-bd45a305-fbe2-40f1-8dba-90edd502c5fc tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f84cc132-4c9b-459b-bd14-07114c50b2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-882c36fd-3df2-4b63-92a4-d96715cad128', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:07:07.936038 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-bd45a305-fbe2-40f1-8dba-90edd502c5fc tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b9eae80-8626-4f09-9e08-a29e7a09786d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:07:07.949472 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-bd45a305-fbe2-40f1-8dba-90edd502c5fc tempest-TestVolumeBootPattern-571902767 None] Volume volume-882c36fd-3df2-4b63-92a4-d96715cad128 (882c36fd-3df2-4b63-92a4-d96715cad128): created successfully Feb 05 21:07:07.956114 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-bd45a305-fbe2-40f1-8dba-90edd502c5fc tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b9eae80-8626-4f09-9e08-a29e7a09786d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:07:07.975722 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-bd45a305-fbe2-40f1-8dba-90edd502c5fc tempest-TestVolumeBootPattern-571902767 None] Flow 'volume_create_manager' (c7e56e24-81ba-4195-98cf-f4d239f2a936) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:07:07.992335 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-bd45a305-fbe2-40f1-8dba-90edd502c5fc tempest-TestVolumeBootPattern-571902767 None] Created volume successfully. Feb 05 21:07:12.754986 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-e1363787-69e9-432c-bf78-4e2fd75011c6 req-a311bcb3-61ab-451e-a204-6e966475da0e tempest-TestVolumeBootPattern-571902767 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 21:07:13.713258 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-e1363787-69e9-432c-bf78-4e2fd75011c6 req-a311bcb3-61ab-451e-a204-6e966475da0e tempest-TestVolumeBootPattern-571902767 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.958s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 21:07:13.714504 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-e1363787-69e9-432c-bf78-4e2fd75011c6 req-a311bcb3-61ab-451e-a204-6e966475da0e tempest-TestVolumeBootPattern-571902767 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-882c36fd-3df2-4b63-92a4-d96715cad128', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': '882c36fd-3df2-4b63-92a4-d96715cad128', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 21:07:13.746042 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-e1363787-69e9-432c-bf78-4e2fd75011c6 req-a311bcb3-61ab-451e-a204-6e966475da0e tempest-TestVolumeBootPattern-571902767 None] Connection info returned from driver {'name': 'volumes/volume-882c36fd-3df2-4b63-92a4-d96715cad128', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '882c36fd-3df2-4b63-92a4-d96715cad128', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '710c7159-d342-4df2-8374-e9e1b2420fae'} {{(pid=122683) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 05 21:07:13.882800 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-e1363787-69e9-432c-bf78-4e2fd75011c6 req-a311bcb3-61ab-451e-a204-6e966475da0e tempest-TestVolumeBootPattern-571902767 None] attachment_update completed successfully. Feb 05 21:07:41.887039 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ed8e64db-5115-49f1-9e3e-a715353c56d9 tempest-BackendsCapabilitiesAdminTestsJSON-1314606987 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:6740a15a-ef85-40b2-bb99-93dfa195f6a4:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=122683) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4733}} Feb 05 21:07:41.929826 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b8c4905d-8f9e-4221-8901-f6bd82ad3625 tempest-BackendsCapabilitiesAdminTestsJSON-1314606987 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:6740a15a-ef85-40b2-bb99-93dfa195f6a4:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=122683) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4733}} Feb 05 21:07:52.573083 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:07:52.574119 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:07:52.679053 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:07:52.804796 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:07:57.700680 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-88630f29-4296-48bf-b6b7-e5c8d6ab0d6d tempest-SnapshotsActionsTest-1566980060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:07:57.715069 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-88630f29-4296-48bf-b6b7-e5c8d6ab0d6d tempest-SnapshotsActionsTest-1566980060 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:07:57.715595 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-88630f29-4296-48bf-b6b7-e5c8d6ab0d6d tempest-SnapshotsActionsTest-1566980060 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:07:57.770203 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-88630f29-4296-48bf-b6b7-e5c8d6ab0d6d tempest-SnapshotsActionsTest-1566980060 None] Flow 'volume_create_manager' (5be113fc-dbce-4a3c-8de6-51371f756340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:07:57.782315 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-88630f29-4296-48bf-b6b7-e5c8d6ab0d6d tempest-SnapshotsActionsTest-1566980060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (968e775a-c9c7-41bf-8887-15356d9246ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:07:57.807767 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-88630f29-4296-48bf-b6b7-e5c8d6ab0d6d tempest-SnapshotsActionsTest-1566980060 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:07:57.832836 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-88630f29-4296-48bf-b6b7-e5c8d6ab0d6d tempest-SnapshotsActionsTest-1566980060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (968e775a-c9c7-41bf-8887-15356d9246ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-567443233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=dae0776f-b6f0-47f5-a940-e0506e33e08f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e91d6bf94689405c8bbb89fce600f97b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:07:58Z,use_quota=True,user_id='5ae88b24a11d4ee0ad1b30d33fe0ccba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:07:57.851682 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-88630f29-4296-48bf-b6b7-e5c8d6ab0d6d tempest-SnapshotsActionsTest-1566980060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1bb678a-6e29-4d9a-bae2-636a6e26287e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:07:57.860411 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-88630f29-4296-48bf-b6b7-e5c8d6ab0d6d tempest-SnapshotsActionsTest-1566980060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1bb678a-6e29-4d9a-bae2-636a6e26287e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:07:57.872413 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-88630f29-4296-48bf-b6b7-e5c8d6ab0d6d tempest-SnapshotsActionsTest-1566980060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03f68685-7296-4320-adc5-98825768c02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:07:57.880860 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-88630f29-4296-48bf-b6b7-e5c8d6ab0d6d tempest-SnapshotsActionsTest-1566980060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03f68685-7296-4320-adc5-98825768c02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dae0776f-b6f0-47f5-a940-e0506e33e08f', 'volume_name': 'volume-dae0776f-b6f0-47f5-a940-e0506e33e08f', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:07:57.898053 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-88630f29-4296-48bf-b6b7-e5c8d6ab0d6d tempest-SnapshotsActionsTest-1566980060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96bebd6d-71ad-4a6d-b359-4521ecc07fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:07:57.910875 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-88630f29-4296-48bf-b6b7-e5c8d6ab0d6d tempest-SnapshotsActionsTest-1566980060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96bebd6d-71ad-4a6d-b359-4521ecc07fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:07:57.918221 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-88630f29-4296-48bf-b6b7-e5c8d6ab0d6d tempest-SnapshotsActionsTest-1566980060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d97d6cd-362f-4058-b440-1c2583f6aa31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:07:57.923860 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-88630f29-4296-48bf-b6b7-e5c8d6ab0d6d tempest-SnapshotsActionsTest-1566980060 None] Volume dae0776f-b6f0-47f5-a940-e0506e33e08f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dae0776f-b6f0-47f5-a940-e0506e33e08f', 'volume_size': 1} Feb 05 21:07:57.924564 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-88630f29-4296-48bf-b6b7-e5c8d6ab0d6d tempest-SnapshotsActionsTest-1566980060 None] creating volume 'volume-dae0776f-b6f0-47f5-a940-e0506e33e08f' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:07:57.937843 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-88630f29-4296-48bf-b6b7-e5c8d6ab0d6d tempest-SnapshotsActionsTest-1566980060 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:07:58.137616 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-88630f29-4296-48bf-b6b7-e5c8d6ab0d6d tempest-SnapshotsActionsTest-1566980060 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:07:58.138566 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-88630f29-4296-48bf-b6b7-e5c8d6ab0d6d tempest-SnapshotsActionsTest-1566980060 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:07:58.154861 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-88630f29-4296-48bf-b6b7-e5c8d6ab0d6d tempest-SnapshotsActionsTest-1566980060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d97d6cd-362f-4058-b440-1c2583f6aa31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dae0776f-b6f0-47f5-a940-e0506e33e08f', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:07:58.174591 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-88630f29-4296-48bf-b6b7-e5c8d6ab0d6d tempest-SnapshotsActionsTest-1566980060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c86e4e33-7d89-4e93-8992-8b9147bdcd36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:07:58.208815 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-88630f29-4296-48bf-b6b7-e5c8d6ab0d6d tempest-SnapshotsActionsTest-1566980060 None] Volume volume-dae0776f-b6f0-47f5-a940-e0506e33e08f (dae0776f-b6f0-47f5-a940-e0506e33e08f): created successfully Feb 05 21:07:58.217018 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-88630f29-4296-48bf-b6b7-e5c8d6ab0d6d tempest-SnapshotsActionsTest-1566980060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c86e4e33-7d89-4e93-8992-8b9147bdcd36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:07:58.231103 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-88630f29-4296-48bf-b6b7-e5c8d6ab0d6d tempest-SnapshotsActionsTest-1566980060 None] Flow 'volume_create_manager' (5be113fc-dbce-4a3c-8de6-51371f756340) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:07:58.266034 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-88630f29-4296-48bf-b6b7-e5c8d6ab0d6d tempest-SnapshotsActionsTest-1566980060 None] Created volume successfully. Feb 05 21:07:59.072582 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-24a2b78f-025f-4c0a-92ca-9ad76522f4d5 tempest-SnapshotsActionsTest-1566980060 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:07:59.677577 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-24a2b78f-025f-4c0a-92ca-9ad76522f4d5 tempest-SnapshotsActionsTest-1566980060 None] Create snapshot completed successfully Feb 05 21:08:01.595836 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-88826406-b8e7-4bd2-9a0b-d07d5576ee3b tempest-SnapshotsActionsTest-1566980060 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:02.817794 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-88826406-b8e7-4bd2-9a0b-d07d5576ee3b tempest-SnapshotsActionsTest-1566980060 None] Create snapshot completed successfully Feb 05 21:08:04.010982 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-54cf4aed-e4b0-41b7-8c21-a42a806124ff tempest-SnapshotsActionsTest-339707364 None] Lock "b'cinder-79bfe364-002d-4617-ad78-fd70b3372da0-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:08:04.014508 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-54cf4aed-e4b0-41b7-8c21-a42a806124ff tempest-SnapshotsActionsTest-339707364 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:04.808690 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-54cf4aed-e4b0-41b7-8c21-a42a806124ff tempest-SnapshotsActionsTest-339707364 None] Created reservations ['3d496de9-ec19-4e38-80d3-55feb782fb27', '1bdb0038-e543-4545-846a-4c9a38807aa3', 'a00e4fc6-4853-41f0-9624-0c9688d67d7a', '20ef333a-0713-4ae3-ab65-8e7ef2aafcb4'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:08:04.898969 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-54cf4aed-e4b0-41b7-8c21-a42a806124ff tempest-SnapshotsActionsTest-339707364 None] Delete snapshot completed successfully. Feb 05 21:08:04.921110 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-54cf4aed-e4b0-41b7-8c21-a42a806124ff tempest-SnapshotsActionsTest-339707364 None] Lock "b'cinder-79bfe364-002d-4617-ad78-fd70b3372da0-delete_snapshot'" released by "delete_snapshot" :: held 0.910s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:08:04.953153 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-deea7223-8678-4b0e-8c24-dd20dd40cd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1246111103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:08:04.958684 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-deea7223-8678-4b0e-8c24-dd20dd40cd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1246111103 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:08:04.959141 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-deea7223-8678-4b0e-8c24-dd20dd40cd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1246111103 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:08:05.002977 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-deea7223-8678-4b0e-8c24-dd20dd40cd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1246111103 None] Flow 'volume_create_manager' (5da23dc1-00df-440a-80a5-7196caa9262e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:08:05.022837 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-deea7223-8678-4b0e-8c24-dd20dd40cd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1246111103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38714ac1-6bb2-4b28-8602-9f32137ce877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:05.035266 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-deea7223-8678-4b0e-8c24-dd20dd40cd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1246111103 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:08:05.057801 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-deea7223-8678-4b0e-8c24-dd20dd40cd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1246111103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38714ac1-6bb2-4b28-8602-9f32137ce877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1015515905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d5aed497-c6c2-4ad8-8603-451a9b92b730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c311b0fbba5a40caac6ae675ddfe21c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:08:05Z,use_quota=True,user_id='1e2caae4117c49e49112b53c1f8f930c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:05.063537 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-deea7223-8678-4b0e-8c24-dd20dd40cd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1246111103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e89fe4d-1c8e-4ffc-b928-1ae968cd5c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:05.084677 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-deea7223-8678-4b0e-8c24-dd20dd40cd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1246111103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e89fe4d-1c8e-4ffc-b928-1ae968cd5c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:05.099720 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-deea7223-8678-4b0e-8c24-dd20dd40cd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1246111103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfa78b11-6233-466f-887e-af7f0554445f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:05.108945 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-deea7223-8678-4b0e-8c24-dd20dd40cd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1246111103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfa78b11-6233-466f-887e-af7f0554445f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5aed497-c6c2-4ad8-8603-451a9b92b730', 'volume_name': 'volume-d5aed497-c6c2-4ad8-8603-451a9b92b730', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:05.113956 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-deea7223-8678-4b0e-8c24-dd20dd40cd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1246111103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d2d6d49-24ef-4a6f-9d8f-013f6a7f9ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:05.131766 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-deea7223-8678-4b0e-8c24-dd20dd40cd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1246111103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d2d6d49-24ef-4a6f-9d8f-013f6a7f9ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:05.148694 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-deea7223-8678-4b0e-8c24-dd20dd40cd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1246111103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ada05bbf-6e9b-4d2b-88d9-61bbafce18e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:05.150158 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-deea7223-8678-4b0e-8c24-dd20dd40cd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1246111103 None] Volume d5aed497-c6c2-4ad8-8603-451a9b92b730: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5aed497-c6c2-4ad8-8603-451a9b92b730', 'volume_size': 1} Feb 05 21:08:05.150626 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-deea7223-8678-4b0e-8c24-dd20dd40cd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1246111103 None] creating volume 'volume-d5aed497-c6c2-4ad8-8603-451a9b92b730' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:08:05.151646 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-deea7223-8678-4b0e-8c24-dd20dd40cd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1246111103 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:05.322234 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-deea7223-8678-4b0e-8c24-dd20dd40cd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1246111103 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:08:05.323151 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-deea7223-8678-4b0e-8c24-dd20dd40cd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1246111103 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:08:05.329717 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-deea7223-8678-4b0e-8c24-dd20dd40cd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1246111103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ada05bbf-6e9b-4d2b-88d9-61bbafce18e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5aed497-c6c2-4ad8-8603-451a9b92b730', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:05.357770 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-deea7223-8678-4b0e-8c24-dd20dd40cd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1246111103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb997c3b-290b-476e-99a0-1935fe499449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:05.406114 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-deea7223-8678-4b0e-8c24-dd20dd40cd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1246111103 None] Volume volume-d5aed497-c6c2-4ad8-8603-451a9b92b730 (d5aed497-c6c2-4ad8-8603-451a9b92b730): created successfully Feb 05 21:08:05.426756 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-deea7223-8678-4b0e-8c24-dd20dd40cd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1246111103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb997c3b-290b-476e-99a0-1935fe499449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:05.461268 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-deea7223-8678-4b0e-8c24-dd20dd40cd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1246111103 None] Flow 'volume_create_manager' (5da23dc1-00df-440a-80a5-7196caa9262e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:08:05.493846 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-deea7223-8678-4b0e-8c24-dd20dd40cd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1246111103 None] Created volume successfully. Feb 05 21:08:05.663470 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-60a2a895-d630-4daa-b666-ab01b23bb729 tempest-SnapshotsActionsTest-1566980060 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:06.354636 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-2770de34-8e95-4e03-8fe7-9680ad038c4f tempest-VolumeSnapshotQuotasNegativeTestJSON-1246111103 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:06.861372 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-2770de34-8e95-4e03-8fe7-9680ad038c4f tempest-VolumeSnapshotQuotasNegativeTestJSON-1246111103 None] Create snapshot completed successfully Feb 05 21:08:06.896285 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-60a2a895-d630-4daa-b666-ab01b23bb729 tempest-SnapshotsActionsTest-1566980060 None] Create snapshot completed successfully Feb 05 21:08:08.112265 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-0f96927c-7401-4021-a215-f4b17a17c024 tempest-SnapshotsActionsTest-339707364 None] Lock "b'cinder-705ee0ed-4149-46eb-ac2b-6706d42c1bb9-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.026s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:08:08.116130 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-0f96927c-7401-4021-a215-f4b17a17c024 tempest-SnapshotsActionsTest-339707364 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:08.299840 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-01c8062d-db0b-49a7-bee9-123a93561c62 tempest-VolumeSnapshotQuotasNegativeTestJSON-1246111103 None] Lock "b'cinder-c7bc81c0-9790-4b5f-b1ca-84b13cfdb53a-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.030s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:08:08.301788 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-01c8062d-db0b-49a7-bee9-123a93561c62 tempest-VolumeSnapshotQuotasNegativeTestJSON-1246111103 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:09.628916 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-0f96927c-7401-4021-a215-f4b17a17c024 tempest-SnapshotsActionsTest-339707364 None] Created reservations ['3a3d45ca-11d9-4a69-9353-17bfc2c7d1d8', 'aafdb931-6584-4698-b1f5-cd63e3942cba', '5418aaab-4549-41d2-96ed-253badd949dd', 'd155639f-3d44-4a11-88a5-37d23061f726'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:08:09.637490 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-01c8062d-db0b-49a7-bee9-123a93561c62 tempest-VolumeSnapshotQuotasNegativeTestJSON-1246111103 None] Created reservations ['bc96f6a4-3ba0-4599-adb1-95bc7a79b292', '28eabac7-901a-4de1-9d02-9cb890c4717c', 'c4788fa1-06d2-4324-b75f-5076ac1bf44e', 'fec5233c-548b-4834-b3fe-823003876b4a'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:08:09.810916 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-0f96927c-7401-4021-a215-f4b17a17c024 tempest-SnapshotsActionsTest-339707364 None] Delete snapshot completed successfully. Feb 05 21:08:09.849359 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-0f96927c-7401-4021-a215-f4b17a17c024 tempest-SnapshotsActionsTest-339707364 None] Lock "b'cinder-705ee0ed-4149-46eb-ac2b-6706d42c1bb9-delete_snapshot'" released by "delete_snapshot" :: held 1.737s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:08:09.892180 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-01c8062d-db0b-49a7-bee9-123a93561c62 tempest-VolumeSnapshotQuotasNegativeTestJSON-1246111103 None] Delete snapshot completed successfully. Feb 05 21:08:09.899692 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-01c8062d-db0b-49a7-bee9-123a93561c62 tempest-VolumeSnapshotQuotasNegativeTestJSON-1246111103 None] Lock "b'cinder-c7bc81c0-9790-4b5f-b1ca-84b13cfdb53a-delete_snapshot'" released by "delete_snapshot" :: held 1.610s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:08:10.578733 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-aec4d8b0-de0a-4be0-a03f-c96d917fd895 tempest-VolumeSnapshotQuotasNegativeTestJSON-1246111103 None] Lock "b'cinder-d5aed497-c6c2-4ad8-8603-451a9b92b730-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:08:10.813586 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-aec4d8b0-de0a-4be0-a03f-c96d917fd895 tempest-VolumeSnapshotQuotasNegativeTestJSON-1246111103 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:10.939092 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-aec4d8b0-de0a-4be0-a03f-c96d917fd895 tempest-VolumeSnapshotQuotasNegativeTestJSON-1246111103 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:08:10.939531 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-aec4d8b0-de0a-4be0-a03f-c96d917fd895 tempest-VolumeSnapshotQuotasNegativeTestJSON-1246111103 None] Volume volume-d5aed497-c6c2-4ad8-8603-451a9b92b730 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:08:10.955706 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-aec4d8b0-de0a-4be0-a03f-c96d917fd895 tempest-VolumeSnapshotQuotasNegativeTestJSON-1246111103 None] deleting rbd volume volume-d5aed497-c6c2-4ad8-8603-451a9b92b730 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:08:11.075230 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-70fef29b-572e-4c40-bdb8-f7dd58dc41d9 tempest-SnapshotsActionsTest-1566980060 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:11.587219 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-70fef29b-572e-4c40-bdb8-f7dd58dc41d9 tempest-SnapshotsActionsTest-1566980060 None] Create snapshot completed successfully Feb 05 21:08:11.698366 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-aec4d8b0-de0a-4be0-a03f-c96d917fd895 tempest-VolumeSnapshotQuotasNegativeTestJSON-1246111103 None] Created reservations ['1ec59947-e7f0-46f0-885e-d938e0057610', 'ef866db5-eeda-4442-9642-3d896c026db5', 'b2b424ce-79d4-4b2d-9891-d37545a537eb', '3195ed95-7525-4fa5-bc67-a829a2903083'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:08:11.771053 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-aec4d8b0-de0a-4be0-a03f-c96d917fd895 tempest-VolumeSnapshotQuotasNegativeTestJSON-1246111103 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:11.860575 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-aec4d8b0-de0a-4be0-a03f-c96d917fd895 tempest-VolumeSnapshotQuotasNegativeTestJSON-1246111103 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:11.977361 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-aec4d8b0-de0a-4be0-a03f-c96d917fd895 tempest-VolumeSnapshotQuotasNegativeTestJSON-1246111103 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:08:11.993934 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-aec4d8b0-de0a-4be0-a03f-c96d917fd895 tempest-VolumeSnapshotQuotasNegativeTestJSON-1246111103 None] Deleted volume successfully. Feb 05 21:08:12.015443 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-aec4d8b0-de0a-4be0-a03f-c96d917fd895 tempest-VolumeSnapshotQuotasNegativeTestJSON-1246111103 None] Lock "b'cinder-d5aed497-c6c2-4ad8-8603-451a9b92b730-delete_volume'" released by "delete_volume" :: held 1.441s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:08:12.602241 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-0f2d0d1c-acf8-4544-895e-4c770a4880fd tempest-SnapshotsActionsTest-339707364 None] Lock "b'cinder-8ad23acf-07e3-4eae-a3a5-2322076e5d11-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.033s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:08:12.618266 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-0f2d0d1c-acf8-4544-895e-4c770a4880fd tempest-SnapshotsActionsTest-339707364 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:13.510188 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-0f2d0d1c-acf8-4544-895e-4c770a4880fd tempest-SnapshotsActionsTest-339707364 None] Created reservations ['cd9a8e19-bb2b-4ae6-af7c-d02e19ae5add', '9fb3289e-d4ed-4fba-938e-f878452f88c9', '17f41959-2e80-4802-82f3-122c9d805baf', '1b3415ad-275d-49e9-8bae-723bff044344'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:08:13.588114 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-0f2d0d1c-acf8-4544-895e-4c770a4880fd tempest-SnapshotsActionsTest-339707364 None] Delete snapshot completed successfully. Feb 05 21:08:13.593322 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-0f2d0d1c-acf8-4544-895e-4c770a4880fd tempest-SnapshotsActionsTest-339707364 None] Lock "b'cinder-8ad23acf-07e3-4eae-a3a5-2322076e5d11-delete_snapshot'" released by "delete_snapshot" :: held 0.991s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:08:14.465894 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8ff65f84-8f5a-4e32-95a0-2265e7222977 tempest-SnapshotsActionsTest-1566980060 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:15.603789 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-8ff65f84-8f5a-4e32-95a0-2265e7222977 tempest-SnapshotsActionsTest-1566980060 None] Create snapshot completed successfully Feb 05 21:08:16.607983 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-191a4007-35d4-4ad5-9882-5b52f410b89c tempest-SnapshotsActionsTest-339707364 None] Lock "b'cinder-ed32a8d3-81e2-4325-8bb3-2d1a4b7d57aa-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.019s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:08:16.611208 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-191a4007-35d4-4ad5-9882-5b52f410b89c tempest-SnapshotsActionsTest-339707364 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:17.675756 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-191a4007-35d4-4ad5-9882-5b52f410b89c tempest-SnapshotsActionsTest-339707364 None] Created reservations ['347605b4-e421-43f7-baa9-6332c95a5dc8', 'c4ea3f39-c10b-44fd-b3a5-f942842a4f0b', '813fad37-0443-4dac-b204-8f601e9bfd1b', '37e27a11-02cf-451d-9c01-24f91865e7c6'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:08:17.776387 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-191a4007-35d4-4ad5-9882-5b52f410b89c tempest-SnapshotsActionsTest-339707364 None] Delete snapshot completed successfully. Feb 05 21:08:17.783560 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-191a4007-35d4-4ad5-9882-5b52f410b89c tempest-SnapshotsActionsTest-339707364 None] Lock "b'cinder-ed32a8d3-81e2-4325-8bb3-2d1a4b7d57aa-delete_snapshot'" released by "delete_snapshot" :: held 1.176s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:08:19.419933 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-a2278a15-879f-43a1-ab09-866cdb67779c tempest-SnapshotsActionsTest-1566980060 None] Lock "b'cinder-a4d6d532-34ba-4058-b665-22adee8f3701-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.033s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:08:19.426469 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-a2278a15-879f-43a1-ab09-866cdb67779c tempest-SnapshotsActionsTest-1566980060 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:20.651205 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-a2278a15-879f-43a1-ab09-866cdb67779c tempest-SnapshotsActionsTest-1566980060 None] Created reservations ['b868d013-697d-4297-8aad-1feeeca5a006', '8aee7bf9-fde5-4114-8bcd-f6de1540668b', '3b2e8200-b1c9-4539-b8da-ec92ffd2a6dd', 'fe8b850b-8236-4645-b4dd-a8b5c1c1311d'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:08:20.727468 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-a2278a15-879f-43a1-ab09-866cdb67779c tempest-SnapshotsActionsTest-1566980060 None] Delete snapshot completed successfully. Feb 05 21:08:20.734693 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-a2278a15-879f-43a1-ab09-866cdb67779c tempest-SnapshotsActionsTest-1566980060 None] Lock "b'cinder-a4d6d532-34ba-4058-b665-22adee8f3701-delete_snapshot'" released by "delete_snapshot" :: held 1.316s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:08:21.626287 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-24b94a24-4ac6-4cee-8012-bab6e1f4a76d tempest-SnapshotsActionsTest-1566980060 None] Lock "b'cinder-dae0776f-b6f0-47f5-a940-e0506e33e08f-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:08:21.715036 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-24b94a24-4ac6-4cee-8012-bab6e1f4a76d tempest-SnapshotsActionsTest-1566980060 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:21.813139 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-24b94a24-4ac6-4cee-8012-bab6e1f4a76d tempest-SnapshotsActionsTest-1566980060 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:08:21.814114 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-24b94a24-4ac6-4cee-8012-bab6e1f4a76d tempest-SnapshotsActionsTest-1566980060 None] Volume volume-dae0776f-b6f0-47f5-a940-e0506e33e08f is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:08:21.828681 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-24b94a24-4ac6-4cee-8012-bab6e1f4a76d tempest-SnapshotsActionsTest-1566980060 None] deleting rbd volume volume-dae0776f-b6f0-47f5-a940-e0506e33e08f {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:08:22.376751 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-24b94a24-4ac6-4cee-8012-bab6e1f4a76d tempest-SnapshotsActionsTest-1566980060 None] Created reservations ['78f71623-9964-49b6-82b9-22a67aba7dd5', '315ad3e1-8207-4f2c-8436-e4d3dfc36f90', '49c1fb3f-dfec-48d3-9bdc-9bbaf43dc1fb', '3bd3bc4b-e5e7-4f69-8215-ec8e748599ab'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:08:22.452035 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-24b94a24-4ac6-4cee-8012-bab6e1f4a76d tempest-SnapshotsActionsTest-1566980060 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:22.499767 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-24b94a24-4ac6-4cee-8012-bab6e1f4a76d tempest-SnapshotsActionsTest-1566980060 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:22.558204 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-24b94a24-4ac6-4cee-8012-bab6e1f4a76d tempest-SnapshotsActionsTest-1566980060 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:08:22.563290 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-24b94a24-4ac6-4cee-8012-bab6e1f4a76d tempest-SnapshotsActionsTest-1566980060 None] Deleted volume successfully. Feb 05 21:08:22.583500 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-24b94a24-4ac6-4cee-8012-bab6e1f4a76d tempest-SnapshotsActionsTest-1566980060 None] Lock "b'cinder-dae0776f-b6f0-47f5-a940-e0506e33e08f-delete_volume'" released by "delete_volume" :: held 0.957s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:08:25.063715 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-de1adfa2-3a01-4455-91d4-3fbb28219d93 tempest-AbsoluteLimitsTests-304453813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:08:25.071464 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-de1adfa2-3a01-4455-91d4-3fbb28219d93 tempest-AbsoluteLimitsTests-304453813 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:08:25.072548 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-de1adfa2-3a01-4455-91d4-3fbb28219d93 tempest-AbsoluteLimitsTests-304453813 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:08:25.105070 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-de1adfa2-3a01-4455-91d4-3fbb28219d93 tempest-AbsoluteLimitsTests-304453813 None] Flow 'volume_create_manager' (62cfe46c-f700-49c8-81e6-2a2c26c5718d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:08:25.113881 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-de1adfa2-3a01-4455-91d4-3fbb28219d93 tempest-AbsoluteLimitsTests-304453813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad3e9eb2-f992-4401-941c-337c34563444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:25.121516 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-de1adfa2-3a01-4455-91d4-3fbb28219d93 tempest-AbsoluteLimitsTests-304453813 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:08:25.138236 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-de1adfa2-3a01-4455-91d4-3fbb28219d93 tempest-AbsoluteLimitsTests-304453813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad3e9eb2-f992-4401-941c-337c34563444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1433226091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=51d6d913-3a07-4bcc-8c1d-dd01c11c6523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5f75023903f477f9dcd0faac3d4a3a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:08:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:08:25Z,use_quota=True,user_id='a96296b0e2584d9ea2030dce32235899',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:25.145505 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-de1adfa2-3a01-4455-91d4-3fbb28219d93 tempest-AbsoluteLimitsTests-304453813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63cdc8fa-59b1-49d4-a56d-3e3808e39393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:25.150439 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-de1adfa2-3a01-4455-91d4-3fbb28219d93 tempest-AbsoluteLimitsTests-304453813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63cdc8fa-59b1-49d4-a56d-3e3808e39393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:25.157053 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-de1adfa2-3a01-4455-91d4-3fbb28219d93 tempest-AbsoluteLimitsTests-304453813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1629913-88e8-4040-8b26-3844b2fd81f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:25.162168 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-de1adfa2-3a01-4455-91d4-3fbb28219d93 tempest-AbsoluteLimitsTests-304453813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1629913-88e8-4040-8b26-3844b2fd81f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51d6d913-3a07-4bcc-8c1d-dd01c11c6523', 'volume_name': 'volume-51d6d913-3a07-4bcc-8c1d-dd01c11c6523', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:25.168087 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-de1adfa2-3a01-4455-91d4-3fbb28219d93 tempest-AbsoluteLimitsTests-304453813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (403ef6c2-e2c8-42dd-86ac-c127fc2a8b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:25.173093 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-de1adfa2-3a01-4455-91d4-3fbb28219d93 tempest-AbsoluteLimitsTests-304453813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (403ef6c2-e2c8-42dd-86ac-c127fc2a8b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:25.178796 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-de1adfa2-3a01-4455-91d4-3fbb28219d93 tempest-AbsoluteLimitsTests-304453813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (611121ff-9a56-456f-9229-701141b4b710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:25.179936 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-de1adfa2-3a01-4455-91d4-3fbb28219d93 tempest-AbsoluteLimitsTests-304453813 None] Volume 51d6d913-3a07-4bcc-8c1d-dd01c11c6523: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51d6d913-3a07-4bcc-8c1d-dd01c11c6523', 'volume_size': 1} Feb 05 21:08:25.180411 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-de1adfa2-3a01-4455-91d4-3fbb28219d93 tempest-AbsoluteLimitsTests-304453813 None] creating volume 'volume-51d6d913-3a07-4bcc-8c1d-dd01c11c6523' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:08:25.181416 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-de1adfa2-3a01-4455-91d4-3fbb28219d93 tempest-AbsoluteLimitsTests-304453813 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:25.277446 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-de1adfa2-3a01-4455-91d4-3fbb28219d93 tempest-AbsoluteLimitsTests-304453813 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:08:25.277813 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-de1adfa2-3a01-4455-91d4-3fbb28219d93 tempest-AbsoluteLimitsTests-304453813 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:08:25.282121 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-de1adfa2-3a01-4455-91d4-3fbb28219d93 tempest-AbsoluteLimitsTests-304453813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (611121ff-9a56-456f-9229-701141b4b710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51d6d913-3a07-4bcc-8c1d-dd01c11c6523', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:25.287155 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-de1adfa2-3a01-4455-91d4-3fbb28219d93 tempest-AbsoluteLimitsTests-304453813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11701b3f-664c-48a4-9a21-fbbd0b941809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:25.297752 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-de1adfa2-3a01-4455-91d4-3fbb28219d93 tempest-AbsoluteLimitsTests-304453813 None] Volume volume-51d6d913-3a07-4bcc-8c1d-dd01c11c6523 (51d6d913-3a07-4bcc-8c1d-dd01c11c6523): created successfully Feb 05 21:08:25.302804 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-de1adfa2-3a01-4455-91d4-3fbb28219d93 tempest-AbsoluteLimitsTests-304453813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11701b3f-664c-48a4-9a21-fbbd0b941809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:25.309105 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-de1adfa2-3a01-4455-91d4-3fbb28219d93 tempest-AbsoluteLimitsTests-304453813 None] Flow 'volume_create_manager' (62cfe46c-f700-49c8-81e6-2a2c26c5718d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:08:25.319864 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-de1adfa2-3a01-4455-91d4-3fbb28219d93 tempest-AbsoluteLimitsTests-304453813 None] Created volume successfully. Feb 05 21:08:26.205201 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-4fd80f8c-e551-4a27-af4b-e38cf4adb0fc tempest-AbsoluteLimitsTests-304453813 None] Lock "b'cinder-51d6d913-3a07-4bcc-8c1d-dd01c11c6523-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:08:26.266715 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-4fd80f8c-e551-4a27-af4b-e38cf4adb0fc tempest-AbsoluteLimitsTests-304453813 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:26.362807 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-4fd80f8c-e551-4a27-af4b-e38cf4adb0fc tempest-AbsoluteLimitsTests-304453813 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:08:26.363415 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-4fd80f8c-e551-4a27-af4b-e38cf4adb0fc tempest-AbsoluteLimitsTests-304453813 None] Volume volume-51d6d913-3a07-4bcc-8c1d-dd01c11c6523 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:08:26.379240 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-4fd80f8c-e551-4a27-af4b-e38cf4adb0fc tempest-AbsoluteLimitsTests-304453813 None] deleting rbd volume volume-51d6d913-3a07-4bcc-8c1d-dd01c11c6523 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:08:26.834327 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-4fd80f8c-e551-4a27-af4b-e38cf4adb0fc tempest-AbsoluteLimitsTests-304453813 None] Created reservations ['1546c789-2919-49b7-875a-6a6cd32f347f', 'dee80b54-b38a-43f2-9e1e-de295a49c887', '6497d44d-403f-4f75-bb0d-d9ee72426f94', '73facf25-918b-4244-a145-f57aca338a8c'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:08:26.917957 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-4fd80f8c-e551-4a27-af4b-e38cf4adb0fc tempest-AbsoluteLimitsTests-304453813 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:27.004298 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-4fd80f8c-e551-4a27-af4b-e38cf4adb0fc tempest-AbsoluteLimitsTests-304453813 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:27.064451 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-4fd80f8c-e551-4a27-af4b-e38cf4adb0fc tempest-AbsoluteLimitsTests-304453813 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:08:27.068827 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-4fd80f8c-e551-4a27-af4b-e38cf4adb0fc tempest-AbsoluteLimitsTests-304453813 None] Deleted volume successfully. Feb 05 21:08:27.095725 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-4fd80f8c-e551-4a27-af4b-e38cf4adb0fc tempest-AbsoluteLimitsTests-304453813 None] Lock "b'cinder-51d6d913-3a07-4bcc-8c1d-dd01c11c6523-delete_volume'" released by "delete_volume" :: held 0.890s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:08:28.630844 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-886b1304-6cea-4103-bcb7-2d2d5ac71368 tempest-VolumesServicesTestJSON-6028279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:08:28.638988 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-886b1304-6cea-4103-bcb7-2d2d5ac71368 tempest-VolumesServicesTestJSON-6028279 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:08:28.642795 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-886b1304-6cea-4103-bcb7-2d2d5ac71368 tempest-VolumesServicesTestJSON-6028279 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:08:28.677666 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-886b1304-6cea-4103-bcb7-2d2d5ac71368 tempest-VolumesServicesTestJSON-6028279 None] Flow 'volume_create_manager' (b235f7a0-a2be-4802-99c3-b676b02ca356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:08:28.686430 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-886b1304-6cea-4103-bcb7-2d2d5ac71368 tempest-VolumesServicesTestJSON-6028279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04744e50-4495-46a8-a346-20a026f684d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:28.694324 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-886b1304-6cea-4103-bcb7-2d2d5ac71368 tempest-VolumesServicesTestJSON-6028279 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:08:28.712713 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-886b1304-6cea-4103-bcb7-2d2d5ac71368 tempest-VolumesServicesTestJSON-6028279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04744e50-4495-46a8-a346-20a026f684d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-331801226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d28ef5b4-bca1-44ed-8a24-bc7639aeab43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18f202f339d24cd8a704511ef975c3ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:08:29Z,use_quota=True,user_id='4b828f6526bd4aa887da3a150dd9fd7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:28.719833 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-886b1304-6cea-4103-bcb7-2d2d5ac71368 tempest-VolumesServicesTestJSON-6028279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (575e0b1c-465a-4489-80e5-ae74ca282cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:28.725864 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-886b1304-6cea-4103-bcb7-2d2d5ac71368 tempest-VolumesServicesTestJSON-6028279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (575e0b1c-465a-4489-80e5-ae74ca282cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:28.733174 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-886b1304-6cea-4103-bcb7-2d2d5ac71368 tempest-VolumesServicesTestJSON-6028279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca076393-5086-4ae0-b5e1-870d9a3c8e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:28.739802 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-886b1304-6cea-4103-bcb7-2d2d5ac71368 tempest-VolumesServicesTestJSON-6028279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca076393-5086-4ae0-b5e1-870d9a3c8e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd28ef5b4-bca1-44ed-8a24-bc7639aeab43', 'volume_name': 'volume-d28ef5b4-bca1-44ed-8a24-bc7639aeab43', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:28.745640 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-886b1304-6cea-4103-bcb7-2d2d5ac71368 tempest-VolumesServicesTestJSON-6028279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b96eba9-ce12-41ec-bc83-e10b62ab9131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:28.752838 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-886b1304-6cea-4103-bcb7-2d2d5ac71368 tempest-VolumesServicesTestJSON-6028279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b96eba9-ce12-41ec-bc83-e10b62ab9131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:28.758796 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-886b1304-6cea-4103-bcb7-2d2d5ac71368 tempest-VolumesServicesTestJSON-6028279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcd402ce-d340-4ab3-98c5-516b7adadaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:28.760203 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-886b1304-6cea-4103-bcb7-2d2d5ac71368 tempest-VolumesServicesTestJSON-6028279 None] Volume d28ef5b4-bca1-44ed-8a24-bc7639aeab43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d28ef5b4-bca1-44ed-8a24-bc7639aeab43', 'volume_size': 1} Feb 05 21:08:28.760805 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-886b1304-6cea-4103-bcb7-2d2d5ac71368 tempest-VolumesServicesTestJSON-6028279 None] creating volume 'volume-d28ef5b4-bca1-44ed-8a24-bc7639aeab43' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:08:28.762042 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-886b1304-6cea-4103-bcb7-2d2d5ac71368 tempest-VolumesServicesTestJSON-6028279 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:28.866057 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-886b1304-6cea-4103-bcb7-2d2d5ac71368 tempest-VolumesServicesTestJSON-6028279 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:08:28.866526 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-886b1304-6cea-4103-bcb7-2d2d5ac71368 tempest-VolumesServicesTestJSON-6028279 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:08:28.871450 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-886b1304-6cea-4103-bcb7-2d2d5ac71368 tempest-VolumesServicesTestJSON-6028279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcd402ce-d340-4ab3-98c5-516b7adadaab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d28ef5b4-bca1-44ed-8a24-bc7639aeab43', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:28.881692 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-886b1304-6cea-4103-bcb7-2d2d5ac71368 tempest-VolumesServicesTestJSON-6028279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77c00ef9-d02c-4df0-9434-4669d7ca1065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:28.902901 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-886b1304-6cea-4103-bcb7-2d2d5ac71368 tempest-VolumesServicesTestJSON-6028279 None] Volume volume-d28ef5b4-bca1-44ed-8a24-bc7639aeab43 (d28ef5b4-bca1-44ed-8a24-bc7639aeab43): created successfully Feb 05 21:08:28.910213 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-886b1304-6cea-4103-bcb7-2d2d5ac71368 tempest-VolumesServicesTestJSON-6028279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77c00ef9-d02c-4df0-9434-4669d7ca1065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:28.921770 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-886b1304-6cea-4103-bcb7-2d2d5ac71368 tempest-VolumesServicesTestJSON-6028279 None] Flow 'volume_create_manager' (b235f7a0-a2be-4802-99c3-b676b02ca356) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:08:28.944701 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-886b1304-6cea-4103-bcb7-2d2d5ac71368 tempest-VolumesServicesTestJSON-6028279 None] Created volume successfully. Feb 05 21:08:29.723033 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-ce3af133-02f0-44d9-a481-c5760e572b9a tempest-VolumesServicesTestJSON-6028279 None] Lock "b'cinder-d28ef5b4-bca1-44ed-8a24-bc7639aeab43-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:08:29.780160 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ce3af133-02f0-44d9-a481-c5760e572b9a tempest-VolumesServicesTestJSON-6028279 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:29.844064 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ce3af133-02f0-44d9-a481-c5760e572b9a tempest-VolumesServicesTestJSON-6028279 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:08:29.844609 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ce3af133-02f0-44d9-a481-c5760e572b9a tempest-VolumesServicesTestJSON-6028279 None] Volume volume-d28ef5b4-bca1-44ed-8a24-bc7639aeab43 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:08:29.854831 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ce3af133-02f0-44d9-a481-c5760e572b9a tempest-VolumesServicesTestJSON-6028279 None] deleting rbd volume volume-d28ef5b4-bca1-44ed-8a24-bc7639aeab43 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:08:30.196194 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-ce3af133-02f0-44d9-a481-c5760e572b9a tempest-VolumesServicesTestJSON-6028279 None] Created reservations ['ad296f80-3c07-41a9-a79f-3c2bd95d50bf', 'f1382ce6-808d-4505-a4bd-c71b552a72ab', '82042a30-9968-42c8-a54b-22d57247cd58', '900a2c0d-37fa-49f1-b98a-ea64ee495008'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:08:30.298714 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ce3af133-02f0-44d9-a481-c5760e572b9a tempest-VolumesServicesTestJSON-6028279 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:30.359529 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ce3af133-02f0-44d9-a481-c5760e572b9a tempest-VolumesServicesTestJSON-6028279 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:30.441541 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-ce3af133-02f0-44d9-a481-c5760e572b9a tempest-VolumesServicesTestJSON-6028279 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:08:30.450443 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-ce3af133-02f0-44d9-a481-c5760e572b9a tempest-VolumesServicesTestJSON-6028279 None] Deleted volume successfully. Feb 05 21:08:30.472116 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-ce3af133-02f0-44d9-a481-c5760e572b9a tempest-VolumesServicesTestJSON-6028279 None] Lock "b'cinder-d28ef5b4-bca1-44ed-8a24-bc7639aeab43-delete_volume'" released by "delete_volume" :: held 0.749s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:08:30.918611 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9443ca7-52cb-434a-ad67-3f41ef1f1699 tempest-VolumesBackupsTest-350919582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:08:30.922513 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-e9443ca7-52cb-434a-ad67-3f41ef1f1699 tempest-VolumesBackupsTest-350919582 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:08:30.923170 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-e9443ca7-52cb-434a-ad67-3f41ef1f1699 tempest-VolumesBackupsTest-350919582 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:08:30.944013 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-e9443ca7-52cb-434a-ad67-3f41ef1f1699 tempest-VolumesBackupsTest-350919582 None] Flow 'volume_create_manager' (9de46138-2651-4f66-9e4c-095763ee5033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:08:30.950751 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-e9443ca7-52cb-434a-ad67-3f41ef1f1699 tempest-VolumesBackupsTest-350919582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dbf35d5-7a14-4818-a5c7-b40bc38976d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:30.959787 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-e9443ca7-52cb-434a-ad67-3f41ef1f1699 tempest-VolumesBackupsTest-350919582 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:08:30.979052 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-e9443ca7-52cb-434a-ad67-3f41ef1f1699 tempest-VolumesBackupsTest-350919582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dbf35d5-7a14-4818-a5c7-b40bc38976d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-2097162479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=551c13d3-70f5-4542-af53-7ecb3c3717f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d41cfbe49c14de89e32c8c88afef49a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:08:31Z,use_quota=True,user_id='76fea515065c484eb21f2054edc0a299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:30.987089 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-e9443ca7-52cb-434a-ad67-3f41ef1f1699 tempest-VolumesBackupsTest-350919582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a5d818-8cb1-4789-ad0f-881ec133ea75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:30.992579 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-e9443ca7-52cb-434a-ad67-3f41ef1f1699 tempest-VolumesBackupsTest-350919582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a5d818-8cb1-4789-ad0f-881ec133ea75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:31.002834 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-e9443ca7-52cb-434a-ad67-3f41ef1f1699 tempest-VolumesBackupsTest-350919582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4509b3f9-1699-4ca2-8d35-5cd9926a6922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:31.008226 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-e9443ca7-52cb-434a-ad67-3f41ef1f1699 tempest-VolumesBackupsTest-350919582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4509b3f9-1699-4ca2-8d35-5cd9926a6922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '551c13d3-70f5-4542-af53-7ecb3c3717f7', 'volume_name': 'volume-551c13d3-70f5-4542-af53-7ecb3c3717f7', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:31.014479 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-e9443ca7-52cb-434a-ad67-3f41ef1f1699 tempest-VolumesBackupsTest-350919582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d153d9e-a6fd-4b62-994d-367f28bb50cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:31.019014 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-e9443ca7-52cb-434a-ad67-3f41ef1f1699 tempest-VolumesBackupsTest-350919582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d153d9e-a6fd-4b62-994d-367f28bb50cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:31.024819 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-e9443ca7-52cb-434a-ad67-3f41ef1f1699 tempest-VolumesBackupsTest-350919582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2af2832-45d2-44e7-8914-421a3393253a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:31.026231 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-e9443ca7-52cb-434a-ad67-3f41ef1f1699 tempest-VolumesBackupsTest-350919582 None] Volume 551c13d3-70f5-4542-af53-7ecb3c3717f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-551c13d3-70f5-4542-af53-7ecb3c3717f7', 'volume_size': 1} Feb 05 21:08:31.026715 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e9443ca7-52cb-434a-ad67-3f41ef1f1699 tempest-VolumesBackupsTest-350919582 None] creating volume 'volume-551c13d3-70f5-4542-af53-7ecb3c3717f7' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:08:31.027969 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e9443ca7-52cb-434a-ad67-3f41ef1f1699 tempest-VolumesBackupsTest-350919582 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:31.113377 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e9443ca7-52cb-434a-ad67-3f41ef1f1699 tempest-VolumesBackupsTest-350919582 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:08:31.114396 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e9443ca7-52cb-434a-ad67-3f41ef1f1699 tempest-VolumesBackupsTest-350919582 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:08:31.117898 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-e9443ca7-52cb-434a-ad67-3f41ef1f1699 tempest-VolumesBackupsTest-350919582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2af2832-45d2-44e7-8914-421a3393253a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-551c13d3-70f5-4542-af53-7ecb3c3717f7', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:31.123627 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-e9443ca7-52cb-434a-ad67-3f41ef1f1699 tempest-VolumesBackupsTest-350919582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a86790c-a8cf-4240-a7e7-a1595a722bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:31.139829 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-e9443ca7-52cb-434a-ad67-3f41ef1f1699 tempest-VolumesBackupsTest-350919582 None] Volume volume-551c13d3-70f5-4542-af53-7ecb3c3717f7 (551c13d3-70f5-4542-af53-7ecb3c3717f7): created successfully Feb 05 21:08:31.143982 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-e9443ca7-52cb-434a-ad67-3f41ef1f1699 tempest-VolumesBackupsTest-350919582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a86790c-a8cf-4240-a7e7-a1595a722bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:31.160326 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-e9443ca7-52cb-434a-ad67-3f41ef1f1699 tempest-VolumesBackupsTest-350919582 None] Flow 'volume_create_manager' (9de46138-2651-4f66-9e4c-095763ee5033) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:08:31.180402 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-e9443ca7-52cb-434a-ad67-3f41ef1f1699 tempest-VolumesBackupsTest-350919582 None] Created volume successfully. Feb 05 21:08:36.069783 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-aaa3c316-1eea-4870-92f2-1aefc0b393c3 tempest-GroupsV320Test-1915397756 None] Group tempest-GroupsV320Test-Group-987684678: creating Feb 05 21:08:36.113411 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-aaa3c316-1eea-4870-92f2-1aefc0b393c3 tempest-GroupsV320Test-1915397756 None] Group tempest-GroupsV320Test-Group-987684678: created successfully Feb 05 21:08:36.137609 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-aaa3c316-1eea-4870-92f2-1aefc0b393c3 tempest-GroupsV320Test-1915397756 None] Create group completed successfully. Feb 05 21:08:36.477477 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b0746c3-2dd9-4a99-9cfc-421461ad9f6d tempest-VolumeTypesAccessTest-1589595439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:08:36.481200 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-5b0746c3-2dd9-4a99-9cfc-421461ad9f6d tempest-VolumeTypesAccessTest-1589595439 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:08:36.481647 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-5b0746c3-2dd9-4a99-9cfc-421461ad9f6d tempest-VolumeTypesAccessTest-1589595439 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:08:36.501834 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5b0746c3-2dd9-4a99-9cfc-421461ad9f6d tempest-VolumeTypesAccessTest-1589595439 None] Flow 'volume_create_manager' (2a4a7d2a-4da1-4087-b49c-c0bdf0037a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:08:36.509921 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5b0746c3-2dd9-4a99-9cfc-421461ad9f6d tempest-VolumeTypesAccessTest-1589595439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f65ffd7-3b64-4c1f-bfbc-eea334aacbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:36.518912 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-5b0746c3-2dd9-4a99-9cfc-421461ad9f6d tempest-VolumeTypesAccessTest-1589595439 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:08:36.555918 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5b0746c3-2dd9-4a99-9cfc-421461ad9f6d tempest-VolumeTypesAccessTest-1589595439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f65ffd7-3b64-4c1f-bfbc-eea334aacbb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-127646004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1bd53650-b4dc-43c2-ad5b-213d68ababd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f90d4f6a2e364c69b9a4560ad07c76d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:08:36Z,use_quota=True,user_id='76058131885145b59d0023e168601f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f287f27-066f-467f-ab1f-5aaf2a5ec0df),volume_type_id=9f287f27-066f-467f-ab1f-5aaf2a5ec0df)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:36.562704 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5b0746c3-2dd9-4a99-9cfc-421461ad9f6d tempest-VolumeTypesAccessTest-1589595439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f24ef4-463a-4996-bd55-dafe45febb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:36.567584 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5b0746c3-2dd9-4a99-9cfc-421461ad9f6d tempest-VolumeTypesAccessTest-1589595439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f24ef4-463a-4996-bd55-dafe45febb51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:36.573873 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5b0746c3-2dd9-4a99-9cfc-421461ad9f6d tempest-VolumeTypesAccessTest-1589595439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2520302e-cefe-47ac-9735-617061d49b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:36.580573 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5b0746c3-2dd9-4a99-9cfc-421461ad9f6d tempest-VolumeTypesAccessTest-1589595439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2520302e-cefe-47ac-9735-617061d49b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bd53650-b4dc-43c2-ad5b-213d68ababd2', 'volume_name': 'volume-1bd53650-b4dc-43c2-ad5b-213d68ababd2', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:36.587841 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5b0746c3-2dd9-4a99-9cfc-421461ad9f6d tempest-VolumeTypesAccessTest-1589595439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5c45ded-952f-4b83-822d-fdcac3a52d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:36.594702 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5b0746c3-2dd9-4a99-9cfc-421461ad9f6d tempest-VolumeTypesAccessTest-1589595439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5c45ded-952f-4b83-822d-fdcac3a52d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:36.600929 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5b0746c3-2dd9-4a99-9cfc-421461ad9f6d tempest-VolumeTypesAccessTest-1589595439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f543cd05-5769-4496-9d00-e250ef4e1867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:36.602546 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-5b0746c3-2dd9-4a99-9cfc-421461ad9f6d tempest-VolumeTypesAccessTest-1589595439 None] Volume 1bd53650-b4dc-43c2-ad5b-213d68ababd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bd53650-b4dc-43c2-ad5b-213d68ababd2', 'volume_size': 1} Feb 05 21:08:36.603173 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5b0746c3-2dd9-4a99-9cfc-421461ad9f6d tempest-VolumeTypesAccessTest-1589595439 None] creating volume 'volume-1bd53650-b4dc-43c2-ad5b-213d68ababd2' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:08:36.604668 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5b0746c3-2dd9-4a99-9cfc-421461ad9f6d tempest-VolumeTypesAccessTest-1589595439 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:36.757137 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5b0746c3-2dd9-4a99-9cfc-421461ad9f6d tempest-VolumeTypesAccessTest-1589595439 None] extra_specs: {} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:08:36.757615 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5b0746c3-2dd9-4a99-9cfc-421461ad9f6d tempest-VolumeTypesAccessTest-1589595439 None] extra_specs: {} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:08:36.761533 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5b0746c3-2dd9-4a99-9cfc-421461ad9f6d tempest-VolumeTypesAccessTest-1589595439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f543cd05-5769-4496-9d00-e250ef4e1867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bd53650-b4dc-43c2-ad5b-213d68ababd2', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:36.777626 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5b0746c3-2dd9-4a99-9cfc-421461ad9f6d tempest-VolumeTypesAccessTest-1589595439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e9ceae3-6516-4e9a-957b-ed4822e8c34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:36.788538 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-5b0746c3-2dd9-4a99-9cfc-421461ad9f6d tempest-VolumeTypesAccessTest-1589595439 None] Volume volume-1bd53650-b4dc-43c2-ad5b-213d68ababd2 (1bd53650-b4dc-43c2-ad5b-213d68ababd2): created successfully Feb 05 21:08:36.794430 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5b0746c3-2dd9-4a99-9cfc-421461ad9f6d tempest-VolumeTypesAccessTest-1589595439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e9ceae3-6516-4e9a-957b-ed4822e8c34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:36.802221 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5b0746c3-2dd9-4a99-9cfc-421461ad9f6d tempest-VolumeTypesAccessTest-1589595439 None] Flow 'volume_create_manager' (2a4a7d2a-4da1-4087-b49c-c0bdf0037a6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:08:36.813849 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-5b0746c3-2dd9-4a99-9cfc-421461ad9f6d tempest-VolumeTypesAccessTest-1589595439 None] Created volume successfully. Feb 05 21:08:37.680614 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-5823e600-686d-43d9-a9e3-2ddc1376172a tempest-GroupsV320Test-1915397756 None] Created reservations ['b892afc3-7779-4dec-b223-53b82e55cf49'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:08:37.761734 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5823e600-686d-43d9-a9e3-2ddc1376172a tempest-GroupsV320Test-1915397756 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:37.846452 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5823e600-686d-43d9-a9e3-2ddc1376172a tempest-GroupsV320Test-1915397756 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:37.924664 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-5823e600-686d-43d9-a9e3-2ddc1376172a tempest-GroupsV320Test-1915397756 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:08:37.957965 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-5823e600-686d-43d9-a9e3-2ddc1376172a tempest-GroupsV320Test-1915397756 None] Delete group completed successfully. Feb 05 21:08:37.972531 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-5b583fa5-a16c-4030-9524-e46e5dcf5626 tempest-VolumeTypesAccessTest-1589595439 None] Lock "b'cinder-1bd53650-b4dc-43c2-ad5b-213d68ababd2-delete_volume'" acquired by "delete_volume" :: waited 0.035s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:08:38.023971 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5b583fa5-a16c-4030-9524-e46e5dcf5626 tempest-VolumeTypesAccessTest-1589595439 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:38.079822 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5b583fa5-a16c-4030-9524-e46e5dcf5626 tempest-VolumeTypesAccessTest-1589595439 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:08:38.080221 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5b583fa5-a16c-4030-9524-e46e5dcf5626 tempest-VolumeTypesAccessTest-1589595439 None] Volume volume-1bd53650-b4dc-43c2-ad5b-213d68ababd2 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:08:38.086445 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5b583fa5-a16c-4030-9524-e46e5dcf5626 tempest-VolumeTypesAccessTest-1589595439 None] deleting rbd volume volume-1bd53650-b4dc-43c2-ad5b-213d68ababd2 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:08:38.408838 ncdv-master-1 cinder-volume[122683]: WARNING cinder.quota [None req-5b583fa5-a16c-4030-9524-e46e5dcf5626 tempest-VolumeTypesAccessTest-1589595439 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-135140 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-135140, it is now deprecated. Please use the default quota class for default quota. Feb 05 21:08:38.409817 ncdv-master-1 cinder-volume[122683]: WARNING cinder.quota [None req-5b583fa5-a16c-4030-9524-e46e5dcf5626 tempest-VolumeTypesAccessTest-1589595439 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-135140 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-135140, it is now deprecated. Please use the default quota class for default quota. Feb 05 21:08:38.426255 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-5b583fa5-a16c-4030-9524-e46e5dcf5626 tempest-VolumeTypesAccessTest-1589595439 None] Created reservations ['9d824ed2-b2a1-4735-badd-ed2a443194db', '65042b80-2248-4ed2-9bd8-78b2837b42bf', 'f68ecfd8-92ff-4fea-8353-f846779c6166', 'cfe0be44-7656-49af-ac16-f67f6cc453f7'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:08:38.471707 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5b583fa5-a16c-4030-9524-e46e5dcf5626 tempest-VolumeTypesAccessTest-1589595439 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:38.510151 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5b583fa5-a16c-4030-9524-e46e5dcf5626 tempest-VolumeTypesAccessTest-1589595439 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:38.542277 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-5b583fa5-a16c-4030-9524-e46e5dcf5626 tempest-VolumeTypesAccessTest-1589595439 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:08:38.547914 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-5b583fa5-a16c-4030-9524-e46e5dcf5626 tempest-VolumeTypesAccessTest-1589595439 None] Deleted volume successfully. Feb 05 21:08:38.568598 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-5b583fa5-a16c-4030-9524-e46e5dcf5626 tempest-VolumeTypesAccessTest-1589595439 None] Lock "b'cinder-1bd53650-b4dc-43c2-ad5b-213d68ababd2-delete_volume'" released by "delete_volume" :: held 0.596s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:08:46.142366 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-0cb8221a-977e-437c-aceb-2d9d20bca2f9 req-a32c3580-bb04-45a6-b941-17ace3bf155c tempest-VolumesBackupsTest-350919582 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 21:08:47.002526 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-0cb8221a-977e-437c-aceb-2d9d20bca2f9 req-a32c3580-bb04-45a6-b941-17ace3bf155c tempest-VolumesBackupsTest-350919582 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.860s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 21:08:47.003379 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-0cb8221a-977e-437c-aceb-2d9d20bca2f9 req-a32c3580-bb04-45a6-b941-17ace3bf155c tempest-VolumesBackupsTest-350919582 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-551c13d3-70f5-4542-af53-7ecb3c3717f7', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': '551c13d3-70f5-4542-af53-7ecb3c3717f7', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 21:08:47.032133 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-0cb8221a-977e-437c-aceb-2d9d20bca2f9 req-a32c3580-bb04-45a6-b941-17ace3bf155c tempest-VolumesBackupsTest-350919582 None] Connection info returned from driver {'name': 'volumes/volume-551c13d3-70f5-4542-af53-7ecb3c3717f7', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '551c13d3-70f5-4542-af53-7ecb3c3717f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'fc483910-05e5-4c68-8b6f-93105adbd4dc'} {{(pid=122683) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 05 21:08:47.082591 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-0cb8221a-977e-437c-aceb-2d9d20bca2f9 req-a32c3580-bb04-45a6-b941-17ace3bf155c tempest-VolumesBackupsTest-350919582 None] attachment_update completed successfully. Feb 05 21:08:49.413002 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-cd87f56a-8c9f-4a8c-9a38-5e6df7970a9e tempest-VolumesBackupsTest-350919582 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-02-05T21:08:49Z,data_timestamp=2022-02-05T21:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-919240273',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=f8bc9e59-8980-46a3-98d2-4f280054bdf8,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='0d41cfbe49c14de89e32c8c88afef49a',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='76fea515065c484eb21f2054edc0a299',volume_id=551c13d3-70f5-4542-af53-7ecb3c3717f7) Feb 05 21:08:49.413931 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.backup.rpcapi [None req-cd87f56a-8c9f-4a8c-9a38-5e6df7970a9e tempest-VolumesBackupsTest-350919582 None] continue_backup in rpcapi backup_id f8bc9e59-8980-46a3-98d2-4f280054bdf8 {{(pid=122683) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Feb 05 21:08:49.625765 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [None req-cd87f56a-8c9f-4a8c-9a38-5e6df7970a9e tempest-VolumesBackupsTest-350919582 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 21:08:50.567406 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [None req-cd87f56a-8c9f-4a8c-9a38-5e6df7970a9e tempest-VolumesBackupsTest-350919582 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.941s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 21:08:50.569257 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-cd87f56a-8c9f-4a8c-9a38-5e6df7970a9e tempest-VolumesBackupsTest-350919582 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-551c13d3-70f5-4542-af53-7ecb3c3717f7', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': '551c13d3-70f5-4542-af53-7ecb3c3717f7', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 21:08:50.592980 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-cd87f56a-8c9f-4a8c-9a38-5e6df7970a9e tempest-VolumesBackupsTest-350919582 None] Initialize volume connection completed successfully. Feb 05 21:08:51.458050 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb8a756d-5d51-491c-8766-124ba83523c0 tempest-VolumesTransfersTest-944552185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:08:51.462409 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-fb8a756d-5d51-491c-8766-124ba83523c0 tempest-VolumesTransfersTest-944552185 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:08:51.462963 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-fb8a756d-5d51-491c-8766-124ba83523c0 tempest-VolumesTransfersTest-944552185 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:08:51.486967 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-fb8a756d-5d51-491c-8766-124ba83523c0 tempest-VolumesTransfersTest-944552185 None] Flow 'volume_create_manager' (b01f4259-01cf-46f2-845d-3b4a24b70017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:08:51.493996 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-fb8a756d-5d51-491c-8766-124ba83523c0 tempest-VolumesTransfersTest-944552185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1557c337-5a1b-4c86-bd36-ee33f29538fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:51.502695 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-fb8a756d-5d51-491c-8766-124ba83523c0 tempest-VolumesTransfersTest-944552185 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:08:51.522990 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-fb8a756d-5d51-491c-8766-124ba83523c0 tempest-VolumesTransfersTest-944552185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1557c337-5a1b-4c86-bd36-ee33f29538fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1281668481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f873ee32-38d1-40c4-a376-a3cdee20c1d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac986d6c121f45bd9657e2598b5f1230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:08:51Z,use_quota=True,user_id='d5c342e84ddf4de093b1f846bc2f5874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:51.530193 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-fb8a756d-5d51-491c-8766-124ba83523c0 tempest-VolumesTransfersTest-944552185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5629d46a-2bf6-4fae-9e23-baadb09475f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:51.535516 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-fb8a756d-5d51-491c-8766-124ba83523c0 tempest-VolumesTransfersTest-944552185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5629d46a-2bf6-4fae-9e23-baadb09475f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:51.549323 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-fb8a756d-5d51-491c-8766-124ba83523c0 tempest-VolumesTransfersTest-944552185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd55f499-7873-46ab-a869-6395cafc0120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:51.554468 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-fb8a756d-5d51-491c-8766-124ba83523c0 tempest-VolumesTransfersTest-944552185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd55f499-7873-46ab-a869-6395cafc0120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f873ee32-38d1-40c4-a376-a3cdee20c1d9', 'volume_name': 'volume-f873ee32-38d1-40c4-a376-a3cdee20c1d9', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:51.560380 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-fb8a756d-5d51-491c-8766-124ba83523c0 tempest-VolumesTransfersTest-944552185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7681a5e1-b5e9-40f0-acf8-12c2b14dad9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:51.564793 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-fb8a756d-5d51-491c-8766-124ba83523c0 tempest-VolumesTransfersTest-944552185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7681a5e1-b5e9-40f0-acf8-12c2b14dad9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:51.570244 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-fb8a756d-5d51-491c-8766-124ba83523c0 tempest-VolumesTransfersTest-944552185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06eda756-5960-4c80-9a2f-267714d10dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:51.572139 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-fb8a756d-5d51-491c-8766-124ba83523c0 tempest-VolumesTransfersTest-944552185 None] Volume f873ee32-38d1-40c4-a376-a3cdee20c1d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f873ee32-38d1-40c4-a376-a3cdee20c1d9', 'volume_size': 1} Feb 05 21:08:51.572792 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-fb8a756d-5d51-491c-8766-124ba83523c0 tempest-VolumesTransfersTest-944552185 None] creating volume 'volume-f873ee32-38d1-40c4-a376-a3cdee20c1d9' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:08:51.574081 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-fb8a756d-5d51-491c-8766-124ba83523c0 tempest-VolumesTransfersTest-944552185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:51.739186 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-fb8a756d-5d51-491c-8766-124ba83523c0 tempest-VolumesTransfersTest-944552185 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:08:51.739763 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-fb8a756d-5d51-491c-8766-124ba83523c0 tempest-VolumesTransfersTest-944552185 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:08:51.744054 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-fb8a756d-5d51-491c-8766-124ba83523c0 tempest-VolumesTransfersTest-944552185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06eda756-5960-4c80-9a2f-267714d10dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f873ee32-38d1-40c4-a376-a3cdee20c1d9', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:51.759319 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-fb8a756d-5d51-491c-8766-124ba83523c0 tempest-VolumesTransfersTest-944552185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d15becb4-e371-4902-9265-ef604c001482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:51.787679 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-fb8a756d-5d51-491c-8766-124ba83523c0 tempest-VolumesTransfersTest-944552185 None] Volume volume-f873ee32-38d1-40c4-a376-a3cdee20c1d9 (f873ee32-38d1-40c4-a376-a3cdee20c1d9): created successfully Feb 05 21:08:51.794935 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-fb8a756d-5d51-491c-8766-124ba83523c0 tempest-VolumesTransfersTest-944552185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d15becb4-e371-4902-9265-ef604c001482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:51.834356 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-fb8a756d-5d51-491c-8766-124ba83523c0 tempest-VolumesTransfersTest-944552185 None] Flow 'volume_create_manager' (b01f4259-01cf-46f2-845d-3b4a24b70017) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:08:51.867646 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-fb8a756d-5d51-491c-8766-124ba83523c0 tempest-VolumesTransfersTest-944552185 None] Created volume successfully. Feb 05 21:08:52.320970 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-2173083a-755a-487d-9fad-8977c939e75f tempest-VolumeQuotasAdminTestJSON-1296053062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:08:52.324321 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-2173083a-755a-487d-9fad-8977c939e75f tempest-VolumeQuotasAdminTestJSON-1296053062 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:08:52.324757 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-2173083a-755a-487d-9fad-8977c939e75f tempest-VolumeQuotasAdminTestJSON-1296053062 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:08:52.345267 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-2173083a-755a-487d-9fad-8977c939e75f tempest-VolumeQuotasAdminTestJSON-1296053062 None] Flow 'volume_create_manager' (76c807fb-0ae1-47fd-9fba-264e61bffed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:08:52.352235 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-2173083a-755a-487d-9fad-8977c939e75f tempest-VolumeQuotasAdminTestJSON-1296053062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e38aca94-5fdd-42fa-9c11-b08e23eb0b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:52.359462 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-2173083a-755a-487d-9fad-8977c939e75f tempest-VolumeQuotasAdminTestJSON-1296053062 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:08:52.374635 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-2173083a-755a-487d-9fad-8977c939e75f tempest-VolumeQuotasAdminTestJSON-1296053062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e38aca94-5fdd-42fa-9c11-b08e23eb0b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1379023367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f3c143a2-e595-47ea-a418-a7fd2957805e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b607e8dcfc498fa8d7f8598213ab44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:08:52Z,use_quota=True,user_id='702bdd7dd9c749e58830639f074ae0a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:52.380066 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-2173083a-755a-487d-9fad-8977c939e75f tempest-VolumeQuotasAdminTestJSON-1296053062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36d11db5-7b8b-401b-9697-76dc1379ebfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:52.384238 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-2173083a-755a-487d-9fad-8977c939e75f tempest-VolumeQuotasAdminTestJSON-1296053062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36d11db5-7b8b-401b-9697-76dc1379ebfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:52.389797 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-2173083a-755a-487d-9fad-8977c939e75f tempest-VolumeQuotasAdminTestJSON-1296053062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84e74f12-5261-4d45-b1b2-68b7feee9b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:52.394054 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-2173083a-755a-487d-9fad-8977c939e75f tempest-VolumeQuotasAdminTestJSON-1296053062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84e74f12-5261-4d45-b1b2-68b7feee9b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3c143a2-e595-47ea-a418-a7fd2957805e', 'volume_name': 'volume-f3c143a2-e595-47ea-a418-a7fd2957805e', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:52.399142 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-2173083a-755a-487d-9fad-8977c939e75f tempest-VolumeQuotasAdminTestJSON-1296053062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (636fa198-b45c-41e0-8a49-26d9378bfec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:52.404123 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-2173083a-755a-487d-9fad-8977c939e75f tempest-VolumeQuotasAdminTestJSON-1296053062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (636fa198-b45c-41e0-8a49-26d9378bfec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:52.409031 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-2173083a-755a-487d-9fad-8977c939e75f tempest-VolumeQuotasAdminTestJSON-1296053062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cf9e205-cdd4-4d30-8f3c-395fd0a6dee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:52.410127 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-2173083a-755a-487d-9fad-8977c939e75f tempest-VolumeQuotasAdminTestJSON-1296053062 None] Volume f3c143a2-e595-47ea-a418-a7fd2957805e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3c143a2-e595-47ea-a418-a7fd2957805e', 'volume_size': 1} Feb 05 21:08:52.410549 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-2173083a-755a-487d-9fad-8977c939e75f tempest-VolumeQuotasAdminTestJSON-1296053062 None] creating volume 'volume-f3c143a2-e595-47ea-a418-a7fd2957805e' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:08:52.411535 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-2173083a-755a-487d-9fad-8977c939e75f tempest-VolumeQuotasAdminTestJSON-1296053062 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:52.516261 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-2173083a-755a-487d-9fad-8977c939e75f tempest-VolumeQuotasAdminTestJSON-1296053062 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:08:52.516744 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-2173083a-755a-487d-9fad-8977c939e75f tempest-VolumeQuotasAdminTestJSON-1296053062 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:08:52.520689 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-2173083a-755a-487d-9fad-8977c939e75f tempest-VolumeQuotasAdminTestJSON-1296053062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cf9e205-cdd4-4d30-8f3c-395fd0a6dee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3c143a2-e595-47ea-a418-a7fd2957805e', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:52.528973 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-2173083a-755a-487d-9fad-8977c939e75f tempest-VolumeQuotasAdminTestJSON-1296053062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb81cc2c-dedd-4117-8574-5c6590d2194b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:52.551102 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-2173083a-755a-487d-9fad-8977c939e75f tempest-VolumeQuotasAdminTestJSON-1296053062 None] Volume volume-f3c143a2-e595-47ea-a418-a7fd2957805e (f3c143a2-e595-47ea-a418-a7fd2957805e): created successfully Feb 05 21:08:52.567576 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-2173083a-755a-487d-9fad-8977c939e75f tempest-VolumeQuotasAdminTestJSON-1296053062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb81cc2c-dedd-4117-8574-5c6590d2194b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:52.571741 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-2173083a-755a-487d-9fad-8977c939e75f tempest-VolumeQuotasAdminTestJSON-1296053062 None] Flow 'volume_create_manager' (76c807fb-0ae1-47fd-9fba-264e61bffed2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:08:52.585901 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-2173083a-755a-487d-9fad-8977c939e75f tempest-VolumeQuotasAdminTestJSON-1296053062 None] Created volume successfully. Feb 05 21:08:52.832087 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-cd87f56a-8c9f-4a8c-9a38-5e6df7970a9e tempest-VolumesBackupsTest-350919582 None] Terminate volume connection completed successfully. Feb 05 21:08:52.853756 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-cd87f56a-8c9f-4a8c-9a38-5e6df7970a9e tempest-VolumesBackupsTest-350919582 None] Remove volume export completed successfully. Feb 05 21:08:53.150037 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-9b4f493b-44ea-4281-87c7-8109622a1ee3 tempest-VolumesTransfersTest-1556286717 None] Transfer volume completed successfully. Feb 05 21:08:53.556875 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-31848726-3f0e-4525-bf09-9281816435d4 tempest-VolumeQuotasAdminTestJSON-1296053062 None] Lock "b'cinder-f3c143a2-e595-47ea-a418-a7fd2957805e-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:08:53.636084 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-31848726-3f0e-4525-bf09-9281816435d4 tempest-VolumeQuotasAdminTestJSON-1296053062 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:53.706301 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-31848726-3f0e-4525-bf09-9281816435d4 tempest-VolumeQuotasAdminTestJSON-1296053062 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:08:53.707775 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-31848726-3f0e-4525-bf09-9281816435d4 tempest-VolumeQuotasAdminTestJSON-1296053062 None] Volume volume-f3c143a2-e595-47ea-a418-a7fd2957805e is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:08:53.717006 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-31848726-3f0e-4525-bf09-9281816435d4 tempest-VolumeQuotasAdminTestJSON-1296053062 None] deleting rbd volume volume-f3c143a2-e595-47ea-a418-a7fd2957805e {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:08:53.906152 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-97cd51fd-a511-44e1-9170-2889b8915bb4 tempest-VolumesTransfersTest-1775449822 None] Lock "b'cinder-f873ee32-38d1-40c4-a376-a3cdee20c1d9-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:08:53.943325 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-97cd51fd-a511-44e1-9170-2889b8915bb4 tempest-VolumesTransfersTest-1775449822 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:54.017849 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-97cd51fd-a511-44e1-9170-2889b8915bb4 tempest-VolumesTransfersTest-1775449822 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:08:54.018717 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-97cd51fd-a511-44e1-9170-2889b8915bb4 tempest-VolumesTransfersTest-1775449822 None] Volume volume-f873ee32-38d1-40c4-a376-a3cdee20c1d9 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:08:54.026051 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-97cd51fd-a511-44e1-9170-2889b8915bb4 tempest-VolumesTransfersTest-1775449822 None] deleting rbd volume volume-f873ee32-38d1-40c4-a376-a3cdee20c1d9 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:08:54.122757 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-31848726-3f0e-4525-bf09-9281816435d4 tempest-VolumeQuotasAdminTestJSON-1296053062 None] Created reservations ['bac4e0dc-9173-448d-9ce6-5e5243eda390', '0fc7b0e0-983e-4368-99e0-016d5feb57f4', 'e4b191d6-6d33-4596-965f-3b722aa74094', '056f97e4-1709-4ab5-8413-ad687b4610f9'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:08:54.189492 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-31848726-3f0e-4525-bf09-9281816435d4 tempest-VolumeQuotasAdminTestJSON-1296053062 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:54.237016 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-31848726-3f0e-4525-bf09-9281816435d4 tempest-VolumeQuotasAdminTestJSON-1296053062 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:54.275760 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-31848726-3f0e-4525-bf09-9281816435d4 tempest-VolumeQuotasAdminTestJSON-1296053062 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:08:54.282120 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-31848726-3f0e-4525-bf09-9281816435d4 tempest-VolumeQuotasAdminTestJSON-1296053062 None] Deleted volume successfully. Feb 05 21:08:54.305323 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-31848726-3f0e-4525-bf09-9281816435d4 tempest-VolumeQuotasAdminTestJSON-1296053062 None] Lock "b'cinder-f3c143a2-e595-47ea-a418-a7fd2957805e-delete_volume'" released by "delete_volume" :: held 0.749s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:08:54.366860 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-97cd51fd-a511-44e1-9170-2889b8915bb4 tempest-VolumesTransfersTest-1775449822 None] Created reservations ['6694e204-2b74-4625-b854-17ce1282cc92', '7b4edfa4-0ffb-4e10-9f66-a063ec528518', '6c2e0882-09bd-40ed-951d-727244b03510', '1f407597-6ad3-4098-bca5-a34cadfa3d07'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:08:54.421647 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-97cd51fd-a511-44e1-9170-2889b8915bb4 tempest-VolumesTransfersTest-1775449822 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:54.459284 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-97cd51fd-a511-44e1-9170-2889b8915bb4 tempest-VolumesTransfersTest-1775449822 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:54.489451 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-97cd51fd-a511-44e1-9170-2889b8915bb4 tempest-VolumesTransfersTest-1775449822 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:08:54.499341 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-97cd51fd-a511-44e1-9170-2889b8915bb4 tempest-VolumesTransfersTest-1775449822 None] Deleted volume successfully. Feb 05 21:08:54.514526 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-97cd51fd-a511-44e1-9170-2889b8915bb4 tempest-VolumesTransfersTest-1775449822 None] Lock "b'cinder-f873ee32-38d1-40c4-a376-a3cdee20c1d9-delete_volume'" released by "delete_volume" :: held 0.608s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:08:55.079858 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-df0680e3-e56b-49c9-a887-54726067ac70 tempest-VolumeQuotasAdminTestJSON-1296053062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:08:55.087485 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-df0680e3-e56b-49c9-a887-54726067ac70 tempest-VolumeQuotasAdminTestJSON-1296053062 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:08:55.089386 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-df0680e3-e56b-49c9-a887-54726067ac70 tempest-VolumeQuotasAdminTestJSON-1296053062 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:08:55.111385 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-df0680e3-e56b-49c9-a887-54726067ac70 tempest-VolumeQuotasAdminTestJSON-1296053062 None] Flow 'volume_create_manager' (3125bec5-9a4f-4931-8ed1-40b6f42c3047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:08:55.119363 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-df0680e3-e56b-49c9-a887-54726067ac70 tempest-VolumeQuotasAdminTestJSON-1296053062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f5efaec-3b87-4765-89ee-cb6a03f5a6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:55.126543 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-df0680e3-e56b-49c9-a887-54726067ac70 tempest-VolumeQuotasAdminTestJSON-1296053062 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:08:55.141280 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-df0680e3-e56b-49c9-a887-54726067ac70 tempest-VolumeQuotasAdminTestJSON-1296053062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f5efaec-3b87-4765-89ee-cb6a03f5a6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-363913682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a2c7d316-6947-4482-824a-407f4ae365fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b607e8dcfc498fa8d7f8598213ab44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:08:55Z,use_quota=True,user_id='702bdd7dd9c749e58830639f074ae0a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:55.147413 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-df0680e3-e56b-49c9-a887-54726067ac70 tempest-VolumeQuotasAdminTestJSON-1296053062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fe94a4a-a332-42b8-9b18-b44d313c5167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:55.151877 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-df0680e3-e56b-49c9-a887-54726067ac70 tempest-VolumeQuotasAdminTestJSON-1296053062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fe94a4a-a332-42b8-9b18-b44d313c5167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:55.158939 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-df0680e3-e56b-49c9-a887-54726067ac70 tempest-VolumeQuotasAdminTestJSON-1296053062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0feab74-5779-4428-9115-14ad958e5f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:55.164505 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-df0680e3-e56b-49c9-a887-54726067ac70 tempest-VolumeQuotasAdminTestJSON-1296053062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0feab74-5779-4428-9115-14ad958e5f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2c7d316-6947-4482-824a-407f4ae365fd', 'volume_name': 'volume-a2c7d316-6947-4482-824a-407f4ae365fd', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:55.171373 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-df0680e3-e56b-49c9-a887-54726067ac70 tempest-VolumeQuotasAdminTestJSON-1296053062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8059db91-4db8-49bd-8014-2132454f1d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:55.175983 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-df0680e3-e56b-49c9-a887-54726067ac70 tempest-VolumeQuotasAdminTestJSON-1296053062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8059db91-4db8-49bd-8014-2132454f1d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:55.181454 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-df0680e3-e56b-49c9-a887-54726067ac70 tempest-VolumeQuotasAdminTestJSON-1296053062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dd1d8d0-6c00-40c7-975e-d1c2d74d4d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:55.182646 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-df0680e3-e56b-49c9-a887-54726067ac70 tempest-VolumeQuotasAdminTestJSON-1296053062 None] Volume a2c7d316-6947-4482-824a-407f4ae365fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2c7d316-6947-4482-824a-407f4ae365fd', 'volume_size': 1} Feb 05 21:08:55.183134 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-df0680e3-e56b-49c9-a887-54726067ac70 tempest-VolumeQuotasAdminTestJSON-1296053062 None] creating volume 'volume-a2c7d316-6947-4482-824a-407f4ae365fd' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:08:55.184280 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-df0680e3-e56b-49c9-a887-54726067ac70 tempest-VolumeQuotasAdminTestJSON-1296053062 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:55.269724 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-df0680e3-e56b-49c9-a887-54726067ac70 tempest-VolumeQuotasAdminTestJSON-1296053062 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:08:55.270130 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-df0680e3-e56b-49c9-a887-54726067ac70 tempest-VolumeQuotasAdminTestJSON-1296053062 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:08:55.275175 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-df0680e3-e56b-49c9-a887-54726067ac70 tempest-VolumeQuotasAdminTestJSON-1296053062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dd1d8d0-6c00-40c7-975e-d1c2d74d4d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2c7d316-6947-4482-824a-407f4ae365fd', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:55.284787 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-df0680e3-e56b-49c9-a887-54726067ac70 tempest-VolumeQuotasAdminTestJSON-1296053062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1716cec-8aa3-4449-89fa-6ecb566bab3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:55.305784 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-df0680e3-e56b-49c9-a887-54726067ac70 tempest-VolumeQuotasAdminTestJSON-1296053062 None] Volume volume-a2c7d316-6947-4482-824a-407f4ae365fd (a2c7d316-6947-4482-824a-407f4ae365fd): created successfully Feb 05 21:08:55.309978 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-df0680e3-e56b-49c9-a887-54726067ac70 tempest-VolumeQuotasAdminTestJSON-1296053062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1716cec-8aa3-4449-89fa-6ecb566bab3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:55.318428 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-df0680e3-e56b-49c9-a887-54726067ac70 tempest-VolumeQuotasAdminTestJSON-1296053062 None] Flow 'volume_create_manager' (3125bec5-9a4f-4931-8ed1-40b6f42c3047) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:08:55.344014 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-df0680e3-e56b-49c9-a887-54726067ac70 tempest-VolumeQuotasAdminTestJSON-1296053062 None] Created volume successfully. Feb 05 21:08:55.425132 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcd2b3ad-00a7-4e55-a104-643bbcf93a05 tempest-VolumesTransfersTest-944552185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:08:55.429452 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-dcd2b3ad-00a7-4e55-a104-643bbcf93a05 tempest-VolumesTransfersTest-944552185 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:08:55.429898 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-dcd2b3ad-00a7-4e55-a104-643bbcf93a05 tempest-VolumesTransfersTest-944552185 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:08:55.449241 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-dcd2b3ad-00a7-4e55-a104-643bbcf93a05 tempest-VolumesTransfersTest-944552185 None] Flow 'volume_create_manager' (781cd26c-9ba2-4eff-b4ee-c2c1ec0d57bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:08:55.456869 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-dcd2b3ad-00a7-4e55-a104-643bbcf93a05 tempest-VolumesTransfersTest-944552185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44a8b55f-1f64-40c7-9da4-c95dd8fec0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:55.464307 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-dcd2b3ad-00a7-4e55-a104-643bbcf93a05 tempest-VolumesTransfersTest-944552185 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:08:55.479822 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-dcd2b3ad-00a7-4e55-a104-643bbcf93a05 tempest-VolumesTransfersTest-944552185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44a8b55f-1f64-40c7-9da4-c95dd8fec0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1468345379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=623c5360-ed91-4a5e-b315-186002ec44fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac986d6c121f45bd9657e2598b5f1230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:08:55Z,use_quota=True,user_id='d5c342e84ddf4de093b1f846bc2f5874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:55.485894 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-dcd2b3ad-00a7-4e55-a104-643bbcf93a05 tempest-VolumesTransfersTest-944552185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (609e5f2a-d159-4d4c-b82e-295c628559b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:55.490425 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-dcd2b3ad-00a7-4e55-a104-643bbcf93a05 tempest-VolumesTransfersTest-944552185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (609e5f2a-d159-4d4c-b82e-295c628559b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:55.495887 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-dcd2b3ad-00a7-4e55-a104-643bbcf93a05 tempest-VolumesTransfersTest-944552185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3654f6c0-be73-482d-a8e1-7e22698f31a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:55.500292 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-dcd2b3ad-00a7-4e55-a104-643bbcf93a05 tempest-VolumesTransfersTest-944552185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3654f6c0-be73-482d-a8e1-7e22698f31a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '623c5360-ed91-4a5e-b315-186002ec44fd', 'volume_name': 'volume-623c5360-ed91-4a5e-b315-186002ec44fd', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:55.505713 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-dcd2b3ad-00a7-4e55-a104-643bbcf93a05 tempest-VolumesTransfersTest-944552185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33fcff5a-0f60-418c-a7f1-6bcecbb15f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:55.509845 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-dcd2b3ad-00a7-4e55-a104-643bbcf93a05 tempest-VolumesTransfersTest-944552185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33fcff5a-0f60-418c-a7f1-6bcecbb15f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:55.515227 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-dcd2b3ad-00a7-4e55-a104-643bbcf93a05 tempest-VolumesTransfersTest-944552185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2623bc84-a3c6-4582-8670-318f290cc314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:55.516345 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-dcd2b3ad-00a7-4e55-a104-643bbcf93a05 tempest-VolumesTransfersTest-944552185 None] Volume 623c5360-ed91-4a5e-b315-186002ec44fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-623c5360-ed91-4a5e-b315-186002ec44fd', 'volume_size': 1} Feb 05 21:08:55.516733 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-dcd2b3ad-00a7-4e55-a104-643bbcf93a05 tempest-VolumesTransfersTest-944552185 None] creating volume 'volume-623c5360-ed91-4a5e-b315-186002ec44fd' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:08:55.517723 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-dcd2b3ad-00a7-4e55-a104-643bbcf93a05 tempest-VolumesTransfersTest-944552185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:55.584600 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-dcd2b3ad-00a7-4e55-a104-643bbcf93a05 tempest-VolumesTransfersTest-944552185 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:08:55.584989 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-dcd2b3ad-00a7-4e55-a104-643bbcf93a05 tempest-VolumesTransfersTest-944552185 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:08:55.588847 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-dcd2b3ad-00a7-4e55-a104-643bbcf93a05 tempest-VolumesTransfersTest-944552185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2623bc84-a3c6-4582-8670-318f290cc314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-623c5360-ed91-4a5e-b315-186002ec44fd', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:55.595050 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-dcd2b3ad-00a7-4e55-a104-643bbcf93a05 tempest-VolumesTransfersTest-944552185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f868761-f5c2-4b75-9c6e-8a8df9b88bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:08:55.603966 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-dcd2b3ad-00a7-4e55-a104-643bbcf93a05 tempest-VolumesTransfersTest-944552185 None] Volume volume-623c5360-ed91-4a5e-b315-186002ec44fd (623c5360-ed91-4a5e-b315-186002ec44fd): created successfully Feb 05 21:08:55.608007 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-dcd2b3ad-00a7-4e55-a104-643bbcf93a05 tempest-VolumesTransfersTest-944552185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f868761-f5c2-4b75-9c6e-8a8df9b88bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:08:55.613851 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-dcd2b3ad-00a7-4e55-a104-643bbcf93a05 tempest-VolumesTransfersTest-944552185 None] Flow 'volume_create_manager' (781cd26c-9ba2-4eff-b4ee-c2c1ec0d57bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:08:55.622185 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-dcd2b3ad-00a7-4e55-a104-643bbcf93a05 tempest-VolumesTransfersTest-944552185 None] Created volume successfully. Feb 05 21:08:56.800917 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-bc6bec28-2a3c-42ea-bef4-208f270b055e req-7202b35b-b63e-4dd8-a87f-8a0df9c3874e tempest-VolumesBackupsTest-350919582 None] Terminate volume connection completed successfully. Feb 05 21:08:56.801464 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-bc6bec28-2a3c-42ea-bef4-208f270b055e req-7202b35b-b63e-4dd8-a87f-8a0df9c3874e tempest-VolumesBackupsTest-350919582 None] Deleting attachment fc483910-05e5-4c68-8b6f-93105adbd4dc. {{(pid=122683) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 05 21:08:56.957095 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-e3dcb554-5bd4-43c0-8f20-b5eae75ff3af tempest-VolumeQuotasAdminTestJSON-1845007241 None] Transfer volume completed successfully. Feb 05 21:08:57.036923 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-1096e788-b8c7-43dd-84b0-5e39b0f46127 tempest-VolumesTransfersTest-1775449822 None] Lock "b'cinder-623c5360-ed91-4a5e-b315-186002ec44fd-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:08:57.080910 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1096e788-b8c7-43dd-84b0-5e39b0f46127 tempest-VolumesTransfersTest-1775449822 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:57.151518 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1096e788-b8c7-43dd-84b0-5e39b0f46127 tempest-VolumesTransfersTest-1775449822 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:08:57.151942 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1096e788-b8c7-43dd-84b0-5e39b0f46127 tempest-VolumesTransfersTest-1775449822 None] Volume volume-623c5360-ed91-4a5e-b315-186002ec44fd is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:08:57.162745 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1096e788-b8c7-43dd-84b0-5e39b0f46127 tempest-VolumesTransfersTest-1775449822 None] deleting rbd volume volume-623c5360-ed91-4a5e-b315-186002ec44fd {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:08:57.440780 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-bb87e7dd-6e0f-456b-8065-235fad197065 tempest-VolumeQuotasAdminTestJSON-1429501605 None] Lock "b'cinder-a2c7d316-6947-4482-824a-407f4ae365fd-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:08:57.483329 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-bb87e7dd-6e0f-456b-8065-235fad197065 tempest-VolumeQuotasAdminTestJSON-1429501605 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:57.523407 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-bb87e7dd-6e0f-456b-8065-235fad197065 tempest-VolumeQuotasAdminTestJSON-1429501605 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:08:57.523837 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-bb87e7dd-6e0f-456b-8065-235fad197065 tempest-VolumeQuotasAdminTestJSON-1429501605 None] Volume volume-a2c7d316-6947-4482-824a-407f4ae365fd is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:08:57.529719 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-bb87e7dd-6e0f-456b-8065-235fad197065 tempest-VolumeQuotasAdminTestJSON-1429501605 None] deleting rbd volume volume-a2c7d316-6947-4482-824a-407f4ae365fd {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:08:57.558836 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-1096e788-b8c7-43dd-84b0-5e39b0f46127 tempest-VolumesTransfersTest-1775449822 None] Created reservations ['4f6ebc45-cb12-433a-8445-c9d2712f24b9', '784a8b5d-2f6d-4f8f-bd7f-9143e216b8cd', '34eea1cf-1434-4836-b55a-4b850a662d70', 'e9379048-10ee-466a-8501-79eeea51a8ea'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:08:57.603415 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1096e788-b8c7-43dd-84b0-5e39b0f46127 tempest-VolumesTransfersTest-1775449822 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:57.628856 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1096e788-b8c7-43dd-84b0-5e39b0f46127 tempest-VolumesTransfersTest-1775449822 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:57.656725 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-1096e788-b8c7-43dd-84b0-5e39b0f46127 tempest-VolumesTransfersTest-1775449822 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:08:57.661535 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-1096e788-b8c7-43dd-84b0-5e39b0f46127 tempest-VolumesTransfersTest-1775449822 None] Deleted volume successfully. Feb 05 21:08:57.674785 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-1096e788-b8c7-43dd-84b0-5e39b0f46127 tempest-VolumesTransfersTest-1775449822 None] Lock "b'cinder-623c5360-ed91-4a5e-b315-186002ec44fd-delete_volume'" released by "delete_volume" :: held 0.638s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:08:57.745336 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-bb87e7dd-6e0f-456b-8065-235fad197065 tempest-VolumeQuotasAdminTestJSON-1429501605 None] Created reservations ['c74c5570-3a41-4fbf-83f7-1cd93496613b', '850daab7-176b-43fd-96ea-ab89eaec29f3', '4c2fb0ef-4df6-4158-b455-cae7bb4e2d75', '20487505-a681-46ed-8d2a-ee6362e00533'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:08:57.786228 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-bb87e7dd-6e0f-456b-8065-235fad197065 tempest-VolumeQuotasAdminTestJSON-1429501605 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:57.808242 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-bb87e7dd-6e0f-456b-8065-235fad197065 tempest-VolumeQuotasAdminTestJSON-1429501605 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:08:57.836593 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-bb87e7dd-6e0f-456b-8065-235fad197065 tempest-VolumeQuotasAdminTestJSON-1429501605 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:08:57.841890 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-bb87e7dd-6e0f-456b-8065-235fad197065 tempest-VolumeQuotasAdminTestJSON-1429501605 None] Deleted volume successfully. Feb 05 21:08:57.853295 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-bb87e7dd-6e0f-456b-8065-235fad197065 tempest-VolumeQuotasAdminTestJSON-1429501605 None] Lock "b'cinder-a2c7d316-6947-4482-824a-407f4ae365fd-delete_volume'" released by "delete_volume" :: held 0.413s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:09:01.085914 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-022a0d27-1eda-40d1-aa03-3dc8753f42ca tempest-VolumesBackupsTest-350919582 None] Lock "b'cinder-551c13d3-70f5-4542-af53-7ecb3c3717f7-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:09:01.143028 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-022a0d27-1eda-40d1-aa03-3dc8753f42ca tempest-VolumesBackupsTest-350919582 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:01.483617 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-022a0d27-1eda-40d1-aa03-3dc8753f42ca tempest-VolumesBackupsTest-350919582 None] Volume volume-551c13d3-70f5-4542-af53-7ecb3c3717f7 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:09:01.531243 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-022a0d27-1eda-40d1-aa03-3dc8753f42ca tempest-VolumesBackupsTest-350919582 None] deleting rbd volume volume-551c13d3-70f5-4542-af53-7ecb3c3717f7 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:09:01.936555 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-022a0d27-1eda-40d1-aa03-3dc8753f42ca tempest-VolumesBackupsTest-350919582 None] Created reservations ['7ba1f644-c596-4eaf-aae5-c1b6e4241644', '19da4bb2-15c8-41ca-8941-1d302894056a', 'a2f84f77-d5d2-49ff-a50e-c88389eb1f0d', '0a389acc-f293-464a-b2d4-f9100f61ed19'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:09:02.026208 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-022a0d27-1eda-40d1-aa03-3dc8753f42ca tempest-VolumesBackupsTest-350919582 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:02.082002 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-022a0d27-1eda-40d1-aa03-3dc8753f42ca tempest-VolumesBackupsTest-350919582 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:02.120574 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-022a0d27-1eda-40d1-aa03-3dc8753f42ca tempest-VolumesBackupsTest-350919582 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:09:02.125355 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-022a0d27-1eda-40d1-aa03-3dc8753f42ca tempest-VolumesBackupsTest-350919582 None] Deleted volume successfully. Feb 05 21:09:02.144830 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-022a0d27-1eda-40d1-aa03-3dc8753f42ca tempest-VolumesBackupsTest-350919582 None] Lock "b'cinder-551c13d3-70f5-4542-af53-7ecb3c3717f7-delete_volume'" released by "delete_volume" :: held 1.059s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:09:02.425973 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-40666d26-e73e-4579-b83b-f56e03444346 tempest-VolumesBackupsV39Test-1477652955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:09:02.441585 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-40666d26-e73e-4579-b83b-f56e03444346 tempest-VolumesBackupsV39Test-1477652955 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:09:02.442040 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-40666d26-e73e-4579-b83b-f56e03444346 tempest-VolumesBackupsV39Test-1477652955 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:09:02.478964 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-40666d26-e73e-4579-b83b-f56e03444346 tempest-VolumesBackupsV39Test-1477652955 None] Flow 'volume_create_manager' (c01fca2b-e87e-411f-b765-138b2afb5afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:09:02.503996 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-40666d26-e73e-4579-b83b-f56e03444346 tempest-VolumesBackupsV39Test-1477652955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2a87245-cf74-4d37-9346-c34cc3e9b0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:02.526922 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-40666d26-e73e-4579-b83b-f56e03444346 tempest-VolumesBackupsV39Test-1477652955 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:09:02.568543 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-40666d26-e73e-4579-b83b-f56e03444346 tempest-VolumesBackupsV39Test-1477652955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2a87245-cf74-4d37-9346-c34cc3e9b0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Volume-85241365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=607a91f1-1cda-40ed-933c-a0b4f2ed309b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='047f2a78ff8f4c988bdcbeb491ca38d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:09:02Z,use_quota=True,user_id='1f2a32b179af423ab2215af2a0cf3d69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:02.576997 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-40666d26-e73e-4579-b83b-f56e03444346 tempest-VolumesBackupsV39Test-1477652955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cbb0360-5d85-416f-8068-9401363cdf15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:02.600532 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-40666d26-e73e-4579-b83b-f56e03444346 tempest-VolumesBackupsV39Test-1477652955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cbb0360-5d85-416f-8068-9401363cdf15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:02.613446 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-40666d26-e73e-4579-b83b-f56e03444346 tempest-VolumesBackupsV39Test-1477652955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f51b5a41-08df-4900-aa6a-45084b459f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:02.627276 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-40666d26-e73e-4579-b83b-f56e03444346 tempest-VolumesBackupsV39Test-1477652955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f51b5a41-08df-4900-aa6a-45084b459f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '607a91f1-1cda-40ed-933c-a0b4f2ed309b', 'volume_name': 'volume-607a91f1-1cda-40ed-933c-a0b4f2ed309b', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:02.634215 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-40666d26-e73e-4579-b83b-f56e03444346 tempest-VolumesBackupsV39Test-1477652955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c430b90e-17b3-4007-875d-a3d830dfcd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:02.644453 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-40666d26-e73e-4579-b83b-f56e03444346 tempest-VolumesBackupsV39Test-1477652955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c430b90e-17b3-4007-875d-a3d830dfcd4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:02.650544 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-40666d26-e73e-4579-b83b-f56e03444346 tempest-VolumesBackupsV39Test-1477652955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74048f57-4207-47e5-86fd-405cb9eb393e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:02.651868 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-40666d26-e73e-4579-b83b-f56e03444346 tempest-VolumesBackupsV39Test-1477652955 None] Volume 607a91f1-1cda-40ed-933c-a0b4f2ed309b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-607a91f1-1cda-40ed-933c-a0b4f2ed309b', 'volume_size': 1} Feb 05 21:09:02.652449 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-40666d26-e73e-4579-b83b-f56e03444346 tempest-VolumesBackupsV39Test-1477652955 None] creating volume 'volume-607a91f1-1cda-40ed-933c-a0b4f2ed309b' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:09:02.653854 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-40666d26-e73e-4579-b83b-f56e03444346 tempest-VolumesBackupsV39Test-1477652955 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:02.803270 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-40666d26-e73e-4579-b83b-f56e03444346 tempest-VolumesBackupsV39Test-1477652955 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:09:02.803958 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-40666d26-e73e-4579-b83b-f56e03444346 tempest-VolumesBackupsV39Test-1477652955 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:09:02.809461 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-40666d26-e73e-4579-b83b-f56e03444346 tempest-VolumesBackupsV39Test-1477652955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74048f57-4207-47e5-86fd-405cb9eb393e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-607a91f1-1cda-40ed-933c-a0b4f2ed309b', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:02.815547 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-40666d26-e73e-4579-b83b-f56e03444346 tempest-VolumesBackupsV39Test-1477652955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7855edf0-4c3f-4c2b-9d16-9df866e77084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:02.846558 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-40666d26-e73e-4579-b83b-f56e03444346 tempest-VolumesBackupsV39Test-1477652955 None] Volume volume-607a91f1-1cda-40ed-933c-a0b4f2ed309b (607a91f1-1cda-40ed-933c-a0b4f2ed309b): created successfully Feb 05 21:09:02.855173 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-40666d26-e73e-4579-b83b-f56e03444346 tempest-VolumesBackupsV39Test-1477652955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7855edf0-4c3f-4c2b-9d16-9df866e77084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:02.871335 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-40666d26-e73e-4579-b83b-f56e03444346 tempest-VolumesBackupsV39Test-1477652955 None] Flow 'volume_create_manager' (c01fca2b-e87e-411f-b765-138b2afb5afa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:09:02.889984 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-40666d26-e73e-4579-b83b-f56e03444346 tempest-VolumesBackupsV39Test-1477652955 None] Created volume successfully. Feb 05 21:09:03.088982 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f204fa9-9de2-438d-aeef-53394602fd56 tempest-VolumesBackupsTest-350919582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:09:03.092605 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-1f204fa9-9de2-438d-aeef-53394602fd56 tempest-VolumesBackupsTest-350919582 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:09:03.093061 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-1f204fa9-9de2-438d-aeef-53394602fd56 tempest-VolumesBackupsTest-350919582 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:09:03.115143 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1f204fa9-9de2-438d-aeef-53394602fd56 tempest-VolumesBackupsTest-350919582 None] Flow 'volume_create_manager' (f46e8195-5269-4e3b-bebb-c152dbd109b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:09:03.122977 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1f204fa9-9de2-438d-aeef-53394602fd56 tempest-VolumesBackupsTest-350919582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e488af52-6dbe-4d8f-a0fc-92ad8977c184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:03.130243 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-1f204fa9-9de2-438d-aeef-53394602fd56 tempest-VolumesBackupsTest-350919582 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:09:03.146737 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1f204fa9-9de2-438d-aeef-53394602fd56 tempest-VolumesBackupsTest-350919582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e488af52-6dbe-4d8f-a0fc-92ad8977c184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-2063373213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=10f43b5e-5fc3-4f9e-be50-14c09c91d474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d41cfbe49c14de89e32c8c88afef49a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:09:03Z,use_quota=True,user_id='76fea515065c484eb21f2054edc0a299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:03.152191 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1f204fa9-9de2-438d-aeef-53394602fd56 tempest-VolumesBackupsTest-350919582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9473813-f85e-46db-96fa-d917203bd246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:03.157374 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1f204fa9-9de2-438d-aeef-53394602fd56 tempest-VolumesBackupsTest-350919582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9473813-f85e-46db-96fa-d917203bd246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:03.162719 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1f204fa9-9de2-438d-aeef-53394602fd56 tempest-VolumesBackupsTest-350919582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51776e63-ddf4-442c-a959-ef8434aa2d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:03.261615 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1f204fa9-9de2-438d-aeef-53394602fd56 tempest-VolumesBackupsTest-350919582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51776e63-ddf4-442c-a959-ef8434aa2d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '10f43b5e-5fc3-4f9e-be50-14c09c91d474', 'volume_name': 'volume-10f43b5e-5fc3-4f9e-be50-14c09c91d474', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:03.275022 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1f204fa9-9de2-438d-aeef-53394602fd56 tempest-VolumesBackupsTest-350919582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70e0f975-4ee4-4146-99d1-b93638528b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:03.285035 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1f204fa9-9de2-438d-aeef-53394602fd56 tempest-VolumesBackupsTest-350919582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70e0f975-4ee4-4146-99d1-b93638528b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:03.296708 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1f204fa9-9de2-438d-aeef-53394602fd56 tempest-VolumesBackupsTest-350919582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45957b6d-38aa-4e68-8eef-9ac4bf8916f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:03.298811 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-1f204fa9-9de2-438d-aeef-53394602fd56 tempest-VolumesBackupsTest-350919582 None] Volume 10f43b5e-5fc3-4f9e-be50-14c09c91d474: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-10f43b5e-5fc3-4f9e-be50-14c09c91d474', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 05 21:09:03.299941 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f204fa9-9de2-438d-aeef-53394602fd56 tempest-VolumesBackupsTest-350919582 None] Cloning 10f43b5e-5fc3-4f9e-be50-14c09c91d474 from image e66a3a3b-d2f9-4d5d-8021-a6001dff419f at location (None, None). {{(pid=122683) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 05 21:09:03.316802 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-1f204fa9-9de2-438d-aeef-53394602fd56 tempest-VolumesBackupsTest-350919582 None] Lock "b'cinder-e66a3a3b-d2f9-4d5d-8021-a6001dff419f'" acquired by "_prepare_image_cache_entry" :: waited 0.015s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:09:03.328800 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-1f204fa9-9de2-438d-aeef-53394602fd56 tempest-VolumesBackupsTest-350919582 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'volume_id': '311ef4be-45fd-4167-a3ad-6251d56550a7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57), 'last_used': datetime.datetime(2022, 2, 5, 21, 9, 3, 322686)}. {{(pid=122683) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 05 21:09:03.329552 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-1f204fa9-9de2-438d-aeef-53394602fd56 tempest-VolumesBackupsTest-350919582 None] Image-volume cache entry image_update_at = 2022-02-05 20:37:57+00:00, requested image updated_at = 2022-02-05 20:37:57+00:00. {{(pid=122683) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 05 21:09:03.330128 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f204fa9-9de2-438d-aeef-53394602fd56 tempest-VolumesBackupsTest-350919582 None] Found cache entry for image = e66a3a3b-d2f9-4d5d-8021-a6001dff419f on host ncdv-master-1@ceph#ceph. {{(pid=122683) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Feb 05 21:09:03.335873 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-1f204fa9-9de2-438d-aeef-53394602fd56 tempest-VolumesBackupsTest-350919582 None] Lock "b'cinder-e66a3a3b-d2f9-4d5d-8021-a6001dff419f'" released by "_prepare_image_cache_entry" :: held 0.019s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:09:03.337029 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f204fa9-9de2-438d-aeef-53394602fd56 tempest-VolumesBackupsTest-350919582 None] Attempting to retrieve cache entry for image = e66a3a3b-d2f9-4d5d-8021-a6001dff419f on host ncdv-master-1@ceph#ceph. {{(pid=122683) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 05 21:09:03.346165 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-1f204fa9-9de2-438d-aeef-53394602fd56 tempest-VolumesBackupsTest-350919582 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'volume_id': '311ef4be-45fd-4167-a3ad-6251d56550a7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57), 'last_used': datetime.datetime(2022, 2, 5, 21, 9, 3, 342447)}. {{(pid=122683) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 05 21:09:03.346843 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-1f204fa9-9de2-438d-aeef-53394602fd56 tempest-VolumesBackupsTest-350919582 None] Image-volume cache entry image_update_at = 2022-02-05 20:37:57+00:00, requested image updated_at = 2022-02-05 20:37:57+00:00. {{(pid=122683) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 05 21:09:03.347383 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f204fa9-9de2-438d-aeef-53394602fd56 tempest-VolumesBackupsTest-350919582 None] Creating from source image-volume 311ef4be-45fd-4167-a3ad-6251d56550a7 {{(pid=122683) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Feb 05 21:09:03.364643 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1f204fa9-9de2-438d-aeef-53394602fd56 tempest-VolumesBackupsTest-350919582 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:03.461760 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1f204fa9-9de2-438d-aeef-53394602fd56 tempest-VolumesBackupsTest-350919582 None] creating snapshot='volume-10f43b5e-5fc3-4f9e-be50-14c09c91d474.clone_snap' {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 05 21:09:04.542309 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1f204fa9-9de2-438d-aeef-53394602fd56 tempest-VolumesBackupsTest-350919582 None] cloning 'volume-311ef4be-45fd-4167-a3ad-6251d56550a7@volume-10f43b5e-5fc3-4f9e-be50-14c09c91d474.clone_snap' to 'volume-10f43b5e-5fc3-4f9e-be50-14c09c91d474' {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 05 21:09:04.569366 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-e5a9f4cf-e2d7-4b13-9fb4-af2c596ade84 tempest-VolumesBackupsV39Test-1477652955 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-02-05T21:09:03Z,data_timestamp=2022-02-05T21:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Backup-126632598',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=cbe785d6-2f9f-4944-9699-f1fe9c4db8ca,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='047f2a78ff8f4c988bdcbeb491ca38d8',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='1f2a32b179af423ab2215af2a0cf3d69',volume_id=607a91f1-1cda-40ed-933c-a0b4f2ed309b) Feb 05 21:09:04.570102 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.backup.rpcapi [None req-e5a9f4cf-e2d7-4b13-9fb4-af2c596ade84 tempest-VolumesBackupsV39Test-1477652955 None] continue_backup in rpcapi backup_id cbe785d6-2f9f-4944-9699-f1fe9c4db8ca {{(pid=122683) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Feb 05 21:09:04.765848 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1f204fa9-9de2-438d-aeef-53394602fd56 tempest-VolumesBackupsTest-350919582 None] Volume volume-35445a36-a76c-48db-a9c5-3b58646c1e7b.deleted is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:09:04.767143 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1f204fa9-9de2-438d-aeef-53394602fd56 tempest-VolumesBackupsTest-350919582 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:09:04.767651 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1f204fa9-9de2-438d-aeef-53394602fd56 tempest-VolumesBackupsTest-350919582 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:09:04.808053 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1f204fa9-9de2-438d-aeef-53394602fd56 tempest-VolumesBackupsTest-350919582 None] clone created successfully {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 05 21:09:04.818090 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.volume_utils [None req-1f204fa9-9de2-438d-aeef-53394602fd56 tempest-VolumesBackupsTest-350919582 None] Marking volume 10f43b5e-5fc3-4f9e-be50-14c09c91d474 as bootable. {{(pid=122683) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Feb 05 21:09:04.834866 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [None req-e5a9f4cf-e2d7-4b13-9fb4-af2c596ade84 tempest-VolumesBackupsV39Test-1477652955 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 21:09:04.874682 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f204fa9-9de2-438d-aeef-53394602fd56 tempest-VolumesBackupsTest-350919582 None] Copying metadata from image e66a3a3b-d2f9-4d5d-8021-a6001dff419f to 10f43b5e-5fc3-4f9e-be50-14c09c91d474. {{(pid=122683) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 05 21:09:04.875186 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f204fa9-9de2-438d-aeef-53394602fd56 tempest-VolumesBackupsTest-350919582 None] Creating volume glance metadata for volume 10f43b5e-5fc3-4f9e-be50-14c09c91d474 backed by image e66a3a3b-d2f9-4d5d-8021-a6001dff419f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=122683) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 05 21:09:04.995462 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1f204fa9-9de2-438d-aeef-53394602fd56 tempest-VolumesBackupsTest-350919582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45957b6d-38aa-4e68-8eef-9ac4bf8916f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10f43b5e-5fc3-4f9e-be50-14c09c91d474', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:05.007890 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1f204fa9-9de2-438d-aeef-53394602fd56 tempest-VolumesBackupsTest-350919582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4373ac8d-0d6e-440a-9eee-e5edf76444d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:05.029932 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-1f204fa9-9de2-438d-aeef-53394602fd56 tempest-VolumesBackupsTest-350919582 None] Volume volume-10f43b5e-5fc3-4f9e-be50-14c09c91d474 (10f43b5e-5fc3-4f9e-be50-14c09c91d474): created successfully Feb 05 21:09:05.034694 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1f204fa9-9de2-438d-aeef-53394602fd56 tempest-VolumesBackupsTest-350919582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4373ac8d-0d6e-440a-9eee-e5edf76444d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:05.040853 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1f204fa9-9de2-438d-aeef-53394602fd56 tempest-VolumesBackupsTest-350919582 None] Flow 'volume_create_manager' (f46e8195-5269-4e3b-bebb-c152dbd109b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:09:05.053175 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-1f204fa9-9de2-438d-aeef-53394602fd56 tempest-VolumesBackupsTest-350919582 None] Created volume successfully. Feb 05 21:09:05.504932 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-137aa728-e349-49db-a0be-08a2fb1a2ba6 tempest-VolumesBackupsTest-350919582 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-02-05T21:09:05Z,data_timestamp=2022-02-05T21:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-313873250',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=39685a0c-8fc6-4d89-ac0b-44ed5da25dab,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='0d41cfbe49c14de89e32c8c88afef49a',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='76fea515065c484eb21f2054edc0a299',volume_id=10f43b5e-5fc3-4f9e-be50-14c09c91d474) Feb 05 21:09:05.504932 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.backup.rpcapi [None req-137aa728-e349-49db-a0be-08a2fb1a2ba6 tempest-VolumesBackupsTest-350919582 None] continue_backup in rpcapi backup_id 39685a0c-8fc6-4d89-ac0b-44ed5da25dab {{(pid=122683) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Feb 05 21:09:05.700265 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [None req-137aa728-e349-49db-a0be-08a2fb1a2ba6 tempest-VolumesBackupsTest-350919582 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 21:09:05.766897 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [None req-e5a9f4cf-e2d7-4b13-9fb4-af2c596ade84 tempest-VolumesBackupsV39Test-1477652955 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.932s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 21:09:05.768154 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e5a9f4cf-e2d7-4b13-9fb4-af2c596ade84 tempest-VolumesBackupsV39Test-1477652955 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-607a91f1-1cda-40ed-933c-a0b4f2ed309b', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': '607a91f1-1cda-40ed-933c-a0b4f2ed309b', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 21:09:05.786794 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-e5a9f4cf-e2d7-4b13-9fb4-af2c596ade84 tempest-VolumesBackupsV39Test-1477652955 None] Initialize volume connection completed successfully. Feb 05 21:09:06.101826 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e79c92e-1ce9-4e3b-a470-1d8c1442202b tempest-VolumeQuotasNegativeTestJSON-1105804478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:09:06.106348 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-9e79c92e-1ce9-4e3b-a470-1d8c1442202b tempest-VolumeQuotasNegativeTestJSON-1105804478 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:09:06.106897 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-9e79c92e-1ce9-4e3b-a470-1d8c1442202b tempest-VolumeQuotasNegativeTestJSON-1105804478 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:09:06.127311 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9e79c92e-1ce9-4e3b-a470-1d8c1442202b tempest-VolumeQuotasNegativeTestJSON-1105804478 None] Flow 'volume_create_manager' (37b9b2a4-7252-4e22-8eb5-11c008611e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:09:06.134449 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9e79c92e-1ce9-4e3b-a470-1d8c1442202b tempest-VolumeQuotasNegativeTestJSON-1105804478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e0cb482-a28c-4d67-8960-cad16656f834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:06.141524 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-9e79c92e-1ce9-4e3b-a470-1d8c1442202b tempest-VolumeQuotasNegativeTestJSON-1105804478 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:09:06.157298 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9e79c92e-1ce9-4e3b-a470-1d8c1442202b tempest-VolumeQuotasNegativeTestJSON-1105804478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e0cb482-a28c-4d67-8960-cad16656f834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-488372070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0328cbea-7739-4dfa-9670-8c0f2ff42f52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d96eaed0cd9c4fd291c5acd83fbe3ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:09:06Z,use_quota=True,user_id='b7fa7e68a0e44f9cbb50ce3e658808f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:06.163498 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9e79c92e-1ce9-4e3b-a470-1d8c1442202b tempest-VolumeQuotasNegativeTestJSON-1105804478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf57ed67-a4bd-456c-b3f6-5c47f39d12ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:06.167746 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9e79c92e-1ce9-4e3b-a470-1d8c1442202b tempest-VolumeQuotasNegativeTestJSON-1105804478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf57ed67-a4bd-456c-b3f6-5c47f39d12ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:06.174020 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9e79c92e-1ce9-4e3b-a470-1d8c1442202b tempest-VolumeQuotasNegativeTestJSON-1105804478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d33acb2b-cbc7-4b2f-b6c9-cd9a519d1a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:06.179243 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9e79c92e-1ce9-4e3b-a470-1d8c1442202b tempest-VolumeQuotasNegativeTestJSON-1105804478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d33acb2b-cbc7-4b2f-b6c9-cd9a519d1a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0328cbea-7739-4dfa-9670-8c0f2ff42f52', 'volume_name': 'volume-0328cbea-7739-4dfa-9670-8c0f2ff42f52', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:06.185144 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9e79c92e-1ce9-4e3b-a470-1d8c1442202b tempest-VolumeQuotasNegativeTestJSON-1105804478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119a6970-fbac-4c31-bdd6-607e6be94c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:06.190214 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9e79c92e-1ce9-4e3b-a470-1d8c1442202b tempest-VolumeQuotasNegativeTestJSON-1105804478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119a6970-fbac-4c31-bdd6-607e6be94c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:06.195214 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9e79c92e-1ce9-4e3b-a470-1d8c1442202b tempest-VolumeQuotasNegativeTestJSON-1105804478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34d3bbc3-6c11-417f-80b9-c6d64f19cac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:06.196389 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-9e79c92e-1ce9-4e3b-a470-1d8c1442202b tempest-VolumeQuotasNegativeTestJSON-1105804478 None] Volume 0328cbea-7739-4dfa-9670-8c0f2ff42f52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0328cbea-7739-4dfa-9670-8c0f2ff42f52', 'volume_size': 1} Feb 05 21:09:06.197159 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-9e79c92e-1ce9-4e3b-a470-1d8c1442202b tempest-VolumeQuotasNegativeTestJSON-1105804478 None] creating volume 'volume-0328cbea-7739-4dfa-9670-8c0f2ff42f52' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:09:06.198695 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-9e79c92e-1ce9-4e3b-a470-1d8c1442202b tempest-VolumeQuotasNegativeTestJSON-1105804478 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:06.291974 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-9e79c92e-1ce9-4e3b-a470-1d8c1442202b tempest-VolumeQuotasNegativeTestJSON-1105804478 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:09:06.292722 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-9e79c92e-1ce9-4e3b-a470-1d8c1442202b tempest-VolumeQuotasNegativeTestJSON-1105804478 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:09:06.298778 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9e79c92e-1ce9-4e3b-a470-1d8c1442202b tempest-VolumeQuotasNegativeTestJSON-1105804478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34d3bbc3-6c11-417f-80b9-c6d64f19cac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0328cbea-7739-4dfa-9670-8c0f2ff42f52', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:06.305234 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9e79c92e-1ce9-4e3b-a470-1d8c1442202b tempest-VolumeQuotasNegativeTestJSON-1105804478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b08f616c-f339-4f65-8c47-742e6db6f33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:06.323351 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-9e79c92e-1ce9-4e3b-a470-1d8c1442202b tempest-VolumeQuotasNegativeTestJSON-1105804478 None] Volume volume-0328cbea-7739-4dfa-9670-8c0f2ff42f52 (0328cbea-7739-4dfa-9670-8c0f2ff42f52): created successfully Feb 05 21:09:06.328204 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9e79c92e-1ce9-4e3b-a470-1d8c1442202b tempest-VolumeQuotasNegativeTestJSON-1105804478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b08f616c-f339-4f65-8c47-742e6db6f33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:06.333853 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9e79c92e-1ce9-4e3b-a470-1d8c1442202b tempest-VolumeQuotasNegativeTestJSON-1105804478 None] Flow 'volume_create_manager' (37b9b2a4-7252-4e22-8eb5-11c008611e50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:09:06.371222 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-9e79c92e-1ce9-4e3b-a470-1d8c1442202b tempest-VolumeQuotasNegativeTestJSON-1105804478 None] Created volume successfully. Feb 05 21:09:06.566247 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [None req-137aa728-e349-49db-a0be-08a2fb1a2ba6 tempest-VolumesBackupsTest-350919582 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.866s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 21:09:06.567362 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-137aa728-e349-49db-a0be-08a2fb1a2ba6 tempest-VolumesBackupsTest-350919582 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-10f43b5e-5fc3-4f9e-be50-14c09c91d474', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': '10f43b5e-5fc3-4f9e-be50-14c09c91d474', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 21:09:06.587146 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-137aa728-e349-49db-a0be-08a2fb1a2ba6 tempest-VolumesBackupsTest-350919582 None] Initialize volume connection completed successfully. Feb 05 21:09:07.929986 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-e5a9f4cf-e2d7-4b13-9fb4-af2c596ade84 tempest-VolumesBackupsV39Test-1477652955 None] Terminate volume connection completed successfully. Feb 05 21:09:07.974166 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-e5a9f4cf-e2d7-4b13-9fb4-af2c596ade84 tempest-VolumesBackupsV39Test-1477652955 None] Remove volume export completed successfully. Feb 05 21:09:08.038418 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-ff54af5e-9667-465c-9d4c-7d2c0248e5d0 tempest-VolumeQuotasNegativeTestJSON-1105804478 None] Lock "b'cinder-0328cbea-7739-4dfa-9670-8c0f2ff42f52-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:09:08.093822 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ff54af5e-9667-465c-9d4c-7d2c0248e5d0 tempest-VolumeQuotasNegativeTestJSON-1105804478 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:08.404841 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ff54af5e-9667-465c-9d4c-7d2c0248e5d0 tempest-VolumeQuotasNegativeTestJSON-1105804478 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:09:08.405036 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ff54af5e-9667-465c-9d4c-7d2c0248e5d0 tempest-VolumeQuotasNegativeTestJSON-1105804478 None] Volume volume-0328cbea-7739-4dfa-9670-8c0f2ff42f52 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:09:08.438076 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ff54af5e-9667-465c-9d4c-7d2c0248e5d0 tempest-VolumeQuotasNegativeTestJSON-1105804478 None] deleting rbd volume volume-0328cbea-7739-4dfa-9670-8c0f2ff42f52 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:09:10.374295 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-ff54af5e-9667-465c-9d4c-7d2c0248e5d0 tempest-VolumeQuotasNegativeTestJSON-1105804478 None] Created reservations ['8cac0f88-d179-4bce-9210-47ffbee9d0f3', '02542f7c-6357-48a1-bc37-c390530d3b48', '2ab67288-aa42-41c7-9839-e80e8ff559be', '8336b347-e1b3-4b9a-b906-3d59f4ece501'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:09:10.456791 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ff54af5e-9667-465c-9d4c-7d2c0248e5d0 tempest-VolumeQuotasNegativeTestJSON-1105804478 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:10.502351 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ff54af5e-9667-465c-9d4c-7d2c0248e5d0 tempest-VolumeQuotasNegativeTestJSON-1105804478 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:10.551229 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-ff54af5e-9667-465c-9d4c-7d2c0248e5d0 tempest-VolumeQuotasNegativeTestJSON-1105804478 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:09:10.566034 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-ff54af5e-9667-465c-9d4c-7d2c0248e5d0 tempest-VolumeQuotasNegativeTestJSON-1105804478 None] Deleted volume successfully. Feb 05 21:09:10.597581 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-ff54af5e-9667-465c-9d4c-7d2c0248e5d0 tempest-VolumeQuotasNegativeTestJSON-1105804478 None] Lock "b'cinder-0328cbea-7739-4dfa-9670-8c0f2ff42f52-delete_volume'" released by "delete_volume" :: held 2.559s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:09:13.530413 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-b0506a6b-5dda-4718-b383-ae70489d716a tempest-VolumesBackupsV39Test-1477652955 None] Lock "b'cinder-607a91f1-1cda-40ed-933c-a0b4f2ed309b-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:09:13.648602 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-b0506a6b-5dda-4718-b383-ae70489d716a tempest-VolumesBackupsV39Test-1477652955 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:14.567631 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-b0506a6b-5dda-4718-b383-ae70489d716a tempest-VolumesBackupsV39Test-1477652955 None] Volume volume-607a91f1-1cda-40ed-933c-a0b4f2ed309b is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:09:14.625515 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-b0506a6b-5dda-4718-b383-ae70489d716a tempest-VolumesBackupsV39Test-1477652955 None] deleting rbd volume volume-607a91f1-1cda-40ed-933c-a0b4f2ed309b {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:09:15.025878 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-b0506a6b-5dda-4718-b383-ae70489d716a tempest-VolumesBackupsV39Test-1477652955 None] Created reservations ['9c679d01-8618-49b9-833f-3da4f875543d', '93cf12e5-f713-47e8-95ee-8bd2419c6e1e', '52b0840f-51c4-4b17-8fa9-f9f77fa4170c', '3b533e90-c0c9-4613-aeef-ec0bb69e794e'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:09:15.082364 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-b0506a6b-5dda-4718-b383-ae70489d716a tempest-VolumesBackupsV39Test-1477652955 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:15.119001 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-b0506a6b-5dda-4718-b383-ae70489d716a tempest-VolumesBackupsV39Test-1477652955 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:15.166750 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-b0506a6b-5dda-4718-b383-ae70489d716a tempest-VolumesBackupsV39Test-1477652955 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:09:15.175902 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-b0506a6b-5dda-4718-b383-ae70489d716a tempest-VolumesBackupsV39Test-1477652955 None] Deleted volume successfully. Feb 05 21:09:15.195477 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-b0506a6b-5dda-4718-b383-ae70489d716a tempest-VolumesBackupsV39Test-1477652955 None] Lock "b'cinder-607a91f1-1cda-40ed-933c-a0b4f2ed309b-delete_volume'" released by "delete_volume" :: held 1.666s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:09:15.941902 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-137aa728-e349-49db-a0be-08a2fb1a2ba6 tempest-VolumesBackupsTest-350919582 None] Terminate volume connection completed successfully. Feb 05 21:09:16.005845 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-137aa728-e349-49db-a0be-08a2fb1a2ba6 tempest-VolumesBackupsTest-350919582 None] Remove volume export completed successfully. Feb 05 21:09:17.626267 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3c860bd-3b56-4dea-a68d-49226f713613 tempest-VolumesBackupsTest-350919582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:09:17.649981 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-f3c860bd-3b56-4dea-a68d-49226f713613 tempest-VolumesBackupsTest-350919582 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:09:17.650950 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-f3c860bd-3b56-4dea-a68d-49226f713613 tempest-VolumesBackupsTest-350919582 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:09:17.677820 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-f3c860bd-3b56-4dea-a68d-49226f713613 tempest-VolumesBackupsTest-350919582 None] Flow 'volume_create_manager' (473d34cd-50c5-4290-9431-656370dc4e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:09:17.685580 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-f3c860bd-3b56-4dea-a68d-49226f713613 tempest-VolumesBackupsTest-350919582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5825451d-d356-4738-adef-4135fb8b276b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:17.693648 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-f3c860bd-3b56-4dea-a68d-49226f713613 tempest-VolumesBackupsTest-350919582 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:09:17.720816 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-f3c860bd-3b56-4dea-a68d-49226f713613 tempest-VolumesBackupsTest-350919582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5825451d-d356-4738-adef-4135fb8b276b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:09:17Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_39685a0c-8fc6-4d89-ac0b-44ed5da25dab',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=41f660e3-74ff-446e-84b9-f0721676e61f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d41cfbe49c14de89e32c8c88afef49a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:09:18Z,use_quota=True,user_id='76fea515065c484eb21f2054edc0a299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:17.728981 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-f3c860bd-3b56-4dea-a68d-49226f713613 tempest-VolumesBackupsTest-350919582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c996940-e1f9-4236-94f7-d0fff01d5a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:17.734832 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-f3c860bd-3b56-4dea-a68d-49226f713613 tempest-VolumesBackupsTest-350919582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c996940-e1f9-4236-94f7-d0fff01d5a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:17.741188 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-f3c860bd-3b56-4dea-a68d-49226f713613 tempest-VolumesBackupsTest-350919582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5e36f6f-b1bc-4c51-9e8f-f23feb786018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:17.746092 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-f3c860bd-3b56-4dea-a68d-49226f713613 tempest-VolumesBackupsTest-350919582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5e36f6f-b1bc-4c51-9e8f-f23feb786018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41f660e3-74ff-446e-84b9-f0721676e61f', 'volume_name': 'volume-41f660e3-74ff-446e-84b9-f0721676e61f', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:17.752536 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-f3c860bd-3b56-4dea-a68d-49226f713613 tempest-VolumesBackupsTest-350919582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc3e5285-5f3a-4d72-a76e-70afaf4b41e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:17.758086 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-f3c860bd-3b56-4dea-a68d-49226f713613 tempest-VolumesBackupsTest-350919582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc3e5285-5f3a-4d72-a76e-70afaf4b41e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:17.764663 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-f3c860bd-3b56-4dea-a68d-49226f713613 tempest-VolumesBackupsTest-350919582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03a5fae6-c591-44e4-92f6-fdc0b8d12cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:17.765999 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-f3c860bd-3b56-4dea-a68d-49226f713613 tempest-VolumesBackupsTest-350919582 None] Volume 41f660e3-74ff-446e-84b9-f0721676e61f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41f660e3-74ff-446e-84b9-f0721676e61f', 'volume_size': 1} Feb 05 21:09:17.766664 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-f3c860bd-3b56-4dea-a68d-49226f713613 tempest-VolumesBackupsTest-350919582 None] creating volume 'volume-41f660e3-74ff-446e-84b9-f0721676e61f' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:09:17.768171 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-f3c860bd-3b56-4dea-a68d-49226f713613 tempest-VolumesBackupsTest-350919582 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:17.873525 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-f3c860bd-3b56-4dea-a68d-49226f713613 tempest-VolumesBackupsTest-350919582 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:09:17.873913 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-f3c860bd-3b56-4dea-a68d-49226f713613 tempest-VolumesBackupsTest-350919582 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:09:17.878553 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-f3c860bd-3b56-4dea-a68d-49226f713613 tempest-VolumesBackupsTest-350919582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03a5fae6-c591-44e4-92f6-fdc0b8d12cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41f660e3-74ff-446e-84b9-f0721676e61f', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:17.883292 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-f3c860bd-3b56-4dea-a68d-49226f713613 tempest-VolumesBackupsTest-350919582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4704afae-0551-453a-8b3f-5ff459448c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:17.893616 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-f3c860bd-3b56-4dea-a68d-49226f713613 tempest-VolumesBackupsTest-350919582 None] Volume volume-41f660e3-74ff-446e-84b9-f0721676e61f (41f660e3-74ff-446e-84b9-f0721676e61f): created successfully Feb 05 21:09:17.897501 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-f3c860bd-3b56-4dea-a68d-49226f713613 tempest-VolumesBackupsTest-350919582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4704afae-0551-453a-8b3f-5ff459448c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:17.905640 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-f3c860bd-3b56-4dea-a68d-49226f713613 tempest-VolumesBackupsTest-350919582 None] Flow 'volume_create_manager' (473d34cd-50c5-4290-9431-656370dc4e16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:09:17.915538 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-f3c860bd-3b56-4dea-a68d-49226f713613 tempest-VolumesBackupsTest-350919582 None] Created volume successfully. Feb 05 21:09:18.399500 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b8cfbba-855f-4fa6-b664-e86d53874c5e tempest-VolumesGetTest-735801655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:09:18.416227 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-9b8cfbba-855f-4fa6-b664-e86d53874c5e tempest-VolumesGetTest-735801655 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:09:18.419430 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-9b8cfbba-855f-4fa6-b664-e86d53874c5e tempest-VolumesGetTest-735801655 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:09:18.456251 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9b8cfbba-855f-4fa6-b664-e86d53874c5e tempest-VolumesGetTest-735801655 None] Flow 'volume_create_manager' (4d3d561e-9da6-4ab8-8311-e404be138a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:09:18.468722 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9b8cfbba-855f-4fa6-b664-e86d53874c5e tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c9c5365-5ff6-4b72-8931-ac211d912bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:18.484273 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-9b8cfbba-855f-4fa6-b664-e86d53874c5e tempest-VolumesGetTest-735801655 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:09:18.544117 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9b8cfbba-855f-4fa6-b664-e86d53874c5e tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c9c5365-5ff6-4b72-8931-ac211d912bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-505407351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=fc3ec58a-cb30-47eb-9971-6695f80e67d5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6e1ea1e3d3cf4f4d8f428013523eb54a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:09:18Z,use_quota=True,user_id='cf2bb6c5571949358e6dc70d77314ee7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:18.567097 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9b8cfbba-855f-4fa6-b664-e86d53874c5e tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a528d37-c90b-416f-aea4-b8bee4bee8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:18.582682 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9b8cfbba-855f-4fa6-b664-e86d53874c5e tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a528d37-c90b-416f-aea4-b8bee4bee8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:18.596637 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9b8cfbba-855f-4fa6-b664-e86d53874c5e tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba155595-b004-4fc5-8f59-23a9e8b48bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:18.611223 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9b8cfbba-855f-4fa6-b664-e86d53874c5e tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba155595-b004-4fc5-8f59-23a9e8b48bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc3ec58a-cb30-47eb-9971-6695f80e67d5', 'volume_name': 'volume-fc3ec58a-cb30-47eb-9971-6695f80e67d5', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:18.622761 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9b8cfbba-855f-4fa6-b664-e86d53874c5e tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91b2d255-a59e-4637-99df-763877a01f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:18.626993 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9b8cfbba-855f-4fa6-b664-e86d53874c5e tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91b2d255-a59e-4637-99df-763877a01f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:18.635092 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9b8cfbba-855f-4fa6-b664-e86d53874c5e tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a13716a-68d2-4b6e-a9de-ee0c19565cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:18.637007 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-9b8cfbba-855f-4fa6-b664-e86d53874c5e tempest-VolumesGetTest-735801655 None] Volume fc3ec58a-cb30-47eb-9971-6695f80e67d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc3ec58a-cb30-47eb-9971-6695f80e67d5', 'volume_size': 1} Feb 05 21:09:18.637553 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-9b8cfbba-855f-4fa6-b664-e86d53874c5e tempest-VolumesGetTest-735801655 None] creating volume 'volume-fc3ec58a-cb30-47eb-9971-6695f80e67d5' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:09:18.638769 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-9b8cfbba-855f-4fa6-b664-e86d53874c5e tempest-VolumesGetTest-735801655 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:18.764222 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [None req-f3c860bd-3b56-4dea-a68d-49226f713613 tempest-VolumesBackupsTest-350919582 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 21:09:18.801145 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-9b8cfbba-855f-4fa6-b664-e86d53874c5e tempest-VolumesGetTest-735801655 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:09:18.801528 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-9b8cfbba-855f-4fa6-b664-e86d53874c5e tempest-VolumesGetTest-735801655 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:09:18.806588 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9b8cfbba-855f-4fa6-b664-e86d53874c5e tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a13716a-68d2-4b6e-a9de-ee0c19565cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc3ec58a-cb30-47eb-9971-6695f80e67d5', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:18.823144 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9b8cfbba-855f-4fa6-b664-e86d53874c5e tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77598033-fca9-4383-845f-9af4985e7ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:18.850108 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-9b8cfbba-855f-4fa6-b664-e86d53874c5e tempest-VolumesGetTest-735801655 None] Volume volume-fc3ec58a-cb30-47eb-9971-6695f80e67d5 (fc3ec58a-cb30-47eb-9971-6695f80e67d5): created successfully Feb 05 21:09:18.854320 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9b8cfbba-855f-4fa6-b664-e86d53874c5e tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77598033-fca9-4383-845f-9af4985e7ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:18.861789 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9b8cfbba-855f-4fa6-b664-e86d53874c5e tempest-VolumesGetTest-735801655 None] Flow 'volume_create_manager' (4d3d561e-9da6-4ab8-8311-e404be138a2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:09:18.875213 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-9b8cfbba-855f-4fa6-b664-e86d53874c5e tempest-VolumesGetTest-735801655 None] Created volume successfully. Feb 05 21:09:19.554339 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [None req-f3c860bd-3b56-4dea-a68d-49226f713613 tempest-VolumesBackupsTest-350919582 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.790s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 21:09:19.555229 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-f3c860bd-3b56-4dea-a68d-49226f713613 tempest-VolumesBackupsTest-350919582 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-41f660e3-74ff-446e-84b9-f0721676e61f', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': '41f660e3-74ff-446e-84b9-f0721676e61f', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 21:09:19.594828 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-f3c860bd-3b56-4dea-a68d-49226f713613 tempest-VolumesBackupsTest-350919582 None] Initialize volume connection completed successfully. Feb 05 21:09:20.184407 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-178fd28f-d93f-4f8e-a2a9-7dd60f15439e tempest-VolumesGetTest-735801655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:09:20.188545 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-178fd28f-d93f-4f8e-a2a9-7dd60f15439e tempest-VolumesGetTest-735801655 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:09:20.189050 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-178fd28f-d93f-4f8e-a2a9-7dd60f15439e tempest-VolumesGetTest-735801655 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:09:20.232102 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-178fd28f-d93f-4f8e-a2a9-7dd60f15439e tempest-VolumesGetTest-735801655 None] Flow 'volume_create_manager' (b9cba5e2-1756-444e-9d79-ab0a7ff1c095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:09:20.258450 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-178fd28f-d93f-4f8e-a2a9-7dd60f15439e tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0c78f4d-5b43-4d39-aaca-3ed7ac381477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:20.270559 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-178fd28f-d93f-4f8e-a2a9-7dd60f15439e tempest-VolumesGetTest-735801655 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:09:20.334609 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-178fd28f-d93f-4f8e-a2a9-7dd60f15439e tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0c78f4d-5b43-4d39-aaca-3ed7ac381477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:09:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-45267741',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ac55e5ac-1526-445e-a586-c416dfad80c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e1ea1e3d3cf4f4d8f428013523eb54a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:09:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:09:20Z,use_quota=True,user_id='cf2bb6c5571949358e6dc70d77314ee7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:20.345153 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-178fd28f-d93f-4f8e-a2a9-7dd60f15439e tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84851cbc-0830-4e38-ab77-2387a89922a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:20.361310 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-178fd28f-d93f-4f8e-a2a9-7dd60f15439e tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84851cbc-0830-4e38-ab77-2387a89922a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:20.375955 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-178fd28f-d93f-4f8e-a2a9-7dd60f15439e tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6dc151e-7244-45aa-bbb1-a35e54c90e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:20.384142 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-178fd28f-d93f-4f8e-a2a9-7dd60f15439e tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6dc151e-7244-45aa-bbb1-a35e54c90e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac55e5ac-1526-445e-a586-c416dfad80c3', 'volume_name': 'volume-ac55e5ac-1526-445e-a586-c416dfad80c3', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:20.400196 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-178fd28f-d93f-4f8e-a2a9-7dd60f15439e tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85ed7506-6fe1-4d25-b941-bf0c1b6cb872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:20.411309 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-178fd28f-d93f-4f8e-a2a9-7dd60f15439e tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85ed7506-6fe1-4d25-b941-bf0c1b6cb872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:20.421020 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-178fd28f-d93f-4f8e-a2a9-7dd60f15439e tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ab70560-d320-418b-bf24-408e1186fdca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:20.423720 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-178fd28f-d93f-4f8e-a2a9-7dd60f15439e tempest-VolumesGetTest-735801655 None] Volume ac55e5ac-1526-445e-a586-c416dfad80c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac55e5ac-1526-445e-a586-c416dfad80c3', 'volume_size': 1} Feb 05 21:09:20.424173 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-178fd28f-d93f-4f8e-a2a9-7dd60f15439e tempest-VolumesGetTest-735801655 None] creating volume 'volume-ac55e5ac-1526-445e-a586-c416dfad80c3' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:09:20.425557 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-178fd28f-d93f-4f8e-a2a9-7dd60f15439e tempest-VolumesGetTest-735801655 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:20.617209 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-178fd28f-d93f-4f8e-a2a9-7dd60f15439e tempest-VolumesGetTest-735801655 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:09:20.617595 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-178fd28f-d93f-4f8e-a2a9-7dd60f15439e tempest-VolumesGetTest-735801655 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:09:20.623501 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-178fd28f-d93f-4f8e-a2a9-7dd60f15439e tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ab70560-d320-418b-bf24-408e1186fdca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac55e5ac-1526-445e-a586-c416dfad80c3', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:20.628878 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-178fd28f-d93f-4f8e-a2a9-7dd60f15439e tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edae7a8e-4427-4786-8b65-982401a03969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:20.662871 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-178fd28f-d93f-4f8e-a2a9-7dd60f15439e tempest-VolumesGetTest-735801655 None] Volume volume-ac55e5ac-1526-445e-a586-c416dfad80c3 (ac55e5ac-1526-445e-a586-c416dfad80c3): created successfully Feb 05 21:09:20.670449 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-178fd28f-d93f-4f8e-a2a9-7dd60f15439e tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edae7a8e-4427-4786-8b65-982401a03969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:20.696673 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-178fd28f-d93f-4f8e-a2a9-7dd60f15439e tempest-VolumesGetTest-735801655 None] Flow 'volume_create_manager' (b9cba5e2-1756-444e-9d79-ab0a7ff1c095) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:09:20.716866 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-178fd28f-d93f-4f8e-a2a9-7dd60f15439e tempest-VolumesGetTest-735801655 None] Created volume successfully. Feb 05 21:09:21.312503 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-389c9b5a-9adf-405e-a5e1-157c10ede45e tempest-VolumesGetTest-735801655 None] Lock "b'cinder-ac55e5ac-1526-445e-a586-c416dfad80c3-delete_volume'" acquired by "delete_volume" :: waited 0.030s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:09:21.400803 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-389c9b5a-9adf-405e-a5e1-157c10ede45e tempest-VolumesGetTest-735801655 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:21.507227 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-389c9b5a-9adf-405e-a5e1-157c10ede45e tempest-VolumesGetTest-735801655 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:09:21.507865 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-389c9b5a-9adf-405e-a5e1-157c10ede45e tempest-VolumesGetTest-735801655 None] Volume volume-ac55e5ac-1526-445e-a586-c416dfad80c3 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:09:21.567703 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-389c9b5a-9adf-405e-a5e1-157c10ede45e tempest-VolumesGetTest-735801655 None] deleting rbd volume volume-ac55e5ac-1526-445e-a586-c416dfad80c3 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:09:22.846856 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-389c9b5a-9adf-405e-a5e1-157c10ede45e tempest-VolumesGetTest-735801655 None] Created reservations ['e6c57cf5-b5fa-430b-92c1-ced5d1e698d4', '220b7adc-f98b-4642-a8a5-e4d7e2899888', '8d38bca7-b02b-4b7f-8645-8cfb9328e885', '5e13d8d6-9833-4b58-b452-da0e6435f5c6'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:09:22.987349 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-389c9b5a-9adf-405e-a5e1-157c10ede45e tempest-VolumesGetTest-735801655 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:23.062641 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-389c9b5a-9adf-405e-a5e1-157c10ede45e tempest-VolumesGetTest-735801655 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:23.144237 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-389c9b5a-9adf-405e-a5e1-157c10ede45e tempest-VolumesGetTest-735801655 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:09:23.160090 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-389c9b5a-9adf-405e-a5e1-157c10ede45e tempest-VolumesGetTest-735801655 None] Deleted volume successfully. Feb 05 21:09:23.202826 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-389c9b5a-9adf-405e-a5e1-157c10ede45e tempest-VolumesGetTest-735801655 None] Lock "b'cinder-ac55e5ac-1526-445e-a586-c416dfad80c3-delete_volume'" released by "delete_volume" :: held 1.888s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:09:23.664550 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-87ca8402-c41c-4ebb-bf46-94848ba67919 tempest-VolumesGetTest-735801655 None] Lock "b'cinder-fc3ec58a-cb30-47eb-9971-6695f80e67d5-delete_volume'" acquired by "delete_volume" :: waited 0.030s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:09:23.743456 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-87ca8402-c41c-4ebb-bf46-94848ba67919 tempest-VolumesGetTest-735801655 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:23.862195 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-87ca8402-c41c-4ebb-bf46-94848ba67919 tempest-VolumesGetTest-735801655 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:09:23.864133 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-87ca8402-c41c-4ebb-bf46-94848ba67919 tempest-VolumesGetTest-735801655 None] Volume volume-fc3ec58a-cb30-47eb-9971-6695f80e67d5 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:09:23.889056 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-87ca8402-c41c-4ebb-bf46-94848ba67919 tempest-VolumesGetTest-735801655 None] deleting rbd volume volume-fc3ec58a-cb30-47eb-9971-6695f80e67d5 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:09:24.681905 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-87ca8402-c41c-4ebb-bf46-94848ba67919 tempest-VolumesGetTest-735801655 None] Created reservations ['9e9cb708-6601-45bd-82e1-25fe54a18cba', '25ffcc6a-3fbb-4ea6-b406-133327391876', '2d44288e-d776-4388-8dba-20fb1ed79721', 'd6b4750d-749a-49eb-8e1f-207fc7a73f09'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:09:24.729300 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-87ca8402-c41c-4ebb-bf46-94848ba67919 tempest-VolumesGetTest-735801655 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:24.793854 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-87ca8402-c41c-4ebb-bf46-94848ba67919 tempest-VolumesGetTest-735801655 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:24.854686 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-87ca8402-c41c-4ebb-bf46-94848ba67919 tempest-VolumesGetTest-735801655 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:09:24.860780 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-87ca8402-c41c-4ebb-bf46-94848ba67919 tempest-VolumesGetTest-735801655 None] Deleted volume successfully. Feb 05 21:09:24.899036 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-3256da76-c7d6-4047-b6d8-c1d3876383ef tempest-VolumesImageMetadata-247790516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:09:24.904141 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-3256da76-c7d6-4047-b6d8-c1d3876383ef tempest-VolumesImageMetadata-247790516 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:09:24.904962 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-3256da76-c7d6-4047-b6d8-c1d3876383ef tempest-VolumesImageMetadata-247790516 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:09:24.928418 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3256da76-c7d6-4047-b6d8-c1d3876383ef tempest-VolumesImageMetadata-247790516 None] Flow 'volume_create_manager' (13eb5ce9-bdad-4d87-80dc-550b701e644a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:09:24.943156 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3256da76-c7d6-4047-b6d8-c1d3876383ef tempest-VolumesImageMetadata-247790516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3b3ac5d-8574-45c0-a553-20383b28bb75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:24.952083 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-87ca8402-c41c-4ebb-bf46-94848ba67919 tempest-VolumesGetTest-735801655 None] Lock "b'cinder-fc3ec58a-cb30-47eb-9971-6695f80e67d5-delete_volume'" released by "delete_volume" :: held 1.285s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:09:24.957761 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-3256da76-c7d6-4047-b6d8-c1d3876383ef tempest-VolumesImageMetadata-247790516 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:09:24.979579 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3256da76-c7d6-4047-b6d8-c1d3876383ef tempest-VolumesImageMetadata-247790516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3b3ac5d-8574-45c0-a553-20383b28bb75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-424903350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e24b7b08-d724-4114-8228-016f2f043638,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed974f949f9742c89c55b6bb91868fcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:09:25Z,use_quota=True,user_id='af14a7de3f114a56abde9680088026d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:24.997526 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3256da76-c7d6-4047-b6d8-c1d3876383ef tempest-VolumesImageMetadata-247790516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e582e2e3-1f50-4196-a66a-5b1e1788847d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:25.003035 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3256da76-c7d6-4047-b6d8-c1d3876383ef tempest-VolumesImageMetadata-247790516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e582e2e3-1f50-4196-a66a-5b1e1788847d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:25.009238 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3256da76-c7d6-4047-b6d8-c1d3876383ef tempest-VolumesImageMetadata-247790516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (035c7ebc-8831-410f-8862-e7ed1171b9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:25.111002 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3256da76-c7d6-4047-b6d8-c1d3876383ef tempest-VolumesImageMetadata-247790516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (035c7ebc-8831-410f-8862-e7ed1171b9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e24b7b08-d724-4114-8228-016f2f043638', 'volume_name': 'volume-e24b7b08-d724-4114-8228-016f2f043638', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:25.116479 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3256da76-c7d6-4047-b6d8-c1d3876383ef tempest-VolumesImageMetadata-247790516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (462c46db-b95f-4875-aa27-138680dd7f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:25.121010 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3256da76-c7d6-4047-b6d8-c1d3876383ef tempest-VolumesImageMetadata-247790516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (462c46db-b95f-4875-aa27-138680dd7f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:25.127083 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3256da76-c7d6-4047-b6d8-c1d3876383ef tempest-VolumesImageMetadata-247790516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4941518-2789-4371-9dcf-108d16cd69df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:25.128384 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-3256da76-c7d6-4047-b6d8-c1d3876383ef tempest-VolumesImageMetadata-247790516 None] Volume e24b7b08-d724-4114-8228-016f2f043638: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e24b7b08-d724-4114-8228-016f2f043638', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 05 21:09:25.129046 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-3256da76-c7d6-4047-b6d8-c1d3876383ef tempest-VolumesImageMetadata-247790516 None] Cloning e24b7b08-d724-4114-8228-016f2f043638 from image e66a3a3b-d2f9-4d5d-8021-a6001dff419f at location (None, None). {{(pid=122683) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 05 21:09:25.139976 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-3256da76-c7d6-4047-b6d8-c1d3876383ef tempest-VolumesImageMetadata-247790516 None] Lock "b'cinder-e66a3a3b-d2f9-4d5d-8021-a6001dff419f'" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:09:25.156366 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-3256da76-c7d6-4047-b6d8-c1d3876383ef tempest-VolumesImageMetadata-247790516 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'volume_id': '311ef4be-45fd-4167-a3ad-6251d56550a7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57), 'last_used': datetime.datetime(2022, 2, 5, 21, 9, 25, 145352)}. {{(pid=122683) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 05 21:09:25.156892 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-3256da76-c7d6-4047-b6d8-c1d3876383ef tempest-VolumesImageMetadata-247790516 None] Image-volume cache entry image_update_at = 2022-02-05 20:37:57+00:00, requested image updated_at = 2022-02-05 20:37:57+00:00. {{(pid=122683) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 05 21:09:25.157300 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-3256da76-c7d6-4047-b6d8-c1d3876383ef tempest-VolumesImageMetadata-247790516 None] Found cache entry for image = e66a3a3b-d2f9-4d5d-8021-a6001dff419f on host ncdv-master-1@ceph#ceph. {{(pid=122683) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Feb 05 21:09:25.162366 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-3256da76-c7d6-4047-b6d8-c1d3876383ef tempest-VolumesImageMetadata-247790516 None] Lock "b'cinder-e66a3a3b-d2f9-4d5d-8021-a6001dff419f'" released by "_prepare_image_cache_entry" :: held 0.022s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:09:25.163460 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-3256da76-c7d6-4047-b6d8-c1d3876383ef tempest-VolumesImageMetadata-247790516 None] Attempting to retrieve cache entry for image = e66a3a3b-d2f9-4d5d-8021-a6001dff419f on host ncdv-master-1@ceph#ceph. {{(pid=122683) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 05 21:09:25.170252 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-3256da76-c7d6-4047-b6d8-c1d3876383ef tempest-VolumesImageMetadata-247790516 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'volume_id': '311ef4be-45fd-4167-a3ad-6251d56550a7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57), 'last_used': datetime.datetime(2022, 2, 5, 21, 9, 25, 166977)}. {{(pid=122683) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 05 21:09:25.170703 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-3256da76-c7d6-4047-b6d8-c1d3876383ef tempest-VolumesImageMetadata-247790516 None] Image-volume cache entry image_update_at = 2022-02-05 20:37:57+00:00, requested image updated_at = 2022-02-05 20:37:57+00:00. {{(pid=122683) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 05 21:09:25.171096 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-3256da76-c7d6-4047-b6d8-c1d3876383ef tempest-VolumesImageMetadata-247790516 None] Creating from source image-volume 311ef4be-45fd-4167-a3ad-6251d56550a7 {{(pid=122683) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Feb 05 21:09:25.188692 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3256da76-c7d6-4047-b6d8-c1d3876383ef tempest-VolumesImageMetadata-247790516 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:25.274113 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3256da76-c7d6-4047-b6d8-c1d3876383ef tempest-VolumesImageMetadata-247790516 None] creating snapshot='volume-e24b7b08-d724-4114-8228-016f2f043638.clone_snap' {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 05 21:09:25.575511 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3256da76-c7d6-4047-b6d8-c1d3876383ef tempest-VolumesImageMetadata-247790516 None] cloning 'volume-311ef4be-45fd-4167-a3ad-6251d56550a7@volume-e24b7b08-d724-4114-8228-016f2f043638.clone_snap' to 'volume-e24b7b08-d724-4114-8228-016f2f043638' {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 05 21:09:25.603259 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0381447-21d0-472d-b89e-534d79265d21 tempest-VolumesGetTest-735801655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:09:25.609574 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-d0381447-21d0-472d-b89e-534d79265d21 tempest-VolumesGetTest-735801655 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:09:25.610030 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-d0381447-21d0-472d-b89e-534d79265d21 tempest-VolumesGetTest-735801655 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:09:25.638239 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d0381447-21d0-472d-b89e-534d79265d21 tempest-VolumesGetTest-735801655 None] Flow 'volume_create_manager' (be52cda7-4b32-4f39-9aae-5f802934127a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:09:25.645756 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d0381447-21d0-472d-b89e-534d79265d21 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6b64756-7288-4626-9035-2000df8aa1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:25.654468 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-d0381447-21d0-472d-b89e-534d79265d21 tempest-VolumesGetTest-735801655 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:09:25.672669 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d0381447-21d0-472d-b89e-534d79265d21 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6b64756-7288-4626-9035-2000df8aa1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-138390887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=41ff1200-c5de-4d9b-b166-3cea9fc03a3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e1ea1e3d3cf4f4d8f428013523eb54a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:09:25Z,use_quota=True,user_id='cf2bb6c5571949358e6dc70d77314ee7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:25.679663 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d0381447-21d0-472d-b89e-534d79265d21 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f61bafbe-d2f4-4e1c-9b95-37206f72735f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:25.686659 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d0381447-21d0-472d-b89e-534d79265d21 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f61bafbe-d2f4-4e1c-9b95-37206f72735f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:25.693004 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d0381447-21d0-472d-b89e-534d79265d21 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa45718-a0d6-41a5-956b-7a67ec20e420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:25.697954 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d0381447-21d0-472d-b89e-534d79265d21 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa45718-a0d6-41a5-956b-7a67ec20e420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41ff1200-c5de-4d9b-b166-3cea9fc03a3a', 'volume_name': 'volume-41ff1200-c5de-4d9b-b166-3cea9fc03a3a', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:25.704180 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d0381447-21d0-472d-b89e-534d79265d21 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fc9e08b-14f1-43d7-a99a-4c92100d09e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:25.711376 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d0381447-21d0-472d-b89e-534d79265d21 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fc9e08b-14f1-43d7-a99a-4c92100d09e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:25.717483 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d0381447-21d0-472d-b89e-534d79265d21 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30222c71-83cf-41ed-9faf-3dccfc5b307a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:25.719181 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-d0381447-21d0-472d-b89e-534d79265d21 tempest-VolumesGetTest-735801655 None] Volume 41ff1200-c5de-4d9b-b166-3cea9fc03a3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41ff1200-c5de-4d9b-b166-3cea9fc03a3a', 'volume_size': 1} Feb 05 21:09:25.719757 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-d0381447-21d0-472d-b89e-534d79265d21 tempest-VolumesGetTest-735801655 None] creating volume 'volume-41ff1200-c5de-4d9b-b166-3cea9fc03a3a' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:09:25.720928 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-d0381447-21d0-472d-b89e-534d79265d21 tempest-VolumesGetTest-735801655 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:25.812399 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3256da76-c7d6-4047-b6d8-c1d3876383ef tempest-VolumesImageMetadata-247790516 None] Volume volume-35445a36-a76c-48db-a9c5-3b58646c1e7b.deleted is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:09:25.814025 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3256da76-c7d6-4047-b6d8-c1d3876383ef tempest-VolumesImageMetadata-247790516 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:09:25.814582 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3256da76-c7d6-4047-b6d8-c1d3876383ef tempest-VolumesImageMetadata-247790516 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:09:25.840301 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3256da76-c7d6-4047-b6d8-c1d3876383ef tempest-VolumesImageMetadata-247790516 None] clone created successfully {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 05 21:09:25.841195 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.volume_utils [None req-3256da76-c7d6-4047-b6d8-c1d3876383ef tempest-VolumesImageMetadata-247790516 None] Marking volume e24b7b08-d724-4114-8228-016f2f043638 as bootable. {{(pid=122683) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Feb 05 21:09:25.852789 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-d0381447-21d0-472d-b89e-534d79265d21 tempest-VolumesGetTest-735801655 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:09:25.853261 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-d0381447-21d0-472d-b89e-534d79265d21 tempest-VolumesGetTest-735801655 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:09:25.859187 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d0381447-21d0-472d-b89e-534d79265d21 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30222c71-83cf-41ed-9faf-3dccfc5b307a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41ff1200-c5de-4d9b-b166-3cea9fc03a3a', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:25.866167 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d0381447-21d0-472d-b89e-534d79265d21 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69ed6635-2f6d-496f-a599-924ffba9059f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:25.874546 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-3256da76-c7d6-4047-b6d8-c1d3876383ef tempest-VolumesImageMetadata-247790516 None] Copying metadata from image e66a3a3b-d2f9-4d5d-8021-a6001dff419f to e24b7b08-d724-4114-8228-016f2f043638. {{(pid=122683) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 05 21:09:25.875034 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-3256da76-c7d6-4047-b6d8-c1d3876383ef tempest-VolumesImageMetadata-247790516 None] Creating volume glance metadata for volume e24b7b08-d724-4114-8228-016f2f043638 backed by image e66a3a3b-d2f9-4d5d-8021-a6001dff419f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=122683) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 05 21:09:25.884661 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-d0381447-21d0-472d-b89e-534d79265d21 tempest-VolumesGetTest-735801655 None] Volume volume-41ff1200-c5de-4d9b-b166-3cea9fc03a3a (41ff1200-c5de-4d9b-b166-3cea9fc03a3a): created successfully Feb 05 21:09:25.888795 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d0381447-21d0-472d-b89e-534d79265d21 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69ed6635-2f6d-496f-a599-924ffba9059f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:25.901158 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d0381447-21d0-472d-b89e-534d79265d21 tempest-VolumesGetTest-735801655 None] Flow 'volume_create_manager' (be52cda7-4b32-4f39-9aae-5f802934127a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:09:25.925742 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-d0381447-21d0-472d-b89e-534d79265d21 tempest-VolumesGetTest-735801655 None] Created volume successfully. Feb 05 21:09:25.976738 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3256da76-c7d6-4047-b6d8-c1d3876383ef tempest-VolumesImageMetadata-247790516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4941518-2789-4371-9dcf-108d16cd69df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e24b7b08-d724-4114-8228-016f2f043638', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:25.981736 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3256da76-c7d6-4047-b6d8-c1d3876383ef tempest-VolumesImageMetadata-247790516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d34d908b-d302-4096-b125-0f8aea1021d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:25.990924 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-3256da76-c7d6-4047-b6d8-c1d3876383ef tempest-VolumesImageMetadata-247790516 None] Volume volume-e24b7b08-d724-4114-8228-016f2f043638 (e24b7b08-d724-4114-8228-016f2f043638): created successfully Feb 05 21:09:25.994788 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3256da76-c7d6-4047-b6d8-c1d3876383ef tempest-VolumesImageMetadata-247790516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d34d908b-d302-4096-b125-0f8aea1021d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:26.001182 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3256da76-c7d6-4047-b6d8-c1d3876383ef tempest-VolumesImageMetadata-247790516 None] Flow 'volume_create_manager' (13eb5ce9-bdad-4d87-80dc-550b701e644a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:09:26.010049 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-3256da76-c7d6-4047-b6d8-c1d3876383ef tempest-VolumesImageMetadata-247790516 None] Created volume successfully. Feb 05 21:09:26.039514 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-f3c860bd-3b56-4dea-a68d-49226f713613 tempest-VolumesBackupsTest-350919582 None] Terminate volume connection completed successfully. Feb 05 21:09:26.056883 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-f3c860bd-3b56-4dea-a68d-49226f713613 tempest-VolumesBackupsTest-350919582 None] Remove volume export completed successfully. Feb 05 21:09:26.575120 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f18ca54-e46c-4b92-9bae-7c9dce264f87 tempest-VolumesGetTest-735801655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:09:26.578466 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-2f18ca54-e46c-4b92-9bae-7c9dce264f87 tempest-VolumesGetTest-735801655 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:09:26.578911 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-2f18ca54-e46c-4b92-9bae-7c9dce264f87 tempest-VolumesGetTest-735801655 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:09:26.606200 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-2f18ca54-e46c-4b92-9bae-7c9dce264f87 tempest-VolumesGetTest-735801655 None] Flow 'volume_create_manager' (9b848960-098d-4632-b517-16b1d11a620b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:09:26.612784 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-2f18ca54-e46c-4b92-9bae-7c9dce264f87 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bee672d3-1071-4f51-a261-da3444c287a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:26.619222 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-2f18ca54-e46c-4b92-9bae-7c9dce264f87 tempest-VolumesGetTest-735801655 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:09:26.634335 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-2f18ca54-e46c-4b92-9bae-7c9dce264f87 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bee672d3-1071-4f51-a261-da3444c287a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1217411585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b4635d44-4a9a-4b54-beaf-14ff652200ee,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6e1ea1e3d3cf4f4d8f428013523eb54a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=41ff1200-c5de-4d9b-b166-3cea9fc03a3a,status='creating',terminated_at=None,updated_at=2022-02-05T21:09:27Z,use_quota=True,user_id='cf2bb6c5571949358e6dc70d77314ee7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:26.641035 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-2f18ca54-e46c-4b92-9bae-7c9dce264f87 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d166e81-f703-4194-a974-da00fd7aa22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:26.645236 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-2f18ca54-e46c-4b92-9bae-7c9dce264f87 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d166e81-f703-4194-a974-da00fd7aa22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:26.650873 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-2f18ca54-e46c-4b92-9bae-7c9dce264f87 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0df17929-ff0d-4195-817b-a078d98b9095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:26.665709 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-2f18ca54-e46c-4b92-9bae-7c9dce264f87 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0df17929-ff0d-4195-817b-a078d98b9095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b4635d44-4a9a-4b54-beaf-14ff652200ee', 'volume_name': 'volume-b4635d44-4a9a-4b54-beaf-14ff652200ee', 'volume_size': 1, 'source_volid': '41ff1200-c5de-4d9b-b166-3cea9fc03a3a', 'source_volstatus': 'available'}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:26.670653 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-2f18ca54-e46c-4b92-9bae-7c9dce264f87 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff2b1ebd-2a0e-4e0f-bf28-0f8e21af3d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:26.674922 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-2f18ca54-e46c-4b92-9bae-7c9dce264f87 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff2b1ebd-2a0e-4e0f-bf28-0f8e21af3d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:26.679769 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-2f18ca54-e46c-4b92-9bae-7c9dce264f87 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc395c5c-4deb-4c01-af2f-f8cd0ee7cbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:26.680834 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-2f18ca54-e46c-4b92-9bae-7c9dce264f87 tempest-VolumesGetTest-735801655 None] Volume b4635d44-4a9a-4b54-beaf-14ff652200ee: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b4635d44-4a9a-4b54-beaf-14ff652200ee', 'volume_size': 1, 'source_volid': '41ff1200-c5de-4d9b-b166-3cea9fc03a3a', 'source_volstatus': 'available'} Feb 05 21:09:26.691669 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-2f18ca54-e46c-4b92-9bae-7c9dce264f87 tempest-VolumesGetTest-735801655 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:26.727119 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-2f18ca54-e46c-4b92-9bae-7c9dce264f87 tempest-VolumesGetTest-735801655 None] creating snapshot='volume-b4635d44-4a9a-4b54-beaf-14ff652200ee.clone_snap' {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 05 21:09:27.562349 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-2f18ca54-e46c-4b92-9bae-7c9dce264f87 tempest-VolumesGetTest-735801655 None] cloning 'volume-41ff1200-c5de-4d9b-b166-3cea9fc03a3a@volume-b4635d44-4a9a-4b54-beaf-14ff652200ee.clone_snap' to 'volume-b4635d44-4a9a-4b54-beaf-14ff652200ee' {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 05 21:09:27.590748 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-fc26b69a-2f06-4c5b-9166-b7c1f874516f tempest-VolumesBackupsTest-350919582 None] Lock "b'cinder-41f660e3-74ff-446e-84b9-f0721676e61f-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:09:27.593620 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-23fa3eb4-65b9-420d-ad1b-cc5387d08d70 tempest-VolumesImageMetadata-247790516 None] Lock "b'cinder-e24b7b08-d724-4114-8228-016f2f043638-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:09:27.676577 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-2f18ca54-e46c-4b92-9bae-7c9dce264f87 tempest-VolumesGetTest-735801655 None] Volume volume-41ff1200-c5de-4d9b-b166-3cea9fc03a3a is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:09:27.677839 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-2f18ca54-e46c-4b92-9bae-7c9dce264f87 tempest-VolumesGetTest-735801655 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:09:27.678209 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-2f18ca54-e46c-4b92-9bae-7c9dce264f87 tempest-VolumesGetTest-735801655 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:09:27.694146 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-2f18ca54-e46c-4b92-9bae-7c9dce264f87 tempest-VolumesGetTest-735801655 None] clone created successfully {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 05 21:09:27.697896 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-2f18ca54-e46c-4b92-9bae-7c9dce264f87 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc395c5c-4deb-4c01-af2f-f8cd0ee7cbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4635d44-4a9a-4b54-beaf-14ff652200ee', 'volume_size': 1, 'source_volid': '41ff1200-c5de-4d9b-b166-3cea9fc03a3a', 'source_volstatus': 'available'}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:27.703200 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-2f18ca54-e46c-4b92-9bae-7c9dce264f87 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5973adf-42fb-4d50-92b0-4f2471e966c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:27.715818 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-fc26b69a-2f06-4c5b-9166-b7c1f874516f tempest-VolumesBackupsTest-350919582 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:28.597393 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-fc26b69a-2f06-4c5b-9166-b7c1f874516f tempest-VolumesBackupsTest-350919582 None] Volume volume-41f660e3-74ff-446e-84b9-f0721676e61f is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:09:28.623270 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-fc26b69a-2f06-4c5b-9166-b7c1f874516f tempest-VolumesBackupsTest-350919582 None] deleting rbd volume volume-41f660e3-74ff-446e-84b9-f0721676e61f {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:09:28.628793 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-2f18ca54-e46c-4b92-9bae-7c9dce264f87 tempest-VolumesGetTest-735801655 None] Volume volume-b4635d44-4a9a-4b54-beaf-14ff652200ee (b4635d44-4a9a-4b54-beaf-14ff652200ee): created successfully Feb 05 21:09:28.633328 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-2f18ca54-e46c-4b92-9bae-7c9dce264f87 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5973adf-42fb-4d50-92b0-4f2471e966c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:28.645990 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-2f18ca54-e46c-4b92-9bae-7c9dce264f87 tempest-VolumesGetTest-735801655 None] Flow 'volume_create_manager' (9b848960-098d-4632-b517-16b1d11a620b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:09:28.649685 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-23fa3eb4-65b9-420d-ad1b-cc5387d08d70 tempest-VolumesImageMetadata-247790516 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:28.766079 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-23fa3eb4-65b9-420d-ad1b-cc5387d08d70 tempest-VolumesImageMetadata-247790516 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:09:28.784347 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-23fa3eb4-65b9-420d-ad1b-cc5387d08d70 tempest-VolumesImageMetadata-247790516 None] deleting rbd volume volume-e24b7b08-d724-4114-8228-016f2f043638 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:09:28.815762 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-2f18ca54-e46c-4b92-9bae-7c9dce264f87 tempest-VolumesGetTest-735801655 None] Created volume successfully. Feb 05 21:09:29.327906 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-23fa3eb4-65b9-420d-ad1b-cc5387d08d70 tempest-VolumesImageMetadata-247790516 None] volume is a clone so cleaning references {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 05 21:09:29.367674 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-23fa3eb4-65b9-420d-ad1b-cc5387d08d70 tempest-VolumesImageMetadata-247790516 None] deleting parent snapshot volume-e24b7b08-d724-4114-8228-016f2f043638.clone_snap {{(pid=122683) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 05 21:09:29.670609 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-72fe0c59-3cc8-48fc-b937-188f9ace48f3 tempest-VolumesGetTest-735801655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:09:29.673450 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-72fe0c59-3cc8-48fc-b937-188f9ace48f3 tempest-VolumesGetTest-735801655 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:09:29.673904 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-72fe0c59-3cc8-48fc-b937-188f9ace48f3 tempest-VolumesGetTest-735801655 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:09:29.704873 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-72fe0c59-3cc8-48fc-b937-188f9ace48f3 tempest-VolumesGetTest-735801655 None] Flow 'volume_create_manager' (7f612664-7f65-4cba-a2d1-d84815b77e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:09:29.713798 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-72fe0c59-3cc8-48fc-b937-188f9ace48f3 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c25a1422-21f5-405c-87f7-7246c6d30073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:29.720993 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-fc26b69a-2f06-4c5b-9166-b7c1f874516f tempest-VolumesBackupsTest-350919582 None] Created reservations ['9640e270-51e4-4115-9e3a-0ef67d57ab8a', '30c30bab-beec-4933-b64d-c32cd5f7208c', '39d2a1c9-775d-4779-871d-135ee6a1205c', 'd67e72ce-5a17-4085-b067-d263c724286d'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:09:29.726740 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-72fe0c59-3cc8-48fc-b937-188f9ace48f3 tempest-VolumesGetTest-735801655 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:09:29.743851 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-72fe0c59-3cc8-48fc-b937-188f9ace48f3 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c25a1422-21f5-405c-87f7-7246c6d30073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:09:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-447423761',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4f73c614-21d2-480e-a19d-4c5f80f4e7d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e1ea1e3d3cf4f4d8f428013523eb54a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:09:29Z,use_quota=True,user_id='cf2bb6c5571949358e6dc70d77314ee7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:29.750692 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-72fe0c59-3cc8-48fc-b937-188f9ace48f3 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93dcfc42-fde1-4d8e-a62a-601206871787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:29.754889 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-72fe0c59-3cc8-48fc-b937-188f9ace48f3 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93dcfc42-fde1-4d8e-a62a-601206871787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:29.760016 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-72fe0c59-3cc8-48fc-b937-188f9ace48f3 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3ff6509-d596-4d5e-8d1d-210f505c3272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:29.764612 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-72fe0c59-3cc8-48fc-b937-188f9ace48f3 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3ff6509-d596-4d5e-8d1d-210f505c3272) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f73c614-21d2-480e-a19d-4c5f80f4e7d3', 'volume_name': 'volume-4f73c614-21d2-480e-a19d-4c5f80f4e7d3', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:29.769527 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-72fe0c59-3cc8-48fc-b937-188f9ace48f3 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06016b96-ea8e-4982-a2aa-2548c91ca20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:29.773509 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-72fe0c59-3cc8-48fc-b937-188f9ace48f3 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06016b96-ea8e-4982-a2aa-2548c91ca20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:29.778666 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-72fe0c59-3cc8-48fc-b937-188f9ace48f3 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a73e1c4-da1b-428e-b5d0-ac8bc194cb97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:29.779741 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-72fe0c59-3cc8-48fc-b937-188f9ace48f3 tempest-VolumesGetTest-735801655 None] Volume 4f73c614-21d2-480e-a19d-4c5f80f4e7d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f73c614-21d2-480e-a19d-4c5f80f4e7d3', 'volume_size': 1} Feb 05 21:09:29.780122 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-72fe0c59-3cc8-48fc-b937-188f9ace48f3 tempest-VolumesGetTest-735801655 None] creating volume 'volume-4f73c614-21d2-480e-a19d-4c5f80f4e7d3' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:09:29.781096 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-72fe0c59-3cc8-48fc-b937-188f9ace48f3 tempest-VolumesGetTest-735801655 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:29.835991 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-23fa3eb4-65b9-420d-ad1b-cc5387d08d70 tempest-VolumesImageMetadata-247790516 None] Created reservations ['bcf69dad-74cc-41dc-85ff-b73c5856f4fa', '7ea87c9a-fa06-4b7d-a4e8-dd48cc49e29a', '1004bb01-5194-45f3-992e-819d5c82d6bf', '2498da24-5019-42e6-ae4f-138d0a1d8903'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:09:29.858631 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-72fe0c59-3cc8-48fc-b937-188f9ace48f3 tempest-VolumesGetTest-735801655 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:09:29.859008 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-72fe0c59-3cc8-48fc-b937-188f9ace48f3 tempest-VolumesGetTest-735801655 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:09:29.862835 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-72fe0c59-3cc8-48fc-b937-188f9ace48f3 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a73e1c4-da1b-428e-b5d0-ac8bc194cb97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f73c614-21d2-480e-a19d-4c5f80f4e7d3', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:29.867525 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-72fe0c59-3cc8-48fc-b937-188f9ace48f3 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c4eae41-0aeb-4b99-b57e-5ce558fd5ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:29.888636 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-72fe0c59-3cc8-48fc-b937-188f9ace48f3 tempest-VolumesGetTest-735801655 None] Volume volume-4f73c614-21d2-480e-a19d-4c5f80f4e7d3 (4f73c614-21d2-480e-a19d-4c5f80f4e7d3): created successfully Feb 05 21:09:29.892335 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-72fe0c59-3cc8-48fc-b937-188f9ace48f3 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c4eae41-0aeb-4b99-b57e-5ce558fd5ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:29.897862 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-72fe0c59-3cc8-48fc-b937-188f9ace48f3 tempest-VolumesGetTest-735801655 None] Flow 'volume_create_manager' (7f612664-7f65-4cba-a2d1-d84815b77e9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:09:29.916113 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-fc26b69a-2f06-4c5b-9166-b7c1f874516f tempest-VolumesBackupsTest-350919582 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:29.959164 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-fc26b69a-2f06-4c5b-9166-b7c1f874516f tempest-VolumesBackupsTest-350919582 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:29.984667 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-fc26b69a-2f06-4c5b-9166-b7c1f874516f tempest-VolumesBackupsTest-350919582 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:09:29.987709 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-72fe0c59-3cc8-48fc-b937-188f9ace48f3 tempest-VolumesGetTest-735801655 None] Created volume successfully. Feb 05 21:09:29.994898 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-fc26b69a-2f06-4c5b-9166-b7c1f874516f tempest-VolumesBackupsTest-350919582 None] Deleted volume successfully. Feb 05 21:09:30.008042 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-23fa3eb4-65b9-420d-ad1b-cc5387d08d70 tempest-VolumesImageMetadata-247790516 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:30.029554 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-23fa3eb4-65b9-420d-ad1b-cc5387d08d70 tempest-VolumesImageMetadata-247790516 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:30.053948 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-23fa3eb4-65b9-420d-ad1b-cc5387d08d70 tempest-VolumesImageMetadata-247790516 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:09:30.056948 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-fc26b69a-2f06-4c5b-9166-b7c1f874516f tempest-VolumesBackupsTest-350919582 None] Lock "b'cinder-41f660e3-74ff-446e-84b9-f0721676e61f-delete_volume'" released by "delete_volume" :: held 2.466s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:09:30.061244 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-23fa3eb4-65b9-420d-ad1b-cc5387d08d70 tempest-VolumesImageMetadata-247790516 None] Deleted volume successfully. Feb 05 21:09:30.073104 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-23fa3eb4-65b9-420d-ad1b-cc5387d08d70 tempest-VolumesImageMetadata-247790516 None] Lock "b'cinder-e24b7b08-d724-4114-8228-016f2f043638-delete_volume'" released by "delete_volume" :: held 2.479s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:09:30.455968 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-92c92153-7748-49bb-a229-8219af7dbd3b tempest-VolumesGetTest-735801655 None] Lock "b'cinder-4f73c614-21d2-480e-a19d-4c5f80f4e7d3-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:09:30.491238 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-92c92153-7748-49bb-a229-8219af7dbd3b tempest-VolumesGetTest-735801655 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:30.530945 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-92c92153-7748-49bb-a229-8219af7dbd3b tempest-VolumesGetTest-735801655 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:09:30.531383 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-92c92153-7748-49bb-a229-8219af7dbd3b tempest-VolumesGetTest-735801655 None] Volume volume-4f73c614-21d2-480e-a19d-4c5f80f4e7d3 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:09:30.537310 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-92c92153-7748-49bb-a229-8219af7dbd3b tempest-VolumesGetTest-735801655 None] deleting rbd volume volume-4f73c614-21d2-480e-a19d-4c5f80f4e7d3 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:09:30.850830 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-92c92153-7748-49bb-a229-8219af7dbd3b tempest-VolumesGetTest-735801655 None] Created reservations ['cd33c9b0-70a7-4c38-8908-83d72eb12e31', 'c3990575-2da1-4096-9189-2b80f28483a3', 'ea348553-5eb6-4a29-8a74-5703c0cb0bff', '90388754-376b-43bd-a2bf-1935e669c011'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:09:30.908260 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-92c92153-7748-49bb-a229-8219af7dbd3b tempest-VolumesGetTest-735801655 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:30.957266 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-92c92153-7748-49bb-a229-8219af7dbd3b tempest-VolumesGetTest-735801655 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:30.997649 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-92c92153-7748-49bb-a229-8219af7dbd3b tempest-VolumesGetTest-735801655 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:09:31.002131 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-92c92153-7748-49bb-a229-8219af7dbd3b tempest-VolumesGetTest-735801655 None] Deleted volume successfully. Feb 05 21:09:31.020332 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-92c92153-7748-49bb-a229-8219af7dbd3b tempest-VolumesGetTest-735801655 None] Lock "b'cinder-4f73c614-21d2-480e-a19d-4c5f80f4e7d3-delete_volume'" released by "delete_volume" :: held 0.564s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:09:31.528054 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-cb8d77a5-d570-4567-8629-e1dd1042c50b tempest-VolumesBackupsTest-350919582 None] Lock "b'cinder-10f43b5e-5fc3-4f9e-be50-14c09c91d474-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:09:31.607037 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-cb8d77a5-d570-4567-8629-e1dd1042c50b tempest-VolumesBackupsTest-350919582 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:32.689212 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-cb8d77a5-d570-4567-8629-e1dd1042c50b tempest-VolumesBackupsTest-350919582 None] deleting rbd volume volume-10f43b5e-5fc3-4f9e-be50-14c09c91d474 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:09:32.706748 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-ca5b04e7-5ac7-47ec-86f4-27a4b1bbc140 tempest-VolumesGetTest-735801655 None] Lock "b'cinder-b4635d44-4a9a-4b54-beaf-14ff652200ee-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:09:32.752049 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ca5b04e7-5ac7-47ec-86f4-27a4b1bbc140 tempest-VolumesGetTest-735801655 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:32.835174 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ca5b04e7-5ac7-47ec-86f4-27a4b1bbc140 tempest-VolumesGetTest-735801655 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:09:32.848561 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ca5b04e7-5ac7-47ec-86f4-27a4b1bbc140 tempest-VolumesGetTest-735801655 None] deleting rbd volume volume-b4635d44-4a9a-4b54-beaf-14ff652200ee {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:09:33.032372 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-cb8d77a5-d570-4567-8629-e1dd1042c50b tempest-VolumesBackupsTest-350919582 None] volume is a clone so cleaning references {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 05 21:09:33.095884 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-cb8d77a5-d570-4567-8629-e1dd1042c50b tempest-VolumesBackupsTest-350919582 None] deleting parent snapshot volume-10f43b5e-5fc3-4f9e-be50-14c09c91d474.clone_snap {{(pid=122683) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 05 21:09:33.705153 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ca5b04e7-5ac7-47ec-86f4-27a4b1bbc140 tempest-VolumesGetTest-735801655 None] volume is a clone so cleaning references {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 05 21:09:33.736714 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ca5b04e7-5ac7-47ec-86f4-27a4b1bbc140 tempest-VolumesGetTest-735801655 None] Volume volume-41ff1200-c5de-4d9b-b166-3cea9fc03a3a is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:09:33.737549 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ca5b04e7-5ac7-47ec-86f4-27a4b1bbc140 tempest-VolumesGetTest-735801655 None] deleting parent snapshot volume-b4635d44-4a9a-4b54-beaf-14ff652200ee.clone_snap {{(pid=122683) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 05 21:09:34.721707 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6846fe7-3888-4774-ae97-b58a2dd74164 tempest-VolumesCloneTest-1887525358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:09:34.725607 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-d6846fe7-3888-4774-ae97-b58a2dd74164 tempest-VolumesCloneTest-1887525358 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:09:34.726052 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-d6846fe7-3888-4774-ae97-b58a2dd74164 tempest-VolumesCloneTest-1887525358 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:09:34.749003 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d6846fe7-3888-4774-ae97-b58a2dd74164 tempest-VolumesCloneTest-1887525358 None] Flow 'volume_create_manager' (0d7f8598-e54a-48d0-bdad-fa945714dde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:09:34.755619 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d6846fe7-3888-4774-ae97-b58a2dd74164 tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7ce2b80-b5f8-403b-a60d-5c8aab77b004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:34.765316 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-ca5b04e7-5ac7-47ec-86f4-27a4b1bbc140 tempest-VolumesGetTest-735801655 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:09:34.802435 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d6846fe7-3888-4774-ae97-b58a2dd74164 tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7ce2b80-b5f8-403b-a60d-5c8aab77b004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1792086941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=153391ed-c44b-4e50-89c9-fc08651650ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dc55288f6324f8498b16b48858426c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:09:33Z,use_quota=True,user_id='f1e6d8adae3644a59f75d546ac21920f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:34.807871 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d6846fe7-3888-4774-ae97-b58a2dd74164 tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ce19554-ea0f-4b36-8286-98549409b74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:34.812325 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d6846fe7-3888-4774-ae97-b58a2dd74164 tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ce19554-ea0f-4b36-8286-98549409b74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:34.817467 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d6846fe7-3888-4774-ae97-b58a2dd74164 tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cb46ab5-a88d-4f0d-b35a-e86b2d49c530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:34.823549 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-ca5b04e7-5ac7-47ec-86f4-27a4b1bbc140 tempest-VolumesGetTest-735801655 None] Created reservations ['824a224c-bf7b-4f92-8b7d-8a930e67ea99', 'fb880665-3ec0-4e10-9c7c-8bbf3e00c0c2', 'f028fe06-cf3f-4113-91db-8246e12fb3c9', '8cd91a65-3297-437b-9cf8-393106cdc642'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:09:34.848240 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-cb8d77a5-d570-4567-8629-e1dd1042c50b tempest-VolumesBackupsTest-350919582 None] Created reservations ['c626bebc-afd7-415f-9759-ac753a193845', 'a5b6eba9-7af9-43e2-94ad-dd31dffdddc2', '13f79749-c090-4d86-a744-dfc404f055a2', 'ee9ed2d4-97a3-497b-966f-1d8db96e7550'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:09:34.908665 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ca5b04e7-5ac7-47ec-86f4-27a4b1bbc140 tempest-VolumesGetTest-735801655 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:34.941079 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ca5b04e7-5ac7-47ec-86f4-27a4b1bbc140 tempest-VolumesGetTest-735801655 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:34.965982 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-ca5b04e7-5ac7-47ec-86f4-27a4b1bbc140 tempest-VolumesGetTest-735801655 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:09:34.976794 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-ca5b04e7-5ac7-47ec-86f4-27a4b1bbc140 tempest-VolumesGetTest-735801655 None] Deleted volume successfully. Feb 05 21:09:34.990308 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d6846fe7-3888-4774-ae97-b58a2dd74164 tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cb46ab5-a88d-4f0d-b35a-e86b2d49c530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '153391ed-c44b-4e50-89c9-fc08651650ee', 'volume_name': 'volume-153391ed-c44b-4e50-89c9-fc08651650ee', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:34.996211 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d6846fe7-3888-4774-ae97-b58a2dd74164 tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7c0a17b-220f-4402-9c3c-32351ba234cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:35.000239 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d6846fe7-3888-4774-ae97-b58a2dd74164 tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7c0a17b-220f-4402-9c3c-32351ba234cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:35.005015 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d6846fe7-3888-4774-ae97-b58a2dd74164 tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0a36bd9-bba9-4ecf-a68c-70d9d95b926a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:35.006143 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-d6846fe7-3888-4774-ae97-b58a2dd74164 tempest-VolumesCloneTest-1887525358 None] Volume 153391ed-c44b-4e50-89c9-fc08651650ee: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-153391ed-c44b-4e50-89c9-fc08651650ee', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 05 21:09:35.006718 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6846fe7-3888-4774-ae97-b58a2dd74164 tempest-VolumesCloneTest-1887525358 None] Cloning 153391ed-c44b-4e50-89c9-fc08651650ee from image e66a3a3b-d2f9-4d5d-8021-a6001dff419f at location (None, None). {{(pid=122683) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 05 21:09:35.016566 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-cb8d77a5-d570-4567-8629-e1dd1042c50b tempest-VolumesBackupsTest-350919582 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:35.040786 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-cb8d77a5-d570-4567-8629-e1dd1042c50b tempest-VolumesBackupsTest-350919582 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:35.069045 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-cb8d77a5-d570-4567-8629-e1dd1042c50b tempest-VolumesBackupsTest-350919582 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:09:35.071793 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-d6846fe7-3888-4774-ae97-b58a2dd74164 tempest-VolumesCloneTest-1887525358 None] Lock "b'cinder-e66a3a3b-d2f9-4d5d-8021-a6001dff419f'" acquired by "_prepare_image_cache_entry" :: waited 0.064s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:09:35.075516 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-ca5b04e7-5ac7-47ec-86f4-27a4b1bbc140 tempest-VolumesGetTest-735801655 None] Lock "b'cinder-b4635d44-4a9a-4b54-beaf-14ff652200ee-delete_volume'" released by "delete_volume" :: held 2.369s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:09:35.079384 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-cb8d77a5-d570-4567-8629-e1dd1042c50b tempest-VolumesBackupsTest-350919582 None] Deleted volume successfully. Feb 05 21:09:35.087796 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-d6846fe7-3888-4774-ae97-b58a2dd74164 tempest-VolumesCloneTest-1887525358 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'volume_id': '311ef4be-45fd-4167-a3ad-6251d56550a7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57), 'last_used': datetime.datetime(2022, 2, 5, 21, 9, 35, 81926)}. {{(pid=122683) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 05 21:09:35.088270 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-d6846fe7-3888-4774-ae97-b58a2dd74164 tempest-VolumesCloneTest-1887525358 None] Image-volume cache entry image_update_at = 2022-02-05 20:37:57+00:00, requested image updated_at = 2022-02-05 20:37:57+00:00. {{(pid=122683) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 05 21:09:35.088673 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6846fe7-3888-4774-ae97-b58a2dd74164 tempest-VolumesCloneTest-1887525358 None] Found cache entry for image = e66a3a3b-d2f9-4d5d-8021-a6001dff419f on host ncdv-master-1@ceph#ceph. {{(pid=122683) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Feb 05 21:09:35.094690 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-d6846fe7-3888-4774-ae97-b58a2dd74164 tempest-VolumesCloneTest-1887525358 None] Lock "b'cinder-e66a3a3b-d2f9-4d5d-8021-a6001dff419f'" released by "_prepare_image_cache_entry" :: held 0.023s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:09:35.095538 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6846fe7-3888-4774-ae97-b58a2dd74164 tempest-VolumesCloneTest-1887525358 None] Attempting to retrieve cache entry for image = e66a3a3b-d2f9-4d5d-8021-a6001dff419f on host ncdv-master-1@ceph#ceph. {{(pid=122683) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 05 21:09:35.098023 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-cb8d77a5-d570-4567-8629-e1dd1042c50b tempest-VolumesBackupsTest-350919582 None] Lock "b'cinder-10f43b5e-5fc3-4f9e-be50-14c09c91d474-delete_volume'" released by "delete_volume" :: held 3.570s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:09:35.103052 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-d6846fe7-3888-4774-ae97-b58a2dd74164 tempest-VolumesCloneTest-1887525358 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'volume_id': '311ef4be-45fd-4167-a3ad-6251d56550a7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57), 'last_used': datetime.datetime(2022, 2, 5, 21, 9, 35, 100712)}. {{(pid=122683) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 05 21:09:35.103467 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-d6846fe7-3888-4774-ae97-b58a2dd74164 tempest-VolumesCloneTest-1887525358 None] Image-volume cache entry image_update_at = 2022-02-05 20:37:57+00:00, requested image updated_at = 2022-02-05 20:37:57+00:00. {{(pid=122683) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 05 21:09:35.103853 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6846fe7-3888-4774-ae97-b58a2dd74164 tempest-VolumesCloneTest-1887525358 None] Creating from source image-volume 311ef4be-45fd-4167-a3ad-6251d56550a7 {{(pid=122683) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Feb 05 21:09:35.116217 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-d6846fe7-3888-4774-ae97-b58a2dd74164 tempest-VolumesCloneTest-1887525358 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:35.186995 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-d6846fe7-3888-4774-ae97-b58a2dd74164 tempest-VolumesCloneTest-1887525358 None] creating snapshot='volume-153391ed-c44b-4e50-89c9-fc08651650ee.clone_snap' {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 05 21:09:35.711831 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-d6846fe7-3888-4774-ae97-b58a2dd74164 tempest-VolumesCloneTest-1887525358 None] cloning 'volume-311ef4be-45fd-4167-a3ad-6251d56550a7@volume-153391ed-c44b-4e50-89c9-fc08651650ee.clone_snap' to 'volume-153391ed-c44b-4e50-89c9-fc08651650ee' {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 05 21:09:35.892884 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-d6846fe7-3888-4774-ae97-b58a2dd74164 tempest-VolumesCloneTest-1887525358 None] Volume volume-35445a36-a76c-48db-a9c5-3b58646c1e7b.deleted is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:09:35.894346 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-d6846fe7-3888-4774-ae97-b58a2dd74164 tempest-VolumesCloneTest-1887525358 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:09:35.894961 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-d6846fe7-3888-4774-ae97-b58a2dd74164 tempest-VolumesCloneTest-1887525358 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:09:35.943139 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-d6846fe7-3888-4774-ae97-b58a2dd74164 tempest-VolumesCloneTest-1887525358 None] clone created successfully {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 05 21:09:35.943740 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.volume_utils [None req-d6846fe7-3888-4774-ae97-b58a2dd74164 tempest-VolumesCloneTest-1887525358 None] Marking volume 153391ed-c44b-4e50-89c9-fc08651650ee as bootable. {{(pid=122683) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Feb 05 21:09:35.966612 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6846fe7-3888-4774-ae97-b58a2dd74164 tempest-VolumesCloneTest-1887525358 None] Copying metadata from image e66a3a3b-d2f9-4d5d-8021-a6001dff419f to 153391ed-c44b-4e50-89c9-fc08651650ee. {{(pid=122683) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 05 21:09:35.967357 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6846fe7-3888-4774-ae97-b58a2dd74164 tempest-VolumesCloneTest-1887525358 None] Creating volume glance metadata for volume 153391ed-c44b-4e50-89c9-fc08651650ee backed by image e66a3a3b-d2f9-4d5d-8021-a6001dff419f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=122683) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 05 21:09:36.074368 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d6846fe7-3888-4774-ae97-b58a2dd74164 tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0a36bd9-bba9-4ecf-a68c-70d9d95b926a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-153391ed-c44b-4e50-89c9-fc08651650ee', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:36.084854 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d6846fe7-3888-4774-ae97-b58a2dd74164 tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74479347-2ae7-41cd-b49c-6e1342efaa1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:36.098830 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-d6846fe7-3888-4774-ae97-b58a2dd74164 tempest-VolumesCloneTest-1887525358 None] Volume volume-153391ed-c44b-4e50-89c9-fc08651650ee (153391ed-c44b-4e50-89c9-fc08651650ee): created successfully Feb 05 21:09:36.104271 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d6846fe7-3888-4774-ae97-b58a2dd74164 tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74479347-2ae7-41cd-b49c-6e1342efaa1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:36.114498 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-d6846fe7-3888-4774-ae97-b58a2dd74164 tempest-VolumesCloneTest-1887525358 None] Flow 'volume_create_manager' (0d7f8598-e54a-48d0-bdad-fa945714dde8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:09:36.130032 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-d6846fe7-3888-4774-ae97-b58a2dd74164 tempest-VolumesCloneTest-1887525358 None] Created volume successfully. Feb 05 21:09:36.678953 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a6bb3b0-c50a-430b-be22-8780e68d9322 tempest-VolumesGetTest-735801655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:09:36.686642 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-4a6bb3b0-c50a-430b-be22-8780e68d9322 tempest-VolumesGetTest-735801655 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:09:36.687346 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-4a6bb3b0-c50a-430b-be22-8780e68d9322 tempest-VolumesGetTest-735801655 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:09:36.716025 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-4a6bb3b0-c50a-430b-be22-8780e68d9322 tempest-VolumesGetTest-735801655 None] Flow 'volume_create_manager' (a9e78818-4765-426d-9fe6-3548140dc77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:09:36.726737 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-4a6bb3b0-c50a-430b-be22-8780e68d9322 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd24526-493c-4075-b2f0-dcbdf2e9a317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:36.751162 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-4a6bb3b0-c50a-430b-be22-8780e68d9322 tempest-VolumesGetTest-735801655 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:09:36.814843 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-4a6bb3b0-c50a-430b-be22-8780e68d9322 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd24526-493c-4075-b2f0-dcbdf2e9a317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1646398107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9417e9b7-61f8-4e09-861c-1de9510ed37c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6e1ea1e3d3cf4f4d8f428013523eb54a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:09:37Z,use_quota=True,user_id='cf2bb6c5571949358e6dc70d77314ee7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:36.831058 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-4a6bb3b0-c50a-430b-be22-8780e68d9322 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01786074-4c57-4a68-b9b1-92e830414cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:36.847522 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-4a6bb3b0-c50a-430b-be22-8780e68d9322 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01786074-4c57-4a68-b9b1-92e830414cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:36.861500 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-4a6bb3b0-c50a-430b-be22-8780e68d9322 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcb095cc-ff37-47ac-9156-9006406572ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:37.046770 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-4a6bb3b0-c50a-430b-be22-8780e68d9322 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcb095cc-ff37-47ac-9156-9006406572ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9417e9b7-61f8-4e09-861c-1de9510ed37c', 'volume_name': 'volume-9417e9b7-61f8-4e09-861c-1de9510ed37c', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:37.052962 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-4a6bb3b0-c50a-430b-be22-8780e68d9322 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd76a462-581d-4bf4-b3b9-de04b197669f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:37.057123 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-4a6bb3b0-c50a-430b-be22-8780e68d9322 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd76a462-581d-4bf4-b3b9-de04b197669f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:37.063424 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-4a6bb3b0-c50a-430b-be22-8780e68d9322 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5414f55-32ec-4700-805d-50d9bb0892a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:37.064585 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-4a6bb3b0-c50a-430b-be22-8780e68d9322 tempest-VolumesGetTest-735801655 None] Volume 9417e9b7-61f8-4e09-861c-1de9510ed37c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9417e9b7-61f8-4e09-861c-1de9510ed37c', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 05 21:09:37.065155 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a6bb3b0-c50a-430b-be22-8780e68d9322 tempest-VolumesGetTest-735801655 None] Cloning 9417e9b7-61f8-4e09-861c-1de9510ed37c from image e66a3a3b-d2f9-4d5d-8021-a6001dff419f at location (None, None). {{(pid=122683) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 05 21:09:37.088724 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-4a6bb3b0-c50a-430b-be22-8780e68d9322 tempest-VolumesGetTest-735801655 None] Lock "b'cinder-e66a3a3b-d2f9-4d5d-8021-a6001dff419f'" acquired by "_prepare_image_cache_entry" :: waited 0.023s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:09:37.105852 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-4a6bb3b0-c50a-430b-be22-8780e68d9322 tempest-VolumesGetTest-735801655 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'volume_id': '311ef4be-45fd-4167-a3ad-6251d56550a7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57), 'last_used': datetime.datetime(2022, 2, 5, 21, 9, 37, 97064)}. {{(pid=122683) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 05 21:09:37.106617 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-4a6bb3b0-c50a-430b-be22-8780e68d9322 tempest-VolumesGetTest-735801655 None] Image-volume cache entry image_update_at = 2022-02-05 20:37:57+00:00, requested image updated_at = 2022-02-05 20:37:57+00:00. {{(pid=122683) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 05 21:09:37.107271 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a6bb3b0-c50a-430b-be22-8780e68d9322 tempest-VolumesGetTest-735801655 None] Found cache entry for image = e66a3a3b-d2f9-4d5d-8021-a6001dff419f on host ncdv-master-1@ceph#ceph. {{(pid=122683) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Feb 05 21:09:37.113868 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-9db9ca01-bc89-435b-91a9-0684bf1e1750 tempest-VolumesCloneTest-1887525358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:09:37.119499 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-9db9ca01-bc89-435b-91a9-0684bf1e1750 tempest-VolumesCloneTest-1887525358 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:09:37.119899 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-9db9ca01-bc89-435b-91a9-0684bf1e1750 tempest-VolumesCloneTest-1887525358 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:09:37.134261 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-4a6bb3b0-c50a-430b-be22-8780e68d9322 tempest-VolumesGetTest-735801655 None] Lock "b'cinder-e66a3a3b-d2f9-4d5d-8021-a6001dff419f'" released by "_prepare_image_cache_entry" :: held 0.045s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:09:37.135366 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a6bb3b0-c50a-430b-be22-8780e68d9322 tempest-VolumesGetTest-735801655 None] Attempting to retrieve cache entry for image = e66a3a3b-d2f9-4d5d-8021-a6001dff419f on host ncdv-master-1@ceph#ceph. {{(pid=122683) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 05 21:09:37.142668 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-4a6bb3b0-c50a-430b-be22-8780e68d9322 tempest-VolumesGetTest-735801655 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:09:37.164675 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9db9ca01-bc89-435b-91a9-0684bf1e1750 tempest-VolumesCloneTest-1887525358 None] Flow 'volume_create_manager' (5751b298-74b3-4b2e-93b6-78e83fdb4eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:09:37.172504 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9db9ca01-bc89-435b-91a9-0684bf1e1750 tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f32b298-c493-4571-8e3a-563babf5ee40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:37.182178 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-4a6bb3b0-c50a-430b-be22-8780e68d9322 tempest-VolumesGetTest-735801655 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'volume_id': '311ef4be-45fd-4167-a3ad-6251d56550a7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57), 'last_used': datetime.datetime(2022, 2, 5, 21, 9, 37, 178967)}. {{(pid=122683) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 05 21:09:37.183678 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-4a6bb3b0-c50a-430b-be22-8780e68d9322 tempest-VolumesGetTest-735801655 None] Image-volume cache entry image_update_at = 2022-02-05 20:37:57+00:00, requested image updated_at = 2022-02-05 20:37:57+00:00. {{(pid=122683) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 05 21:09:37.184376 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a6bb3b0-c50a-430b-be22-8780e68d9322 tempest-VolumesGetTest-735801655 None] Creating from source image-volume 311ef4be-45fd-4167-a3ad-6251d56550a7 {{(pid=122683) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Feb 05 21:09:37.204760 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-4a6bb3b0-c50a-430b-be22-8780e68d9322 tempest-VolumesGetTest-735801655 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:37.327721 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-4a6bb3b0-c50a-430b-be22-8780e68d9322 tempest-VolumesGetTest-735801655 None] creating snapshot='volume-9417e9b7-61f8-4e09-861c-1de9510ed37c.clone_snap' {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 05 21:09:37.762976 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-4a6bb3b0-c50a-430b-be22-8780e68d9322 tempest-VolumesGetTest-735801655 None] cloning 'volume-311ef4be-45fd-4167-a3ad-6251d56550a7@volume-9417e9b7-61f8-4e09-861c-1de9510ed37c.clone_snap' to 'volume-9417e9b7-61f8-4e09-861c-1de9510ed37c' {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 05 21:09:37.792960 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9db9ca01-bc89-435b-91a9-0684bf1e1750 tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f32b298-c493-4571-8e3a-563babf5ee40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1638231702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b77ec0fb-9a75-4cb1-b9ff-f93252481dea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dc55288f6324f8498b16b48858426c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=153391ed-c44b-4e50-89c9-fc08651650ee,status='creating',terminated_at=None,updated_at=2022-02-05T21:09:37Z,use_quota=True,user_id='f1e6d8adae3644a59f75d546ac21920f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:37.811113 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9db9ca01-bc89-435b-91a9-0684bf1e1750 tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1189a544-f038-40cd-9d73-710eb2baaaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:37.819129 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9db9ca01-bc89-435b-91a9-0684bf1e1750 tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1189a544-f038-40cd-9d73-710eb2baaaab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:37.830558 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9db9ca01-bc89-435b-91a9-0684bf1e1750 tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (284f3ed4-15ab-46c8-8cb5-4a34b8389cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:37.864878 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9db9ca01-bc89-435b-91a9-0684bf1e1750 tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (284f3ed4-15ab-46c8-8cb5-4a34b8389cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b77ec0fb-9a75-4cb1-b9ff-f93252481dea', 'volume_name': 'volume-b77ec0fb-9a75-4cb1-b9ff-f93252481dea', 'volume_size': 1, 'source_volid': '153391ed-c44b-4e50-89c9-fc08651650ee', 'source_volstatus': 'available'}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:37.871287 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9db9ca01-bc89-435b-91a9-0684bf1e1750 tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (974af07d-f215-4792-aece-0071129cc065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:37.883594 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9db9ca01-bc89-435b-91a9-0684bf1e1750 tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (974af07d-f215-4792-aece-0071129cc065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:37.902753 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9db9ca01-bc89-435b-91a9-0684bf1e1750 tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d24f89e9-1e32-47c1-a7fd-e662d23859aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:37.913311 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-9db9ca01-bc89-435b-91a9-0684bf1e1750 tempest-VolumesCloneTest-1887525358 None] Volume b77ec0fb-9a75-4cb1-b9ff-f93252481dea: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b77ec0fb-9a75-4cb1-b9ff-f93252481dea', 'volume_size': 1, 'source_volid': '153391ed-c44b-4e50-89c9-fc08651650ee', 'source_volstatus': 'available'} Feb 05 21:09:37.941539 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-9db9ca01-bc89-435b-91a9-0684bf1e1750 tempest-VolumesCloneTest-1887525358 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:38.087155 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-9db9ca01-bc89-435b-91a9-0684bf1e1750 tempest-VolumesCloneTest-1887525358 None] creating snapshot='volume-b77ec0fb-9a75-4cb1-b9ff-f93252481dea.clone_snap' {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 05 21:09:38.610424 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-9db9ca01-bc89-435b-91a9-0684bf1e1750 tempest-VolumesCloneTest-1887525358 None] cloning 'volume-153391ed-c44b-4e50-89c9-fc08651650ee@volume-b77ec0fb-9a75-4cb1-b9ff-f93252481dea.clone_snap' to 'volume-b77ec0fb-9a75-4cb1-b9ff-f93252481dea' {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 05 21:09:38.687315 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-4a6bb3b0-c50a-430b-be22-8780e68d9322 tempest-VolumesGetTest-735801655 None] Volume volume-35445a36-a76c-48db-a9c5-3b58646c1e7b.deleted is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:09:38.689936 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-4a6bb3b0-c50a-430b-be22-8780e68d9322 tempest-VolumesGetTest-735801655 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:09:38.691283 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-4a6bb3b0-c50a-430b-be22-8780e68d9322 tempest-VolumesGetTest-735801655 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:09:38.751936 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-4a6bb3b0-c50a-430b-be22-8780e68d9322 tempest-VolumesGetTest-735801655 None] clone created successfully {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 05 21:09:38.752538 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.volume_utils [None req-4a6bb3b0-c50a-430b-be22-8780e68d9322 tempest-VolumesGetTest-735801655 None] Marking volume 9417e9b7-61f8-4e09-861c-1de9510ed37c as bootable. {{(pid=122683) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Feb 05 21:09:38.766280 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a6bb3b0-c50a-430b-be22-8780e68d9322 tempest-VolumesGetTest-735801655 None] Copying metadata from image e66a3a3b-d2f9-4d5d-8021-a6001dff419f to 9417e9b7-61f8-4e09-861c-1de9510ed37c. {{(pid=122683) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 05 21:09:38.767137 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a6bb3b0-c50a-430b-be22-8780e68d9322 tempest-VolumesGetTest-735801655 None] Creating volume glance metadata for volume 9417e9b7-61f8-4e09-861c-1de9510ed37c backed by image e66a3a3b-d2f9-4d5d-8021-a6001dff419f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=122683) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 05 21:09:38.943084 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-9db9ca01-bc89-435b-91a9-0684bf1e1750 tempest-VolumesCloneTest-1887525358 None] Volume volume-35445a36-a76c-48db-a9c5-3b58646c1e7b.deleted is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:09:38.944780 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-9db9ca01-bc89-435b-91a9-0684bf1e1750 tempest-VolumesCloneTest-1887525358 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:09:38.945197 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-9db9ca01-bc89-435b-91a9-0684bf1e1750 tempest-VolumesCloneTest-1887525358 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:09:38.989008 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-9db9ca01-bc89-435b-91a9-0684bf1e1750 tempest-VolumesCloneTest-1887525358 None] clone created successfully {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 05 21:09:38.989494 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.volume_utils [None req-9db9ca01-bc89-435b-91a9-0684bf1e1750 tempest-VolumesCloneTest-1887525358 None] Marking volume b77ec0fb-9a75-4cb1-b9ff-f93252481dea as bootable. {{(pid=122683) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Feb 05 21:09:39.001212 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-9db9ca01-bc89-435b-91a9-0684bf1e1750 tempest-VolumesCloneTest-1887525358 None] Copying metadata from source volume 153391ed-c44b-4e50-89c9-fc08651650ee to b77ec0fb-9a75-4cb1-b9ff-f93252481dea. {{(pid=122683) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:431}} Feb 05 21:09:39.032977 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-4a6bb3b0-c50a-430b-be22-8780e68d9322 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5414f55-32ec-4700-805d-50d9bb0892a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9417e9b7-61f8-4e09-861c-1de9510ed37c', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:39.037855 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-4a6bb3b0-c50a-430b-be22-8780e68d9322 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88837624-9032-490d-9d8e-3de4ae168018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:39.053934 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-4a6bb3b0-c50a-430b-be22-8780e68d9322 tempest-VolumesGetTest-735801655 None] Volume volume-9417e9b7-61f8-4e09-861c-1de9510ed37c (9417e9b7-61f8-4e09-861c-1de9510ed37c): created successfully Feb 05 21:09:39.058551 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-4a6bb3b0-c50a-430b-be22-8780e68d9322 tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88837624-9032-490d-9d8e-3de4ae168018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:39.065027 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-4a6bb3b0-c50a-430b-be22-8780e68d9322 tempest-VolumesGetTest-735801655 None] Flow 'volume_create_manager' (a9e78818-4765-426d-9fe6-3548140dc77e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:09:39.073386 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9db9ca01-bc89-435b-91a9-0684bf1e1750 tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d24f89e9-1e32-47c1-a7fd-e662d23859aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b77ec0fb-9a75-4cb1-b9ff-f93252481dea', 'volume_size': 1, 'source_volid': '153391ed-c44b-4e50-89c9-fc08651650ee', 'source_volstatus': 'available'}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:39.078493 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9db9ca01-bc89-435b-91a9-0684bf1e1750 tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b78b3d84-45c7-4152-9c7d-970855d06c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:39.088488 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-4a6bb3b0-c50a-430b-be22-8780e68d9322 tempest-VolumesGetTest-735801655 None] Created volume successfully. Feb 05 21:09:39.094061 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-9db9ca01-bc89-435b-91a9-0684bf1e1750 tempest-VolumesCloneTest-1887525358 None] Volume volume-b77ec0fb-9a75-4cb1-b9ff-f93252481dea (b77ec0fb-9a75-4cb1-b9ff-f93252481dea): created successfully Feb 05 21:09:39.099967 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9db9ca01-bc89-435b-91a9-0684bf1e1750 tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b78b3d84-45c7-4152-9c7d-970855d06c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:39.107189 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9db9ca01-bc89-435b-91a9-0684bf1e1750 tempest-VolumesCloneTest-1887525358 None] Flow 'volume_create_manager' (5751b298-74b3-4b2e-93b6-78e83fdb4eed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:09:39.125211 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-9db9ca01-bc89-435b-91a9-0684bf1e1750 tempest-VolumesCloneTest-1887525358 None] Created volume successfully. Feb 05 21:09:39.844483 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-72b76009-7811-4bbd-980d-8be531b78cad tempest-VolumesSnapshotTestJSON-1761633007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:09:39.856586 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-72b76009-7811-4bbd-980d-8be531b78cad tempest-VolumesSnapshotTestJSON-1761633007 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:09:39.857037 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-72b76009-7811-4bbd-980d-8be531b78cad tempest-VolumesSnapshotTestJSON-1761633007 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:09:39.898933 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-72b76009-7811-4bbd-980d-8be531b78cad tempest-VolumesSnapshotTestJSON-1761633007 None] Flow 'volume_create_manager' (dede8ddd-555b-4ffd-aa46-690e4a3a39bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:09:39.912666 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-72b76009-7811-4bbd-980d-8be531b78cad tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cf6e34c-08ed-41ee-9af8-80ece77a6a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:39.930620 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-72b76009-7811-4bbd-980d-8be531b78cad tempest-VolumesSnapshotTestJSON-1761633007 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:09:39.948209 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-72b76009-7811-4bbd-980d-8be531b78cad tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cf6e34c-08ed-41ee-9af8-80ece77a6a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-880918919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=419ad4d0-6b45-4fb7-9e6f-920b37e4a0ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c04615402925462792ca03f711db23c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:09:40Z,use_quota=True,user_id='6682477b172d460881a96d68f6bd053c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:39.959291 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-72b76009-7811-4bbd-980d-8be531b78cad tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55029940-43fe-4d44-86fc-82dc1ae2ea74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:39.964465 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-72b76009-7811-4bbd-980d-8be531b78cad tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55029940-43fe-4d44-86fc-82dc1ae2ea74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:39.971411 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-72b76009-7811-4bbd-980d-8be531b78cad tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8add61a5-3cba-4b89-8ed4-bc704d2b4d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:39.980112 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-72b76009-7811-4bbd-980d-8be531b78cad tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8add61a5-3cba-4b89-8ed4-bc704d2b4d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '419ad4d0-6b45-4fb7-9e6f-920b37e4a0ea', 'volume_name': 'volume-419ad4d0-6b45-4fb7-9e6f-920b37e4a0ea', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:39.986519 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-72b76009-7811-4bbd-980d-8be531b78cad tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba289103-210b-4cec-b7e5-33d93e0dbb71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:39.992140 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-72b76009-7811-4bbd-980d-8be531b78cad tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba289103-210b-4cec-b7e5-33d93e0dbb71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:39.997459 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-72b76009-7811-4bbd-980d-8be531b78cad tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (407898ae-ea64-4d4b-b45e-f0e772786490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:39.998571 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-72b76009-7811-4bbd-980d-8be531b78cad tempest-VolumesSnapshotTestJSON-1761633007 None] Volume 419ad4d0-6b45-4fb7-9e6f-920b37e4a0ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-419ad4d0-6b45-4fb7-9e6f-920b37e4a0ea', 'volume_size': 1} Feb 05 21:09:39.998971 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-72b76009-7811-4bbd-980d-8be531b78cad tempest-VolumesSnapshotTestJSON-1761633007 None] creating volume 'volume-419ad4d0-6b45-4fb7-9e6f-920b37e4a0ea' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:09:40.001364 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-72b76009-7811-4bbd-980d-8be531b78cad tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:40.144267 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-72b76009-7811-4bbd-980d-8be531b78cad tempest-VolumesSnapshotTestJSON-1761633007 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:09:40.145859 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-72b76009-7811-4bbd-980d-8be531b78cad tempest-VolumesSnapshotTestJSON-1761633007 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:09:40.150885 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-72b76009-7811-4bbd-980d-8be531b78cad tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (407898ae-ea64-4d4b-b45e-f0e772786490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-419ad4d0-6b45-4fb7-9e6f-920b37e4a0ea', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:40.157060 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-72b76009-7811-4bbd-980d-8be531b78cad tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c04ecb4-6648-42a0-9020-4bef40a2a4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:40.169624 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-72b76009-7811-4bbd-980d-8be531b78cad tempest-VolumesSnapshotTestJSON-1761633007 None] Volume volume-419ad4d0-6b45-4fb7-9e6f-920b37e4a0ea (419ad4d0-6b45-4fb7-9e6f-920b37e4a0ea): created successfully Feb 05 21:09:40.176747 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-72b76009-7811-4bbd-980d-8be531b78cad tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c04ecb4-6648-42a0-9020-4bef40a2a4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:40.186874 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-72b76009-7811-4bbd-980d-8be531b78cad tempest-VolumesSnapshotTestJSON-1761633007 None] Flow 'volume_create_manager' (dede8ddd-555b-4ffd-aa46-690e4a3a39bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:09:40.198748 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-72b76009-7811-4bbd-980d-8be531b78cad tempest-VolumesSnapshotTestJSON-1761633007 None] Created volume successfully. Feb 05 21:09:40.691508 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-56b219a4-f353-4376-bfff-3f9e1b12339d tempest-VolumesGetTest-735801655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:09:40.695215 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-56b219a4-f353-4376-bfff-3f9e1b12339d tempest-VolumesGetTest-735801655 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:09:40.695745 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-56b219a4-f353-4376-bfff-3f9e1b12339d tempest-VolumesGetTest-735801655 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:09:40.744622 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-56b219a4-f353-4376-bfff-3f9e1b12339d tempest-VolumesGetTest-735801655 None] Flow 'volume_create_manager' (483ad326-45bc-4d3d-b8c3-8e5dfcabf143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:09:40.753633 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-56b219a4-f353-4376-bfff-3f9e1b12339d tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b1160c1-9bf5-4a46-a966-7bde3e9a6535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:40.764582 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-56b219a4-f353-4376-bfff-3f9e1b12339d tempest-VolumesGetTest-735801655 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:09:40.784672 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-56b219a4-f353-4376-bfff-3f9e1b12339d tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b1160c1-9bf5-4a46-a966-7bde3e9a6535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:09:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-710507559',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6cfde4d9-8296-4315-8679-d6c60ce8bdcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e1ea1e3d3cf4f4d8f428013523eb54a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:09:41Z,use_quota=True,user_id='cf2bb6c5571949358e6dc70d77314ee7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:40.791679 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-56b219a4-f353-4376-bfff-3f9e1b12339d tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ad6450e-0d13-4cc6-9536-81ab9aa37d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:40.799531 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-56b219a4-f353-4376-bfff-3f9e1b12339d tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ad6450e-0d13-4cc6-9536-81ab9aa37d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:40.805948 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-56b219a4-f353-4376-bfff-3f9e1b12339d tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (222b9a8b-68c2-4878-8779-71d2d615d49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:40.816125 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-56b219a4-f353-4376-bfff-3f9e1b12339d tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (222b9a8b-68c2-4878-8779-71d2d615d49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cfde4d9-8296-4315-8679-d6c60ce8bdcd', 'volume_name': 'volume-6cfde4d9-8296-4315-8679-d6c60ce8bdcd', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:40.833144 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-56b219a4-f353-4376-bfff-3f9e1b12339d tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3477c18-8c9b-4634-9f7a-47accb1a67bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:40.848787 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-56b219a4-f353-4376-bfff-3f9e1b12339d tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3477c18-8c9b-4634-9f7a-47accb1a67bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:40.873298 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-56b219a4-f353-4376-bfff-3f9e1b12339d tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10b80c41-b8f5-41f9-b96a-ec5d45920ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:40.877414 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-56b219a4-f353-4376-bfff-3f9e1b12339d tempest-VolumesGetTest-735801655 None] Volume 6cfde4d9-8296-4315-8679-d6c60ce8bdcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cfde4d9-8296-4315-8679-d6c60ce8bdcd', 'volume_size': 1} Feb 05 21:09:40.877829 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-56b219a4-f353-4376-bfff-3f9e1b12339d tempest-VolumesGetTest-735801655 None] creating volume 'volume-6cfde4d9-8296-4315-8679-d6c60ce8bdcd' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:09:40.884204 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-56b219a4-f353-4376-bfff-3f9e1b12339d tempest-VolumesGetTest-735801655 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:41.001003 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-54998179-fca7-4b7c-a006-6ff410b0507f tempest-VolumesCloneTest-1887525358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:09:41.010157 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-54998179-fca7-4b7c-a006-6ff410b0507f tempest-VolumesCloneTest-1887525358 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:09:41.011202 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-54998179-fca7-4b7c-a006-6ff410b0507f tempest-VolumesCloneTest-1887525358 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:09:41.068395 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-54998179-fca7-4b7c-a006-6ff410b0507f tempest-VolumesCloneTest-1887525358 None] Flow 'volume_create_manager' (7a990669-7484-4911-b5e2-a101329e54e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:09:41.083039 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-54998179-fca7-4b7c-a006-6ff410b0507f tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d2f54f4-b52c-43cd-8181-67a78faba112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:41.092858 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-56b219a4-f353-4376-bfff-3f9e1b12339d tempest-VolumesGetTest-735801655 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:09:41.093662 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-56b219a4-f353-4376-bfff-3f9e1b12339d tempest-VolumesGetTest-735801655 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:09:41.100292 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-56b219a4-f353-4376-bfff-3f9e1b12339d tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10b80c41-b8f5-41f9-b96a-ec5d45920ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cfde4d9-8296-4315-8679-d6c60ce8bdcd', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:41.107062 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-56b219a4-f353-4376-bfff-3f9e1b12339d tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4689f34-a001-4e95-b118-ee15b35947a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:41.115375 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-54998179-fca7-4b7c-a006-6ff410b0507f tempest-VolumesCloneTest-1887525358 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:09:41.138937 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-54998179-fca7-4b7c-a006-6ff410b0507f tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d2f54f4-b52c-43cd-8181-67a78faba112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1221098890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=12daa7e1-67d5-47a2-8c61-05780f4dc56c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dc55288f6324f8498b16b48858426c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:09:41Z,use_quota=True,user_id='f1e6d8adae3644a59f75d546ac21920f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:41.144033 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-54998179-fca7-4b7c-a006-6ff410b0507f tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8939eef1-b4c3-4524-83d3-bc318c8b45d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:41.148961 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-54998179-fca7-4b7c-a006-6ff410b0507f tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8939eef1-b4c3-4524-83d3-bc318c8b45d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:41.155440 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-54998179-fca7-4b7c-a006-6ff410b0507f tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aedf471-fcc6-4501-a79c-80e56adcabe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:41.160326 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-54998179-fca7-4b7c-a006-6ff410b0507f tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aedf471-fcc6-4501-a79c-80e56adcabe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12daa7e1-67d5-47a2-8c61-05780f4dc56c', 'volume_name': 'volume-12daa7e1-67d5-47a2-8c61-05780f4dc56c', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:41.165352 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-54998179-fca7-4b7c-a006-6ff410b0507f tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5875dbf5-329e-4c19-ac65-0a2417a7b968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:41.170498 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-54998179-fca7-4b7c-a006-6ff410b0507f tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5875dbf5-329e-4c19-ac65-0a2417a7b968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:41.175569 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-54998179-fca7-4b7c-a006-6ff410b0507f tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2d78da3-2562-47fb-98a3-65ed0b4f745f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:41.176874 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-54998179-fca7-4b7c-a006-6ff410b0507f tempest-VolumesCloneTest-1887525358 None] Volume 12daa7e1-67d5-47a2-8c61-05780f4dc56c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12daa7e1-67d5-47a2-8c61-05780f4dc56c', 'volume_size': 1} Feb 05 21:09:41.177466 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-54998179-fca7-4b7c-a006-6ff410b0507f tempest-VolumesCloneTest-1887525358 None] creating volume 'volume-12daa7e1-67d5-47a2-8c61-05780f4dc56c' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:09:41.179552 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-54998179-fca7-4b7c-a006-6ff410b0507f tempest-VolumesCloneTest-1887525358 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:41.229973 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-56b219a4-f353-4376-bfff-3f9e1b12339d tempest-VolumesGetTest-735801655 None] Volume volume-6cfde4d9-8296-4315-8679-d6c60ce8bdcd (6cfde4d9-8296-4315-8679-d6c60ce8bdcd): created successfully Feb 05 21:09:41.234333 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-56b219a4-f353-4376-bfff-3f9e1b12339d tempest-VolumesGetTest-735801655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4689f34-a001-4e95-b118-ee15b35947a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:41.243982 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-56b219a4-f353-4376-bfff-3f9e1b12339d tempest-VolumesGetTest-735801655 None] Flow 'volume_create_manager' (483ad326-45bc-4d3d-b8c3-8e5dfcabf143) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:09:41.260417 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-56b219a4-f353-4376-bfff-3f9e1b12339d tempest-VolumesGetTest-735801655 None] Created volume successfully. Feb 05 21:09:41.312457 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-54998179-fca7-4b7c-a006-6ff410b0507f tempest-VolumesCloneTest-1887525358 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:09:41.313747 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-54998179-fca7-4b7c-a006-6ff410b0507f tempest-VolumesCloneTest-1887525358 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:09:41.320034 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-54998179-fca7-4b7c-a006-6ff410b0507f tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2d78da3-2562-47fb-98a3-65ed0b4f745f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12daa7e1-67d5-47a2-8c61-05780f4dc56c', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:41.333051 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-54998179-fca7-4b7c-a006-6ff410b0507f tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a013a07-31d4-4065-b271-27e7d0566815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:41.359103 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-54998179-fca7-4b7c-a006-6ff410b0507f tempest-VolumesCloneTest-1887525358 None] Volume volume-12daa7e1-67d5-47a2-8c61-05780f4dc56c (12daa7e1-67d5-47a2-8c61-05780f4dc56c): created successfully Feb 05 21:09:41.364401 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-54998179-fca7-4b7c-a006-6ff410b0507f tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a013a07-31d4-4065-b271-27e7d0566815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:41.372973 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-54998179-fca7-4b7c-a006-6ff410b0507f tempest-VolumesCloneTest-1887525358 None] Flow 'volume_create_manager' (7a990669-7484-4911-b5e2-a101329e54e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:09:41.396104 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ae689e4f-9236-4e38-9f17-71040fe5cec8 tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:41.461702 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-54998179-fca7-4b7c-a006-6ff410b0507f tempest-VolumesCloneTest-1887525358 None] Created volume successfully. Feb 05 21:09:41.480693 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fd8ee50-00cc-4e6f-9ae6-e1ef4f352550 tempest-ServersNegativeTestJSON-1381166818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:09:41.486938 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-1fd8ee50-00cc-4e6f-9ae6-e1ef4f352550 tempest-ServersNegativeTestJSON-1381166818 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:09:41.487384 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-1fd8ee50-00cc-4e6f-9ae6-e1ef4f352550 tempest-ServersNegativeTestJSON-1381166818 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:09:41.511174 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1fd8ee50-00cc-4e6f-9ae6-e1ef4f352550 tempest-ServersNegativeTestJSON-1381166818 None] Flow 'volume_create_manager' (f559d4d5-4d52-4faf-83e1-2de849672182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:09:41.522902 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1fd8ee50-00cc-4e6f-9ae6-e1ef4f352550 tempest-ServersNegativeTestJSON-1381166818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7ee26c8-cdaa-483a-9af7-2f4bdca8564c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:41.531158 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-1fd8ee50-00cc-4e6f-9ae6-e1ef4f352550 tempest-ServersNegativeTestJSON-1381166818 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:09:41.548238 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1fd8ee50-00cc-4e6f-9ae6-e1ef4f352550 tempest-ServersNegativeTestJSON-1381166818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7ee26c8-cdaa-483a-9af7-2f4bdca8564c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1808851537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0d6a4521-f825-4fa5-a5e5-626cee2ec7f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc0a1e1d985c4b0eb031dcc2cbe83f90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:09:41Z,use_quota=True,user_id='1df1cffc98074e0baf4c31f2e79b3ac5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:41.554754 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1fd8ee50-00cc-4e6f-9ae6-e1ef4f352550 tempest-ServersNegativeTestJSON-1381166818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4403720c-59a0-4b5c-9240-862d0efeb1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:41.560375 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1fd8ee50-00cc-4e6f-9ae6-e1ef4f352550 tempest-ServersNegativeTestJSON-1381166818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4403720c-59a0-4b5c-9240-862d0efeb1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:41.566205 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1fd8ee50-00cc-4e6f-9ae6-e1ef4f352550 tempest-ServersNegativeTestJSON-1381166818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (713e3ce1-c04d-4488-a5ff-2d1b5851a2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:41.571342 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1fd8ee50-00cc-4e6f-9ae6-e1ef4f352550 tempest-ServersNegativeTestJSON-1381166818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (713e3ce1-c04d-4488-a5ff-2d1b5851a2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d6a4521-f825-4fa5-a5e5-626cee2ec7f8', 'volume_name': 'volume-0d6a4521-f825-4fa5-a5e5-626cee2ec7f8', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:41.577057 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1fd8ee50-00cc-4e6f-9ae6-e1ef4f352550 tempest-ServersNegativeTestJSON-1381166818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (686b6bb5-813f-4492-bb39-bcb49d5372b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:41.584181 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1fd8ee50-00cc-4e6f-9ae6-e1ef4f352550 tempest-ServersNegativeTestJSON-1381166818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (686b6bb5-813f-4492-bb39-bcb49d5372b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:41.591744 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1fd8ee50-00cc-4e6f-9ae6-e1ef4f352550 tempest-ServersNegativeTestJSON-1381166818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35af8cb3-d474-48ef-b4ea-6a3dc853b317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:41.593361 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-1fd8ee50-00cc-4e6f-9ae6-e1ef4f352550 tempest-ServersNegativeTestJSON-1381166818 None] Volume 0d6a4521-f825-4fa5-a5e5-626cee2ec7f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d6a4521-f825-4fa5-a5e5-626cee2ec7f8', 'volume_size': 1} Feb 05 21:09:41.593893 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1fd8ee50-00cc-4e6f-9ae6-e1ef4f352550 tempest-ServersNegativeTestJSON-1381166818 None] creating volume 'volume-0d6a4521-f825-4fa5-a5e5-626cee2ec7f8' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:09:41.595221 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1fd8ee50-00cc-4e6f-9ae6-e1ef4f352550 tempest-ServersNegativeTestJSON-1381166818 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:41.677840 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1fd8ee50-00cc-4e6f-9ae6-e1ef4f352550 tempest-ServersNegativeTestJSON-1381166818 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:09:41.678268 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1fd8ee50-00cc-4e6f-9ae6-e1ef4f352550 tempest-ServersNegativeTestJSON-1381166818 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:09:41.684644 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1fd8ee50-00cc-4e6f-9ae6-e1ef4f352550 tempest-ServersNegativeTestJSON-1381166818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35af8cb3-d474-48ef-b4ea-6a3dc853b317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d6a4521-f825-4fa5-a5e5-626cee2ec7f8', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:41.689736 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1fd8ee50-00cc-4e6f-9ae6-e1ef4f352550 tempest-ServersNegativeTestJSON-1381166818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f18103f-2be1-43c6-986b-6d33768040c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:41.700756 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-1fd8ee50-00cc-4e6f-9ae6-e1ef4f352550 tempest-ServersNegativeTestJSON-1381166818 None] Volume volume-0d6a4521-f825-4fa5-a5e5-626cee2ec7f8 (0d6a4521-f825-4fa5-a5e5-626cee2ec7f8): created successfully Feb 05 21:09:41.705168 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1fd8ee50-00cc-4e6f-9ae6-e1ef4f352550 tempest-ServersNegativeTestJSON-1381166818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f18103f-2be1-43c6-986b-6d33768040c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:41.711858 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1fd8ee50-00cc-4e6f-9ae6-e1ef4f352550 tempest-ServersNegativeTestJSON-1381166818 None] Flow 'volume_create_manager' (f559d4d5-4d52-4faf-83e1-2de849672182) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:09:41.725112 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-1fd8ee50-00cc-4e6f-9ae6-e1ef4f352550 tempest-ServersNegativeTestJSON-1381166818 None] Created volume successfully. Feb 05 21:09:41.924653 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-12b92dc2-45c0-4faf-8b94-994f93163615 tempest-VolumesGetTest-735801655 None] Lock "b'cinder-6cfde4d9-8296-4315-8679-d6c60ce8bdcd-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:09:42.007777 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-12b92dc2-45c0-4faf-8b94-994f93163615 tempest-VolumesGetTest-735801655 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:42.090795 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-12b92dc2-45c0-4faf-8b94-994f93163615 tempest-VolumesGetTest-735801655 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:09:42.091221 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-12b92dc2-45c0-4faf-8b94-994f93163615 tempest-VolumesGetTest-735801655 None] Volume volume-6cfde4d9-8296-4315-8679-d6c60ce8bdcd is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:09:42.107287 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-12b92dc2-45c0-4faf-8b94-994f93163615 tempest-VolumesGetTest-735801655 None] deleting rbd volume volume-6cfde4d9-8296-4315-8679-d6c60ce8bdcd {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:09:42.453554 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-ae689e4f-9236-4e38-9f17-71040fe5cec8 tempest-VolumesSnapshotTestJSON-1761633007 None] Create snapshot completed successfully Feb 05 21:09:42.693762 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f5d86a1-29fa-4699-8db4-2cc1b8c68427 tempest-VolumesCloneTest-1887525358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:09:42.700419 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-3f5d86a1-29fa-4699-8db4-2cc1b8c68427 tempest-VolumesCloneTest-1887525358 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:09:42.700851 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-3f5d86a1-29fa-4699-8db4-2cc1b8c68427 tempest-VolumesCloneTest-1887525358 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:09:42.750679 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3f5d86a1-29fa-4699-8db4-2cc1b8c68427 tempest-VolumesCloneTest-1887525358 None] Flow 'volume_create_manager' (a722845c-98bc-4880-a771-4121706931cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:09:42.765509 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3f5d86a1-29fa-4699-8db4-2cc1b8c68427 tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71375cba-1dbc-41aa-898f-3ab8783086e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:42.780697 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-3f5d86a1-29fa-4699-8db4-2cc1b8c68427 tempest-VolumesCloneTest-1887525358 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:09:42.850509 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3f5d86a1-29fa-4699-8db4-2cc1b8c68427 tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71375cba-1dbc-41aa-898f-3ab8783086e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1255310427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=be3eead9-a8f6-414e-be8a-ed6afd5df1f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dc55288f6324f8498b16b48858426c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:09:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=12daa7e1-67d5-47a2-8c61-05780f4dc56c,status='creating',terminated_at=None,updated_at=2022-02-05T21:09:43Z,use_quota=True,user_id='f1e6d8adae3644a59f75d546ac21920f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:42.867101 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3f5d86a1-29fa-4699-8db4-2cc1b8c68427 tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2a51a60-ad3b-45b6-a2d7-50960056f85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:42.880628 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3f5d86a1-29fa-4699-8db4-2cc1b8c68427 tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2a51a60-ad3b-45b6-a2d7-50960056f85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:42.889755 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3f5d86a1-29fa-4699-8db4-2cc1b8c68427 tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e58bd5a0-4aaf-48ea-89dd-ea8b6d8f8e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:42.948826 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3f5d86a1-29fa-4699-8db4-2cc1b8c68427 tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e58bd5a0-4aaf-48ea-89dd-ea8b6d8f8e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'be3eead9-a8f6-414e-be8a-ed6afd5df1f0', 'volume_name': 'volume-be3eead9-a8f6-414e-be8a-ed6afd5df1f0', 'volume_size': 2, 'source_volid': '12daa7e1-67d5-47a2-8c61-05780f4dc56c', 'source_volstatus': 'available'}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:42.956559 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3f5d86a1-29fa-4699-8db4-2cc1b8c68427 tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15e77c61-aa8c-4d71-b3e9-160dfac87088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:42.961397 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3f5d86a1-29fa-4699-8db4-2cc1b8c68427 tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15e77c61-aa8c-4d71-b3e9-160dfac87088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:42.967940 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3f5d86a1-29fa-4699-8db4-2cc1b8c68427 tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71c6b02b-53ef-44b5-8460-ce83e2d847b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:42.969557 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-3f5d86a1-29fa-4699-8db4-2cc1b8c68427 tempest-VolumesCloneTest-1887525358 None] Volume be3eead9-a8f6-414e-be8a-ed6afd5df1f0: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-be3eead9-a8f6-414e-be8a-ed6afd5df1f0', 'volume_size': 2, 'source_volid': '12daa7e1-67d5-47a2-8c61-05780f4dc56c', 'source_volstatus': 'available'} Feb 05 21:09:42.987395 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3f5d86a1-29fa-4699-8db4-2cc1b8c68427 tempest-VolumesCloneTest-1887525358 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:43.053152 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3f5d86a1-29fa-4699-8db4-2cc1b8c68427 tempest-VolumesCloneTest-1887525358 None] creating snapshot='volume-be3eead9-a8f6-414e-be8a-ed6afd5df1f0.clone_snap' {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 05 21:09:43.381398 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3f5d86a1-29fa-4699-8db4-2cc1b8c68427 tempest-VolumesCloneTest-1887525358 None] cloning 'volume-12daa7e1-67d5-47a2-8c61-05780f4dc56c@volume-be3eead9-a8f6-414e-be8a-ed6afd5df1f0.clone_snap' to 'volume-be3eead9-a8f6-414e-be8a-ed6afd5df1f0' {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 05 21:09:43.429755 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-12b92dc2-45c0-4faf-8b94-994f93163615 tempest-VolumesGetTest-735801655 None] Created reservations ['78a21cfc-ab42-40dd-9e10-2a1a732cd708', '7b6f303e-19ee-4c57-a35c-3c677324f0dd', '47cd74a8-8c75-44bb-8499-9ad7cc4f641f', '0696d70f-511b-4f9e-8b99-d19d136dcb66'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:09:43.600802 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-12b92dc2-45c0-4faf-8b94-994f93163615 tempest-VolumesGetTest-735801655 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:43.675668 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-12b92dc2-45c0-4faf-8b94-994f93163615 tempest-VolumesGetTest-735801655 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:43.707344 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-12b92dc2-45c0-4faf-8b94-994f93163615 tempest-VolumesGetTest-735801655 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:09:43.727051 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3f5d86a1-29fa-4699-8db4-2cc1b8c68427 tempest-VolumesCloneTest-1887525358 None] Volume volume-12daa7e1-67d5-47a2-8c61-05780f4dc56c is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:09:43.733056 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3f5d86a1-29fa-4699-8db4-2cc1b8c68427 tempest-VolumesCloneTest-1887525358 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:09:43.734818 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3f5d86a1-29fa-4699-8db4-2cc1b8c68427 tempest-VolumesCloneTest-1887525358 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:09:43.782544 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3f5d86a1-29fa-4699-8db4-2cc1b8c68427 tempest-VolumesCloneTest-1887525358 None] resize volume 'volume-be3eead9-a8f6-414e-be8a-ed6afd5df1f0' from 1 to 2 {{(pid=122683) _extend_if_required /opt/stack/cinder/cinder/volume/drivers/rbd.py:694}} Feb 05 21:09:43.783114 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3f5d86a1-29fa-4699-8db4-2cc1b8c68427 tempest-VolumesCloneTest-1887525358 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:43.881686 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-12b92dc2-45c0-4faf-8b94-994f93163615 tempest-VolumesGetTest-735801655 None] Deleted volume successfully. Feb 05 21:09:43.929645 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.driver [None req-f3029c8c-7abd-4edc-aa8b-2d3925d8a748 tempest-VolumesSnapshotTestJSON-1761633007 None] Creating a new backup for volume volume-419ad4d0-6b45-4fb7-9e6f-920b37e4a0ea. {{(pid=122683) _get_backup_volume_temp_volume /opt/stack/cinder/cinder/volume/driver.py:1226}} Feb 05 21:09:43.948047 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-12b92dc2-45c0-4faf-8b94-994f93163615 tempest-VolumesGetTest-735801655 None] Lock "b'cinder-6cfde4d9-8296-4315-8679-d6c60ce8bdcd-delete_volume'" released by "delete_volume" :: held 2.024s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:09:43.987325 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-f3029c8c-7abd-4edc-aa8b-2d3925d8a748 tempest-VolumesSnapshotTestJSON-1761633007 None] cloning volumes/volume-419ad4d0-6b45-4fb7-9e6f-920b37e4a0ea@snapshot-37619e5a-7495-43b1-bc07-3cb25b99c0bd to volume-baa93d66-524e-4edc-addd-c5c2d6b460a4 {{(pid=122683) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Feb 05 21:09:43.988340 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-f3029c8c-7abd-4edc-aa8b-2d3925d8a748 tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:44.068826 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-f3029c8c-7abd-4edc-aa8b-2d3925d8a748 tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:44.170401 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3f5d86a1-29fa-4699-8db4-2cc1b8c68427 tempest-VolumesCloneTest-1887525358 None] clone created successfully {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 05 21:09:44.175646 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3f5d86a1-29fa-4699-8db4-2cc1b8c68427 tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71c6b02b-53ef-44b5-8460-ce83e2d847b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be3eead9-a8f6-414e-be8a-ed6afd5df1f0', 'volume_size': 2, 'source_volid': '12daa7e1-67d5-47a2-8c61-05780f4dc56c', 'source_volstatus': 'available'}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:44.181453 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3f5d86a1-29fa-4699-8db4-2cc1b8c68427 tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9937f1ef-175a-4914-a559-4147172422cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:44.193227 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-3f5d86a1-29fa-4699-8db4-2cc1b8c68427 tempest-VolumesCloneTest-1887525358 None] Volume volume-be3eead9-a8f6-414e-be8a-ed6afd5df1f0 (be3eead9-a8f6-414e-be8a-ed6afd5df1f0): created successfully Feb 05 21:09:44.200869 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3f5d86a1-29fa-4699-8db4-2cc1b8c68427 tempest-VolumesCloneTest-1887525358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9937f1ef-175a-4914-a559-4147172422cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:44.232509 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3f5d86a1-29fa-4699-8db4-2cc1b8c68427 tempest-VolumesCloneTest-1887525358 None] Flow 'volume_create_manager' (a722845c-98bc-4880-a771-4121706931cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:09:44.249798 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-3f5d86a1-29fa-4699-8db4-2cc1b8c68427 tempest-VolumesCloneTest-1887525358 None] Created volume successfully. Feb 05 21:09:44.312475 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-f3029c8c-7abd-4edc-aa8b-2d3925d8a748 tempest-VolumesSnapshotTestJSON-1761633007 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:09:44.313691 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-f3029c8c-7abd-4edc-aa8b-2d3925d8a748 tempest-VolumesSnapshotTestJSON-1761633007 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:09:44.363853 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-6a840f80-6612-44e1-a8cd-71aafee38caa tempest-VolumesGetTest-735801655 None] Lock "b'cinder-9417e9b7-61f8-4e09-861c-1de9510ed37c-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:09:44.373187 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-78d3b1ab-cc1f-43d6-baa4-f593b5a11893 tempest-ServersNegativeTestJSON-1381166818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:09:44.376881 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-78d3b1ab-cc1f-43d6-baa4-f593b5a11893 tempest-ServersNegativeTestJSON-1381166818 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:09:44.377394 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-78d3b1ab-cc1f-43d6-baa4-f593b5a11893 tempest-ServersNegativeTestJSON-1381166818 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:09:44.399981 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-78d3b1ab-cc1f-43d6-baa4-f593b5a11893 tempest-ServersNegativeTestJSON-1381166818 None] Flow 'volume_create_manager' (d1ffb4a2-ccda-457f-bb12-8c9a9f5c68df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:09:44.408244 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-78d3b1ab-cc1f-43d6-baa4-f593b5a11893 tempest-ServersNegativeTestJSON-1381166818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (644ec02d-9ed2-4d9f-8423-481341f0f497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:44.418103 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-f3029c8c-7abd-4edc-aa8b-2d3925d8a748 tempest-VolumesSnapshotTestJSON-1761633007 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-02-05T21:09:43Z,data_timestamp=2022-02-05T21:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Backup-1074229487',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=9f4e66ef-8f16-49c7-9500-076004f0014d,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='c04615402925462792ca03f711db23c1',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id='37619e5a-7495-43b1-bc07-3cb25b99c0bd',status='creating',temp_snapshot_id=None,temp_volume_id='baa93d66-524e-4edc-addd-c5c2d6b460a4',updated_at=None,user_id='6682477b172d460881a96d68f6bd053c',volume_id=419ad4d0-6b45-4fb7-9e6f-920b37e4a0ea) Feb 05 21:09:44.418872 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.backup.rpcapi [None req-f3029c8c-7abd-4edc-aa8b-2d3925d8a748 tempest-VolumesSnapshotTestJSON-1761633007 None] continue_backup in rpcapi backup_id 9f4e66ef-8f16-49c7-9500-076004f0014d {{(pid=122683) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Feb 05 21:09:44.431846 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-78d3b1ab-cc1f-43d6-baa4-f593b5a11893 tempest-ServersNegativeTestJSON-1381166818 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:09:44.452122 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-78d3b1ab-cc1f-43d6-baa4-f593b5a11893 tempest-ServersNegativeTestJSON-1381166818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (644ec02d-9ed2-4d9f-8423-481341f0f497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-580326440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c46c46c9-4865-463e-b891-4cf43955ae33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc0a1e1d985c4b0eb031dcc2cbe83f90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:09:44Z,use_quota=True,user_id='1df1cffc98074e0baf4c31f2e79b3ac5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:44.458229 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-78d3b1ab-cc1f-43d6-baa4-f593b5a11893 tempest-ServersNegativeTestJSON-1381166818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c81fea04-3148-42d5-8d8d-ce52cb513829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:44.465462 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-78d3b1ab-cc1f-43d6-baa4-f593b5a11893 tempest-ServersNegativeTestJSON-1381166818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c81fea04-3148-42d5-8d8d-ce52cb513829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:44.471739 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-78d3b1ab-cc1f-43d6-baa4-f593b5a11893 tempest-ServersNegativeTestJSON-1381166818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b548a9-acef-47c6-82e6-27ae8c038e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:44.476558 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-78d3b1ab-cc1f-43d6-baa4-f593b5a11893 tempest-ServersNegativeTestJSON-1381166818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b548a9-acef-47c6-82e6-27ae8c038e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c46c46c9-4865-463e-b891-4cf43955ae33', 'volume_name': 'volume-c46c46c9-4865-463e-b891-4cf43955ae33', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:44.482690 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-78d3b1ab-cc1f-43d6-baa4-f593b5a11893 tempest-ServersNegativeTestJSON-1381166818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91673b79-1833-4427-88e2-615c9e0dfc95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:44.487194 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-78d3b1ab-cc1f-43d6-baa4-f593b5a11893 tempest-ServersNegativeTestJSON-1381166818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91673b79-1833-4427-88e2-615c9e0dfc95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:44.492310 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-78d3b1ab-cc1f-43d6-baa4-f593b5a11893 tempest-ServersNegativeTestJSON-1381166818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f919bb90-e7fb-49d2-8373-5d88608cb25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:44.493456 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-78d3b1ab-cc1f-43d6-baa4-f593b5a11893 tempest-ServersNegativeTestJSON-1381166818 None] Volume c46c46c9-4865-463e-b891-4cf43955ae33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c46c46c9-4865-463e-b891-4cf43955ae33', 'volume_size': 1} Feb 05 21:09:44.493857 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-78d3b1ab-cc1f-43d6-baa4-f593b5a11893 tempest-ServersNegativeTestJSON-1381166818 None] creating volume 'volume-c46c46c9-4865-463e-b891-4cf43955ae33' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:09:44.497369 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-78d3b1ab-cc1f-43d6-baa4-f593b5a11893 tempest-ServersNegativeTestJSON-1381166818 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:44.597821 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6a840f80-6612-44e1-a8cd-71aafee38caa tempest-VolumesGetTest-735801655 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:44.728199 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6a840f80-6612-44e1-a8cd-71aafee38caa tempest-VolumesGetTest-735801655 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:09:44.746472 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6a840f80-6612-44e1-a8cd-71aafee38caa tempest-VolumesGetTest-735801655 None] deleting rbd volume volume-9417e9b7-61f8-4e09-861c-1de9510ed37c {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:09:44.756224 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-78d3b1ab-cc1f-43d6-baa4-f593b5a11893 tempest-ServersNegativeTestJSON-1381166818 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:09:44.756608 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-78d3b1ab-cc1f-43d6-baa4-f593b5a11893 tempest-ServersNegativeTestJSON-1381166818 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:09:44.766797 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-78d3b1ab-cc1f-43d6-baa4-f593b5a11893 tempest-ServersNegativeTestJSON-1381166818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f919bb90-e7fb-49d2-8373-5d88608cb25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c46c46c9-4865-463e-b891-4cf43955ae33', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:44.789524 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-78d3b1ab-cc1f-43d6-baa4-f593b5a11893 tempest-ServersNegativeTestJSON-1381166818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (258867b3-2df0-4127-8d7b-bd2665ce2f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:09:44.811154 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [None req-f3029c8c-7abd-4edc-aa8b-2d3925d8a748 tempest-VolumesSnapshotTestJSON-1761633007 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 21:09:44.882188 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-78d3b1ab-cc1f-43d6-baa4-f593b5a11893 tempest-ServersNegativeTestJSON-1381166818 None] Volume volume-c46c46c9-4865-463e-b891-4cf43955ae33 (c46c46c9-4865-463e-b891-4cf43955ae33): created successfully Feb 05 21:09:44.899615 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-78d3b1ab-cc1f-43d6-baa4-f593b5a11893 tempest-ServersNegativeTestJSON-1381166818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (258867b3-2df0-4127-8d7b-bd2665ce2f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:09:44.929412 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-78d3b1ab-cc1f-43d6-baa4-f593b5a11893 tempest-ServersNegativeTestJSON-1381166818 None] Flow 'volume_create_manager' (d1ffb4a2-ccda-457f-bb12-8c9a9f5c68df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:09:44.977292 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-78d3b1ab-cc1f-43d6-baa4-f593b5a11893 tempest-ServersNegativeTestJSON-1381166818 None] Created volume successfully. Feb 05 21:09:45.037396 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-091a09ba-c602-48f9-8664-2af570b94926 tempest-VolumesCloneTest-1887525358 None] Lock "b'cinder-be3eead9-a8f6-414e-be8a-ed6afd5df1f0-delete_volume'" acquired by "delete_volume" :: waited 0.028s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:09:45.092754 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-091a09ba-c602-48f9-8664-2af570b94926 tempest-VolumesCloneTest-1887525358 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:45.197088 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-091a09ba-c602-48f9-8664-2af570b94926 tempest-VolumesCloneTest-1887525358 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:09:45.207228 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-091a09ba-c602-48f9-8664-2af570b94926 tempest-VolumesCloneTest-1887525358 None] deleting rbd volume volume-be3eead9-a8f6-414e-be8a-ed6afd5df1f0 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:09:45.214324 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6a840f80-6612-44e1-a8cd-71aafee38caa tempest-VolumesGetTest-735801655 None] volume is a clone so cleaning references {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 05 21:09:45.273623 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6a840f80-6612-44e1-a8cd-71aafee38caa tempest-VolumesGetTest-735801655 None] deleting parent snapshot volume-9417e9b7-61f8-4e09-861c-1de9510ed37c.clone_snap {{(pid=122683) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 05 21:09:46.368785 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-091a09ba-c602-48f9-8664-2af570b94926 tempest-VolumesCloneTest-1887525358 None] volume is a clone so cleaning references {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 05 21:09:46.401022 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-091a09ba-c602-48f9-8664-2af570b94926 tempest-VolumesCloneTest-1887525358 None] Volume volume-12daa7e1-67d5-47a2-8c61-05780f4dc56c is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:09:46.401593 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-091a09ba-c602-48f9-8664-2af570b94926 tempest-VolumesCloneTest-1887525358 None] deleting parent snapshot volume-be3eead9-a8f6-414e-be8a-ed6afd5df1f0.clone_snap {{(pid=122683) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 05 21:09:47.399388 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [None req-f3029c8c-7abd-4edc-aa8b-2d3925d8a748 tempest-VolumesSnapshotTestJSON-1761633007 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 2.592s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 21:09:47.403828 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-f3029c8c-7abd-4edc-aa8b-2d3925d8a748 tempest-VolumesSnapshotTestJSON-1761633007 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-baa93d66-524e-4edc-addd-c5c2d6b460a4', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': 'baa93d66-524e-4edc-addd-c5c2d6b460a4', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 21:09:47.457637 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-f3029c8c-7abd-4edc-aa8b-2d3925d8a748 tempest-VolumesSnapshotTestJSON-1761633007 None] Initialize volume connection completed successfully. Feb 05 21:09:47.484675 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-6a840f80-6612-44e1-a8cd-71aafee38caa tempest-VolumesGetTest-735801655 None] Created reservations ['72a066d1-a324-4159-849d-1dcc93681f62', 'b4fd1e2c-df2a-408a-9386-d3492c686655', '708696cb-305b-4649-8d49-dff05af2c001', 'f4fb93a5-82d9-421d-b4eb-54951e4d6b02'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:09:47.489552 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-091a09ba-c602-48f9-8664-2af570b94926 tempest-VolumesCloneTest-1887525358 None] Created reservations ['9f42f6b4-3261-43dc-8ced-aa60ea936c63', 'dd1e445b-3557-4cbc-b8df-1f2f4a33f968', '7b766afa-8bda-4bee-a385-511dd678f3f0', '5db97a9d-75fe-4f60-9b31-11541f442ace'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:09:47.575050 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6a840f80-6612-44e1-a8cd-71aafee38caa tempest-VolumesGetTest-735801655 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:47.648636 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6a840f80-6612-44e1-a8cd-71aafee38caa tempest-VolumesGetTest-735801655 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:47.720358 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6a840f80-6612-44e1-a8cd-71aafee38caa tempest-VolumesGetTest-735801655 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:09:47.768741 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-091a09ba-c602-48f9-8664-2af570b94926 tempest-VolumesCloneTest-1887525358 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:47.836171 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-091a09ba-c602-48f9-8664-2af570b94926 tempest-VolumesCloneTest-1887525358 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:47.905996 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-091a09ba-c602-48f9-8664-2af570b94926 tempest-VolumesCloneTest-1887525358 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:09:47.910801 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-9fbe5082-c7d8-4276-9d1a-ebbfc4ef28a7 tempest-VolumesGetTest-735801655 None] Lock "b'cinder-41ff1200-c5de-4d9b-b166-3cea9fc03a3a-delete_volume'" acquired by "delete_volume" :: waited 0.173s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:09:47.913490 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-6a840f80-6612-44e1-a8cd-71aafee38caa tempest-VolumesGetTest-735801655 None] Deleted volume successfully. Feb 05 21:09:47.989904 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-6a840f80-6612-44e1-a8cd-71aafee38caa tempest-VolumesGetTest-735801655 None] Lock "b'cinder-9417e9b7-61f8-4e09-861c-1de9510ed37c-delete_volume'" released by "delete_volume" :: held 3.625s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:09:48.004173 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-091a09ba-c602-48f9-8664-2af570b94926 tempest-VolumesCloneTest-1887525358 None] Deleted volume successfully. Feb 05 21:09:48.056905 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-091a09ba-c602-48f9-8664-2af570b94926 tempest-VolumesCloneTest-1887525358 None] Lock "b'cinder-be3eead9-a8f6-414e-be8a-ed6afd5df1f0-delete_volume'" released by "delete_volume" :: held 3.019s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:09:48.061117 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-9fbe5082-c7d8-4276-9d1a-ebbfc4ef28a7 tempest-VolumesGetTest-735801655 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:48.154528 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-9fbe5082-c7d8-4276-9d1a-ebbfc4ef28a7 tempest-VolumesGetTest-735801655 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:09:48.155472 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-9fbe5082-c7d8-4276-9d1a-ebbfc4ef28a7 tempest-VolumesGetTest-735801655 None] Volume volume-41ff1200-c5de-4d9b-b166-3cea9fc03a3a is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:09:48.166079 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-9fbe5082-c7d8-4276-9d1a-ebbfc4ef28a7 tempest-VolumesGetTest-735801655 None] deleting rbd volume volume-41ff1200-c5de-4d9b-b166-3cea9fc03a3a {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:09:48.308326 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-38b98a3e-c7b2-4b75-8d53-0090c0e58b48 tempest-VolumesCloneTest-1887525358 None] Lock "b'cinder-12daa7e1-67d5-47a2-8c61-05780f4dc56c-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:09:48.389902 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-38b98a3e-c7b2-4b75-8d53-0090c0e58b48 tempest-VolumesCloneTest-1887525358 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:48.484155 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-38b98a3e-c7b2-4b75-8d53-0090c0e58b48 tempest-VolumesCloneTest-1887525358 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:09:48.484877 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-38b98a3e-c7b2-4b75-8d53-0090c0e58b48 tempest-VolumesCloneTest-1887525358 None] Volume volume-12daa7e1-67d5-47a2-8c61-05780f4dc56c is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:09:48.521735 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-38b98a3e-c7b2-4b75-8d53-0090c0e58b48 tempest-VolumesCloneTest-1887525358 None] deleting rbd volume volume-12daa7e1-67d5-47a2-8c61-05780f4dc56c {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:09:49.194685 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-9fbe5082-c7d8-4276-9d1a-ebbfc4ef28a7 tempest-VolumesGetTest-735801655 None] Created reservations ['0ed95621-dafe-4127-aa29-b29e51151ea8', '78d2f124-b088-4e79-9b1d-2727de45b039', '1f742b6b-fc75-43f8-8b8b-c64fdf479bfb', 'd3f5e3de-69ce-4104-950b-177fd4b784a9'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:09:49.273930 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-9fbe5082-c7d8-4276-9d1a-ebbfc4ef28a7 tempest-VolumesGetTest-735801655 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:49.343869 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-9fbe5082-c7d8-4276-9d1a-ebbfc4ef28a7 tempest-VolumesGetTest-735801655 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:49.406500 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-9fbe5082-c7d8-4276-9d1a-ebbfc4ef28a7 tempest-VolumesGetTest-735801655 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:09:49.413731 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-9fbe5082-c7d8-4276-9d1a-ebbfc4ef28a7 tempest-VolumesGetTest-735801655 None] Deleted volume successfully. Feb 05 21:09:49.441887 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-9fbe5082-c7d8-4276-9d1a-ebbfc4ef28a7 tempest-VolumesGetTest-735801655 None] Lock "b'cinder-41ff1200-c5de-4d9b-b166-3cea9fc03a3a-delete_volume'" released by "delete_volume" :: held 1.531s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:09:49.531958 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-38b98a3e-c7b2-4b75-8d53-0090c0e58b48 tempest-VolumesCloneTest-1887525358 None] Created reservations ['292dc573-0765-44df-a6bb-368cc2191be3', '459bf95e-7902-4b75-917c-bdd11e76e893', '22e787a4-de64-491d-b5d8-c74307523bb9', '88d7d469-747e-4944-96d1-cf8647a8edda'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:09:49.589473 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-38b98a3e-c7b2-4b75-8d53-0090c0e58b48 tempest-VolumesCloneTest-1887525358 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:49.646271 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-38b98a3e-c7b2-4b75-8d53-0090c0e58b48 tempest-VolumesCloneTest-1887525358 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:49.702768 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-38b98a3e-c7b2-4b75-8d53-0090c0e58b48 tempest-VolumesCloneTest-1887525358 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:09:49.714320 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-38b98a3e-c7b2-4b75-8d53-0090c0e58b48 tempest-VolumesCloneTest-1887525358 None] Deleted volume successfully. Feb 05 21:09:49.732272 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-38b98a3e-c7b2-4b75-8d53-0090c0e58b48 tempest-VolumesCloneTest-1887525358 None] Lock "b'cinder-12daa7e1-67d5-47a2-8c61-05780f4dc56c-delete_volume'" released by "delete_volume" :: held 1.426s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:09:50.646308 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-c292505c-f056-416d-a633-c9a829ba5941 tempest-VolumesCloneTest-1887525358 None] Lock "b'cinder-b77ec0fb-9a75-4cb1-b9ff-f93252481dea-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:09:50.751904 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c292505c-f056-416d-a633-c9a829ba5941 tempest-VolumesCloneTest-1887525358 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:50.997011 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c292505c-f056-416d-a633-c9a829ba5941 tempest-VolumesCloneTest-1887525358 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:09:51.019319 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c292505c-f056-416d-a633-c9a829ba5941 tempest-VolumesCloneTest-1887525358 None] deleting rbd volume volume-b77ec0fb-9a75-4cb1-b9ff-f93252481dea {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:09:52.137186 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c292505c-f056-416d-a633-c9a829ba5941 tempest-VolumesCloneTest-1887525358 None] volume is a clone so cleaning references {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 05 21:09:52.223734 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c292505c-f056-416d-a633-c9a829ba5941 tempest-VolumesCloneTest-1887525358 None] deleting parent snapshot volume-b77ec0fb-9a75-4cb1-b9ff-f93252481dea.clone_snap {{(pid=122683) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 05 21:09:52.689617 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:09:52.690980 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:52.742877 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:52.839444 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:09:52.934178 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-c292505c-f056-416d-a633-c9a829ba5941 tempest-VolumesCloneTest-1887525358 None] Created reservations ['84f5e29b-8cfc-4d14-8391-3a755cf2b1d0', '545c8c93-61dd-435b-98f5-601187957446', '33f69df4-494a-447f-b1b2-4d69c6e56c2a', '4427f1d9-726d-46e0-b79b-4c3a5e14abfb'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:09:53.035137 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c292505c-f056-416d-a633-c9a829ba5941 tempest-VolumesCloneTest-1887525358 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:53.089747 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c292505c-f056-416d-a633-c9a829ba5941 tempest-VolumesCloneTest-1887525358 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:53.142161 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-c292505c-f056-416d-a633-c9a829ba5941 tempest-VolumesCloneTest-1887525358 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:09:53.147179 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-c292505c-f056-416d-a633-c9a829ba5941 tempest-VolumesCloneTest-1887525358 None] Deleted volume successfully. Feb 05 21:09:53.187422 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-c292505c-f056-416d-a633-c9a829ba5941 tempest-VolumesCloneTest-1887525358 None] Lock "b'cinder-b77ec0fb-9a75-4cb1-b9ff-f93252481dea-delete_volume'" released by "delete_volume" :: held 2.543s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:09:54.075344 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-d211328b-c925-49ff-98ca-c0e7d867409c tempest-VolumesCloneTest-1887525358 None] Lock "b'cinder-153391ed-c44b-4e50-89c9-fc08651650ee-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:09:54.144032 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-d211328b-c925-49ff-98ca-c0e7d867409c tempest-VolumesCloneTest-1887525358 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:54.325085 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-d211328b-c925-49ff-98ca-c0e7d867409c tempest-VolumesCloneTest-1887525358 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:09:54.378607 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-d211328b-c925-49ff-98ca-c0e7d867409c tempest-VolumesCloneTest-1887525358 None] deleting rbd volume volume-153391ed-c44b-4e50-89c9-fc08651650ee {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:09:55.341313 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-d211328b-c925-49ff-98ca-c0e7d867409c tempest-VolumesCloneTest-1887525358 None] volume is a clone so cleaning references {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 05 21:09:55.427166 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-d211328b-c925-49ff-98ca-c0e7d867409c tempest-VolumesCloneTest-1887525358 None] deleting parent snapshot volume-153391ed-c44b-4e50-89c9-fc08651650ee.clone_snap {{(pid=122683) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 05 21:09:55.841890 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-d211328b-c925-49ff-98ca-c0e7d867409c tempest-VolumesCloneTest-1887525358 None] Created reservations ['bcc95052-06b7-425b-a815-bffdc4d70452', '843cd9da-689b-4352-ac76-7e09d6354204', '9c84a06d-0ac1-40a1-b2cc-b8fd0a4b0e2a', 'edf76498-1e0f-4acb-a52f-5e67051e70c1'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:09:55.947146 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-d211328b-c925-49ff-98ca-c0e7d867409c tempest-VolumesCloneTest-1887525358 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:56.021916 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-d211328b-c925-49ff-98ca-c0e7d867409c tempest-VolumesCloneTest-1887525358 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:09:56.108184 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-d211328b-c925-49ff-98ca-c0e7d867409c tempest-VolumesCloneTest-1887525358 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:09:56.114202 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-d211328b-c925-49ff-98ca-c0e7d867409c tempest-VolumesCloneTest-1887525358 None] Deleted volume successfully. Feb 05 21:09:56.149556 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-d211328b-c925-49ff-98ca-c0e7d867409c tempest-VolumesCloneTest-1887525358 None] Lock "b'cinder-153391ed-c44b-4e50-89c9-fc08651650ee-delete_volume'" released by "delete_volume" :: held 2.071s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:10:00.299176 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f0a414c-2ab8-4b91-9bde-05da957cbbf8 tempest-VolumesNegativeTest-1321821701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:10:00.308895 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-7f0a414c-2ab8-4b91-9bde-05da957cbbf8 tempest-VolumesNegativeTest-1321821701 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:10:00.309938 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-7f0a414c-2ab8-4b91-9bde-05da957cbbf8 tempest-VolumesNegativeTest-1321821701 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:10:00.340679 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-7f0a414c-2ab8-4b91-9bde-05da957cbbf8 tempest-VolumesNegativeTest-1321821701 None] Flow 'volume_create_manager' (8cdd2140-8895-48d1-bc40-f8a338746e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:10:00.349287 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-7f0a414c-2ab8-4b91-9bde-05da957cbbf8 tempest-VolumesNegativeTest-1321821701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86489107-6c03-4579-b5c4-5edf5cb520a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:10:00.363203 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-7f0a414c-2ab8-4b91-9bde-05da957cbbf8 tempest-VolumesNegativeTest-1321821701 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:10:00.408883 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-7f0a414c-2ab8-4b91-9bde-05da957cbbf8 tempest-VolumesNegativeTest-1321821701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86489107-6c03-4579-b5c4-5edf5cb520a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1543808807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b810ba01-dea0-4ffe-b64d-ee8b6b042505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0ac1f2b9efc46bdbabf1888e40aaed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:10:00Z,use_quota=True,user_id='a90705c84fe642f2bdddb1c905a48f7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:10:00.417196 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-7f0a414c-2ab8-4b91-9bde-05da957cbbf8 tempest-VolumesNegativeTest-1321821701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb0a32e4-8c47-48ca-8d63-7c9aa6333a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:10:00.422028 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-7f0a414c-2ab8-4b91-9bde-05da957cbbf8 tempest-VolumesNegativeTest-1321821701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb0a32e4-8c47-48ca-8d63-7c9aa6333a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:10:00.430545 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-7f0a414c-2ab8-4b91-9bde-05da957cbbf8 tempest-VolumesNegativeTest-1321821701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fb3dd3f-f290-48d8-8e94-380e9c513bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:10:00.447585 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-7f0a414c-2ab8-4b91-9bde-05da957cbbf8 tempest-VolumesNegativeTest-1321821701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fb3dd3f-f290-48d8-8e94-380e9c513bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b810ba01-dea0-4ffe-b64d-ee8b6b042505', 'volume_name': 'volume-b810ba01-dea0-4ffe-b64d-ee8b6b042505', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:10:00.452952 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-7f0a414c-2ab8-4b91-9bde-05da957cbbf8 tempest-VolumesNegativeTest-1321821701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eb6e522-0083-4203-bc1b-158ef2e20edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:10:00.457989 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-7f0a414c-2ab8-4b91-9bde-05da957cbbf8 tempest-VolumesNegativeTest-1321821701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eb6e522-0083-4203-bc1b-158ef2e20edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:10:00.465236 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-7f0a414c-2ab8-4b91-9bde-05da957cbbf8 tempest-VolumesNegativeTest-1321821701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d65496-4b25-424e-b4bd-7aa03765f168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:10:00.467636 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-7f0a414c-2ab8-4b91-9bde-05da957cbbf8 tempest-VolumesNegativeTest-1321821701 None] Volume b810ba01-dea0-4ffe-b64d-ee8b6b042505: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b810ba01-dea0-4ffe-b64d-ee8b6b042505', 'volume_size': 1} Feb 05 21:10:00.468235 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-7f0a414c-2ab8-4b91-9bde-05da957cbbf8 tempest-VolumesNegativeTest-1321821701 None] creating volume 'volume-b810ba01-dea0-4ffe-b64d-ee8b6b042505' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:10:00.470223 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-7f0a414c-2ab8-4b91-9bde-05da957cbbf8 tempest-VolumesNegativeTest-1321821701 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:10:00.638156 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-7f0a414c-2ab8-4b91-9bde-05da957cbbf8 tempest-VolumesNegativeTest-1321821701 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:10:00.638579 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-7f0a414c-2ab8-4b91-9bde-05da957cbbf8 tempest-VolumesNegativeTest-1321821701 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:10:00.645438 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-7f0a414c-2ab8-4b91-9bde-05da957cbbf8 tempest-VolumesNegativeTest-1321821701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d65496-4b25-424e-b4bd-7aa03765f168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b810ba01-dea0-4ffe-b64d-ee8b6b042505', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:10:00.664803 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-7f0a414c-2ab8-4b91-9bde-05da957cbbf8 tempest-VolumesNegativeTest-1321821701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03db1567-8127-4d87-899b-e0ab79c4278f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:10:00.702691 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-7f0a414c-2ab8-4b91-9bde-05da957cbbf8 tempest-VolumesNegativeTest-1321821701 None] Volume volume-b810ba01-dea0-4ffe-b64d-ee8b6b042505 (b810ba01-dea0-4ffe-b64d-ee8b6b042505): created successfully Feb 05 21:10:00.706693 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-7f0a414c-2ab8-4b91-9bde-05da957cbbf8 tempest-VolumesNegativeTest-1321821701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03db1567-8127-4d87-899b-e0ab79c4278f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:10:00.714204 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-7f0a414c-2ab8-4b91-9bde-05da957cbbf8 tempest-VolumesNegativeTest-1321821701 None] Flow 'volume_create_manager' (8cdd2140-8895-48d1-bc40-f8a338746e5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:10:00.718451 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-f3029c8c-7abd-4edc-aa8b-2d3925d8a748 tempest-VolumesSnapshotTestJSON-1761633007 None] Terminate volume connection completed successfully. Feb 05 21:10:00.732881 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-7f0a414c-2ab8-4b91-9bde-05da957cbbf8 tempest-VolumesNegativeTest-1321821701 None] Created volume successfully. Feb 05 21:10:00.743359 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-f3029c8c-7abd-4edc-aa8b-2d3925d8a748 tempest-VolumesSnapshotTestJSON-1761633007 None] Remove volume export completed successfully. Feb 05 21:10:00.798559 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-f3029c8c-7abd-4edc-aa8b-2d3925d8a748 tempest-VolumesSnapshotTestJSON-1761633007 None] Lock "b'cinder-baa93d66-524e-4edc-addd-c5c2d6b460a4-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:10:00.836542 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-f3029c8c-7abd-4edc-aa8b-2d3925d8a748 tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:10:00.951030 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-f3029c8c-7abd-4edc-aa8b-2d3925d8a748 tempest-VolumesSnapshotTestJSON-1761633007 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:10:00.963591 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-f3029c8c-7abd-4edc-aa8b-2d3925d8a748 tempest-VolumesSnapshotTestJSON-1761633007 None] deleting rbd volume volume-baa93d66-524e-4edc-addd-c5c2d6b460a4 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:10:01.356163 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-f3029c8c-7abd-4edc-aa8b-2d3925d8a748 tempest-VolumesSnapshotTestJSON-1761633007 None] Deleted volume successfully. Feb 05 21:10:01.377504 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-f3029c8c-7abd-4edc-aa8b-2d3925d8a748 tempest-VolumesSnapshotTestJSON-1761633007 None] Lock "b'cinder-baa93d66-524e-4edc-addd-c5c2d6b460a4-delete_volume'" released by "delete_volume" :: held 0.579s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:10:05.987503 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-eabc8dda-d6d7-46d8-93da-e5db5c463255 req-369ac377-899a-40d4-bec9-c1f9fdf8f79d tempest-TestVolumeBootPattern-571902767 None] Terminate volume connection completed successfully. Feb 05 21:10:05.988790 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-eabc8dda-d6d7-46d8-93da-e5db5c463255 req-369ac377-899a-40d4-bec9-c1f9fdf8f79d tempest-TestVolumeBootPattern-571902767 None] Deleting attachment 710c7159-d342-4df2-8374-e9e1b2420fae. {{(pid=122683) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 05 21:10:10.342845 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-e54562d0-43a0-4b44-b55d-77c085a1b301 req-5387f0b0-5e15-4fe9-8dd2-e50ec50125ad tempest-TestVolumeBootPattern-571902767 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 21:10:11.278933 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-e54562d0-43a0-4b44-b55d-77c085a1b301 req-5387f0b0-5e15-4fe9-8dd2-e50ec50125ad tempest-TestVolumeBootPattern-571902767 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.936s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 21:10:11.280764 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-e54562d0-43a0-4b44-b55d-77c085a1b301 req-5387f0b0-5e15-4fe9-8dd2-e50ec50125ad tempest-TestVolumeBootPattern-571902767 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-882c36fd-3df2-4b63-92a4-d96715cad128', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': '882c36fd-3df2-4b63-92a4-d96715cad128', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 21:10:11.307993 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-e54562d0-43a0-4b44-b55d-77c085a1b301 req-5387f0b0-5e15-4fe9-8dd2-e50ec50125ad tempest-TestVolumeBootPattern-571902767 None] Connection info returned from driver {'name': 'volumes/volume-882c36fd-3df2-4b63-92a4-d96715cad128', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '882c36fd-3df2-4b63-92a4-d96715cad128', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '323f5193-989b-4a1c-91ff-d60fb45f3f48'} {{(pid=122683) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 05 21:10:11.370724 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-e54562d0-43a0-4b44-b55d-77c085a1b301 req-5387f0b0-5e15-4fe9-8dd2-e50ec50125ad tempest-TestVolumeBootPattern-571902767 None] attachment_update completed successfully. Feb 05 21:10:19.105181 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-3725a511-7719-4faa-a168-c3eff3f59726 tempest-VolumesSnapshotTestJSON-1761633007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:10:19.110601 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-3725a511-7719-4faa-a168-c3eff3f59726 tempest-VolumesSnapshotTestJSON-1761633007 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:10:19.111117 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-3725a511-7719-4faa-a168-c3eff3f59726 tempest-VolumesSnapshotTestJSON-1761633007 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:10:19.133016 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3725a511-7719-4faa-a168-c3eff3f59726 tempest-VolumesSnapshotTestJSON-1761633007 None] Flow 'volume_create_manager' (026b8abc-7338-4e49-8375-cacd544e0982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:10:19.141207 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3725a511-7719-4faa-a168-c3eff3f59726 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c145a8ae-0c62-4b60-a5f4-662c6bf6630d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:10:19.149153 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-3725a511-7719-4faa-a168-c3eff3f59726 tempest-VolumesSnapshotTestJSON-1761633007 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:10:19.165262 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3725a511-7719-4faa-a168-c3eff3f59726 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c145a8ae-0c62-4b60-a5f4-662c6bf6630d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-539535926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=efeb3240-d992-46c6-8d1c-28d353568b08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c04615402925462792ca03f711db23c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:10:19Z,use_quota=True,user_id='6682477b172d460881a96d68f6bd053c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:10:19.171571 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3725a511-7719-4faa-a168-c3eff3f59726 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bca5bff8-3b32-41ef-bd0e-71eb4ff78031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:10:19.179352 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3725a511-7719-4faa-a168-c3eff3f59726 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bca5bff8-3b32-41ef-bd0e-71eb4ff78031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:10:19.185710 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3725a511-7719-4faa-a168-c3eff3f59726 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0d410b2-6a76-4dc3-b127-0a49f36598b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:10:19.278495 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3725a511-7719-4faa-a168-c3eff3f59726 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0d410b2-6a76-4dc3-b127-0a49f36598b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'efeb3240-d992-46c6-8d1c-28d353568b08', 'volume_name': 'volume-efeb3240-d992-46c6-8d1c-28d353568b08', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:10:19.284335 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3725a511-7719-4faa-a168-c3eff3f59726 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (717d140d-5b81-4b2c-aa1a-1b407659932d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:10:19.288545 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3725a511-7719-4faa-a168-c3eff3f59726 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (717d140d-5b81-4b2c-aa1a-1b407659932d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:10:19.293857 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3725a511-7719-4faa-a168-c3eff3f59726 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab0d08c7-b2e1-4bef-bebb-0420020ea0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:10:19.294851 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-3725a511-7719-4faa-a168-c3eff3f59726 tempest-VolumesSnapshotTestJSON-1761633007 None] Volume efeb3240-d992-46c6-8d1c-28d353568b08: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-efeb3240-d992-46c6-8d1c-28d353568b08', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 05 21:10:19.295319 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-3725a511-7719-4faa-a168-c3eff3f59726 tempest-VolumesSnapshotTestJSON-1761633007 None] Cloning efeb3240-d992-46c6-8d1c-28d353568b08 from image e66a3a3b-d2f9-4d5d-8021-a6001dff419f at location (None, None). {{(pid=122683) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 05 21:10:19.307789 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-3725a511-7719-4faa-a168-c3eff3f59726 tempest-VolumesSnapshotTestJSON-1761633007 None] Lock "b'cinder-e66a3a3b-d2f9-4d5d-8021-a6001dff419f'" acquired by "_prepare_image_cache_entry" :: waited 0.012s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:10:19.317737 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-3725a511-7719-4faa-a168-c3eff3f59726 tempest-VolumesSnapshotTestJSON-1761633007 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'volume_id': '311ef4be-45fd-4167-a3ad-6251d56550a7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57), 'last_used': datetime.datetime(2022, 2, 5, 21, 10, 19, 312303)}. {{(pid=122683) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 05 21:10:19.318332 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-3725a511-7719-4faa-a168-c3eff3f59726 tempest-VolumesSnapshotTestJSON-1761633007 None] Image-volume cache entry image_update_at = 2022-02-05 20:37:57+00:00, requested image updated_at = 2022-02-05 20:37:57+00:00. {{(pid=122683) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 05 21:10:19.318947 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-3725a511-7719-4faa-a168-c3eff3f59726 tempest-VolumesSnapshotTestJSON-1761633007 None] Found cache entry for image = e66a3a3b-d2f9-4d5d-8021-a6001dff419f on host ncdv-master-1@ceph#ceph. {{(pid=122683) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Feb 05 21:10:19.324186 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-3725a511-7719-4faa-a168-c3eff3f59726 tempest-VolumesSnapshotTestJSON-1761633007 None] Lock "b'cinder-e66a3a3b-d2f9-4d5d-8021-a6001dff419f'" released by "_prepare_image_cache_entry" :: held 0.016s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:10:19.325212 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-3725a511-7719-4faa-a168-c3eff3f59726 tempest-VolumesSnapshotTestJSON-1761633007 None] Attempting to retrieve cache entry for image = e66a3a3b-d2f9-4d5d-8021-a6001dff419f on host ncdv-master-1@ceph#ceph. {{(pid=122683) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 05 21:10:19.331264 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-3725a511-7719-4faa-a168-c3eff3f59726 tempest-VolumesSnapshotTestJSON-1761633007 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'volume_id': '311ef4be-45fd-4167-a3ad-6251d56550a7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57), 'last_used': datetime.datetime(2022, 2, 5, 21, 10, 19, 328811)}. {{(pid=122683) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 05 21:10:19.331798 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-3725a511-7719-4faa-a168-c3eff3f59726 tempest-VolumesSnapshotTestJSON-1761633007 None] Image-volume cache entry image_update_at = 2022-02-05 20:37:57+00:00, requested image updated_at = 2022-02-05 20:37:57+00:00. {{(pid=122683) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 05 21:10:19.332111 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-3725a511-7719-4faa-a168-c3eff3f59726 tempest-VolumesSnapshotTestJSON-1761633007 None] Creating from source image-volume 311ef4be-45fd-4167-a3ad-6251d56550a7 {{(pid=122683) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Feb 05 21:10:19.346764 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3725a511-7719-4faa-a168-c3eff3f59726 tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:10:19.414774 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3725a511-7719-4faa-a168-c3eff3f59726 tempest-VolumesSnapshotTestJSON-1761633007 None] creating snapshot='volume-efeb3240-d992-46c6-8d1c-28d353568b08.clone_snap' {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 05 21:10:19.636487 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3725a511-7719-4faa-a168-c3eff3f59726 tempest-VolumesSnapshotTestJSON-1761633007 None] cloning 'volume-311ef4be-45fd-4167-a3ad-6251d56550a7@volume-efeb3240-d992-46c6-8d1c-28d353568b08.clone_snap' to 'volume-efeb3240-d992-46c6-8d1c-28d353568b08' {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 05 21:10:19.784220 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3725a511-7719-4faa-a168-c3eff3f59726 tempest-VolumesSnapshotTestJSON-1761633007 None] Volume volume-35445a36-a76c-48db-a9c5-3b58646c1e7b.deleted is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:10:19.785471 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3725a511-7719-4faa-a168-c3eff3f59726 tempest-VolumesSnapshotTestJSON-1761633007 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:10:19.785952 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3725a511-7719-4faa-a168-c3eff3f59726 tempest-VolumesSnapshotTestJSON-1761633007 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:10:19.806446 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3725a511-7719-4faa-a168-c3eff3f59726 tempest-VolumesSnapshotTestJSON-1761633007 None] clone created successfully {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 05 21:10:19.807283 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.volume_utils [None req-3725a511-7719-4faa-a168-c3eff3f59726 tempest-VolumesSnapshotTestJSON-1761633007 None] Marking volume efeb3240-d992-46c6-8d1c-28d353568b08 as bootable. {{(pid=122683) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Feb 05 21:10:19.815045 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-3725a511-7719-4faa-a168-c3eff3f59726 tempest-VolumesSnapshotTestJSON-1761633007 None] Copying metadata from image e66a3a3b-d2f9-4d5d-8021-a6001dff419f to efeb3240-d992-46c6-8d1c-28d353568b08. {{(pid=122683) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 05 21:10:19.815474 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-3725a511-7719-4faa-a168-c3eff3f59726 tempest-VolumesSnapshotTestJSON-1761633007 None] Creating volume glance metadata for volume efeb3240-d992-46c6-8d1c-28d353568b08 backed by image e66a3a3b-d2f9-4d5d-8021-a6001dff419f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=122683) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 05 21:10:19.866146 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3725a511-7719-4faa-a168-c3eff3f59726 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab0d08c7-b2e1-4bef-bebb-0420020ea0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efeb3240-d992-46c6-8d1c-28d353568b08', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:10:19.872006 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3725a511-7719-4faa-a168-c3eff3f59726 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0108d5e3-ee07-4905-890d-9b17c614227d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:10:19.880452 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-3725a511-7719-4faa-a168-c3eff3f59726 tempest-VolumesSnapshotTestJSON-1761633007 None] Volume volume-efeb3240-d992-46c6-8d1c-28d353568b08 (efeb3240-d992-46c6-8d1c-28d353568b08): created successfully Feb 05 21:10:19.884435 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3725a511-7719-4faa-a168-c3eff3f59726 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0108d5e3-ee07-4905-890d-9b17c614227d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:10:19.890143 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3725a511-7719-4faa-a168-c3eff3f59726 tempest-VolumesSnapshotTestJSON-1761633007 None] Flow 'volume_create_manager' (026b8abc-7338-4e49-8375-cacd544e0982) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:10:19.898370 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-3725a511-7719-4faa-a168-c3eff3f59726 tempest-VolumesSnapshotTestJSON-1761633007 None] Created volume successfully. Feb 05 21:10:20.661873 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-a4b3f970-5562-454b-a05c-25c2481e9e01 req-32ce3bd8-c4a9-4523-a15f-0328c4330b0a tempest-VolumesSnapshotTestJSON-1761633007 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 21:10:21.375806 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-a4b3f970-5562-454b-a05c-25c2481e9e01 req-32ce3bd8-c4a9-4523-a15f-0328c4330b0a tempest-VolumesSnapshotTestJSON-1761633007 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.714s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 21:10:21.376682 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-a4b3f970-5562-454b-a05c-25c2481e9e01 req-32ce3bd8-c4a9-4523-a15f-0328c4330b0a tempest-VolumesSnapshotTestJSON-1761633007 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-efeb3240-d992-46c6-8d1c-28d353568b08', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': 'efeb3240-d992-46c6-8d1c-28d353568b08', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 21:10:21.400967 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-a4b3f970-5562-454b-a05c-25c2481e9e01 req-32ce3bd8-c4a9-4523-a15f-0328c4330b0a tempest-VolumesSnapshotTestJSON-1761633007 None] Connection info returned from driver {'name': 'volumes/volume-efeb3240-d992-46c6-8d1c-28d353568b08', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'efeb3240-d992-46c6-8d1c-28d353568b08', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '70841f5d-b67f-462f-a540-07b45e12cc7a'} {{(pid=122683) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 05 21:10:21.472949 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-a4b3f970-5562-454b-a05c-25c2481e9e01 req-32ce3bd8-c4a9-4523-a15f-0328c4330b0a tempest-VolumesSnapshotTestJSON-1761633007 None] attachment_update completed successfully. Feb 05 21:10:22.220734 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-3fd16760-7d3f-4c56-8575-7fd927b38853 tempest-VolumesNegativeTest-1321821701 None] Lock "b'cinder-b810ba01-dea0-4ffe-b64d-ee8b6b042505-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:10:22.253795 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3fd16760-7d3f-4c56-8575-7fd927b38853 tempest-VolumesNegativeTest-1321821701 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:10:22.293684 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3fd16760-7d3f-4c56-8575-7fd927b38853 tempest-VolumesNegativeTest-1321821701 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:10:22.294140 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3fd16760-7d3f-4c56-8575-7fd927b38853 tempest-VolumesNegativeTest-1321821701 None] Volume volume-b810ba01-dea0-4ffe-b64d-ee8b6b042505 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:10:22.300067 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3fd16760-7d3f-4c56-8575-7fd927b38853 tempest-VolumesNegativeTest-1321821701 None] deleting rbd volume volume-b810ba01-dea0-4ffe-b64d-ee8b6b042505 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:10:22.497005 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-3fd16760-7d3f-4c56-8575-7fd927b38853 tempest-VolumesNegativeTest-1321821701 None] Created reservations ['4856da88-03e5-478a-93ba-43fa2e39ba58', '66819895-ec1b-47fc-b305-9da730a8b469', '5b1fcfb4-81e9-4c25-9027-2cf7b6ce47d6', 'ec26f123-9960-4576-8d0b-abec205bb074'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:10:22.535698 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3fd16760-7d3f-4c56-8575-7fd927b38853 tempest-VolumesNegativeTest-1321821701 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:10:22.567076 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3fd16760-7d3f-4c56-8575-7fd927b38853 tempest-VolumesNegativeTest-1321821701 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:10:22.599816 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-3fd16760-7d3f-4c56-8575-7fd927b38853 tempest-VolumesNegativeTest-1321821701 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:10:22.606357 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-3fd16760-7d3f-4c56-8575-7fd927b38853 tempest-VolumesNegativeTest-1321821701 None] Deleted volume successfully. Feb 05 21:10:22.623086 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-3fd16760-7d3f-4c56-8575-7fd927b38853 tempest-VolumesNegativeTest-1321821701 None] Lock "b'cinder-b810ba01-dea0-4ffe-b64d-ee8b6b042505-delete_volume'" released by "delete_volume" :: held 0.402s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:10:23.969040 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8b68b2c8-793e-4a02-8707-155cd7d28945 tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:10:24.776369 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-8b68b2c8-793e-4a02-8707-155cd7d28945 tempest-VolumesSnapshotTestJSON-1761633007 None] Create snapshot completed successfully Feb 05 21:10:25.221125 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-67865bbc-6912-496a-a1a8-04cec874f7cc tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:10:25.774006 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-67865bbc-6912-496a-a1a8-04cec874f7cc tempest-VolumesSnapshotTestJSON-1761633007 None] Create snapshot completed successfully Feb 05 21:10:26.432915 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ef0b9fd4-1f98-4103-8d9b-61d8d2284c26 tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:10:26.848432 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-ef0b9fd4-1f98-4103-8d9b-61d8d2284c26 tempest-VolumesSnapshotTestJSON-1761633007 None] Create snapshot completed successfully Feb 05 21:10:27.489243 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-865efeb3-7590-4a43-aa20-f867b6732e1c tempest-VolumesSnapshotTestJSON-1761633007 None] Lock "b'cinder-4a9cf734-c506-42fb-a2ba-3d9e31ca651b-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:10:27.490803 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-865efeb3-7590-4a43-aa20-f867b6732e1c tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:10:28.636872 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-c10a504c-cfe0-4fc9-ab56-0f8be6b3d6b0 tempest-ServerRescueNegativeTestJSON-1316004756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:10:28.640576 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-c10a504c-cfe0-4fc9-ab56-0f8be6b3d6b0 tempest-ServerRescueNegativeTestJSON-1316004756 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:10:28.641054 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-c10a504c-cfe0-4fc9-ab56-0f8be6b3d6b0 tempest-ServerRescueNegativeTestJSON-1316004756 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:10:28.661811 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-c10a504c-cfe0-4fc9-ab56-0f8be6b3d6b0 tempest-ServerRescueNegativeTestJSON-1316004756 None] Flow 'volume_create_manager' (ab3ae5bd-3f37-4736-866a-916fd24d8679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:10:28.669378 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-c10a504c-cfe0-4fc9-ab56-0f8be6b3d6b0 tempest-ServerRescueNegativeTestJSON-1316004756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b6858d-9c34-45c7-bbee-ffcd8daa8aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:10:28.676535 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-c10a504c-cfe0-4fc9-ab56-0f8be6b3d6b0 tempest-ServerRescueNegativeTestJSON-1316004756 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:10:28.695640 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-c10a504c-cfe0-4fc9-ab56-0f8be6b3d6b0 tempest-ServerRescueNegativeTestJSON-1316004756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b6858d-9c34-45c7-bbee-ffcd8daa8aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1015048235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8fdfb2d0-6d85-4059-ab04-b07d4d64ba60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52eadb29309f4abb8ff8f5903643d9da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:10:29Z,use_quota=True,user_id='fab99209ed2947fab2bd58185fe491a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:10:28.701281 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-c10a504c-cfe0-4fc9-ab56-0f8be6b3d6b0 tempest-ServerRescueNegativeTestJSON-1316004756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f36508a-820e-4cad-95b9-7c94f9befd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:10:28.705489 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-c10a504c-cfe0-4fc9-ab56-0f8be6b3d6b0 tempest-ServerRescueNegativeTestJSON-1316004756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f36508a-820e-4cad-95b9-7c94f9befd00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:10:28.711053 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-c10a504c-cfe0-4fc9-ab56-0f8be6b3d6b0 tempest-ServerRescueNegativeTestJSON-1316004756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd4bb96-c3b4-458b-bc59-6554ae3ea78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:10:28.715975 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-c10a504c-cfe0-4fc9-ab56-0f8be6b3d6b0 tempest-ServerRescueNegativeTestJSON-1316004756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd4bb96-c3b4-458b-bc59-6554ae3ea78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fdfb2d0-6d85-4059-ab04-b07d4d64ba60', 'volume_name': 'volume-8fdfb2d0-6d85-4059-ab04-b07d4d64ba60', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:10:28.721098 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-c10a504c-cfe0-4fc9-ab56-0f8be6b3d6b0 tempest-ServerRescueNegativeTestJSON-1316004756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a25dbde3-8883-44ca-be48-3365e9c70101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:10:28.725149 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-c10a504c-cfe0-4fc9-ab56-0f8be6b3d6b0 tempest-ServerRescueNegativeTestJSON-1316004756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a25dbde3-8883-44ca-be48-3365e9c70101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:10:28.731128 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-c10a504c-cfe0-4fc9-ab56-0f8be6b3d6b0 tempest-ServerRescueNegativeTestJSON-1316004756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd901186-f0ed-4b30-a1e8-64d91bf3259f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:10:28.732243 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-c10a504c-cfe0-4fc9-ab56-0f8be6b3d6b0 tempest-ServerRescueNegativeTestJSON-1316004756 None] Volume 8fdfb2d0-6d85-4059-ab04-b07d4d64ba60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fdfb2d0-6d85-4059-ab04-b07d4d64ba60', 'volume_size': 1} Feb 05 21:10:28.732645 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c10a504c-cfe0-4fc9-ab56-0f8be6b3d6b0 tempest-ServerRescueNegativeTestJSON-1316004756 None] creating volume 'volume-8fdfb2d0-6d85-4059-ab04-b07d4d64ba60' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:10:28.733653 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c10a504c-cfe0-4fc9-ab56-0f8be6b3d6b0 tempest-ServerRescueNegativeTestJSON-1316004756 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:10:28.798118 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c10a504c-cfe0-4fc9-ab56-0f8be6b3d6b0 tempest-ServerRescueNegativeTestJSON-1316004756 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:10:28.799306 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c10a504c-cfe0-4fc9-ab56-0f8be6b3d6b0 tempest-ServerRescueNegativeTestJSON-1316004756 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:10:28.804537 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-c10a504c-cfe0-4fc9-ab56-0f8be6b3d6b0 tempest-ServerRescueNegativeTestJSON-1316004756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd901186-f0ed-4b30-a1e8-64d91bf3259f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fdfb2d0-6d85-4059-ab04-b07d4d64ba60', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:10:28.809410 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-c10a504c-cfe0-4fc9-ab56-0f8be6b3d6b0 tempest-ServerRescueNegativeTestJSON-1316004756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1317626d-b299-43d0-8d33-b26d65433a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:10:28.824084 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-c10a504c-cfe0-4fc9-ab56-0f8be6b3d6b0 tempest-ServerRescueNegativeTestJSON-1316004756 None] Volume volume-8fdfb2d0-6d85-4059-ab04-b07d4d64ba60 (8fdfb2d0-6d85-4059-ab04-b07d4d64ba60): created successfully Feb 05 21:10:28.828917 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-c10a504c-cfe0-4fc9-ab56-0f8be6b3d6b0 tempest-ServerRescueNegativeTestJSON-1316004756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1317626d-b299-43d0-8d33-b26d65433a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:10:28.834783 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-c10a504c-cfe0-4fc9-ab56-0f8be6b3d6b0 tempest-ServerRescueNegativeTestJSON-1316004756 None] Flow 'volume_create_manager' (ab3ae5bd-3f37-4736-866a-916fd24d8679) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:10:28.845469 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-c10a504c-cfe0-4fc9-ab56-0f8be6b3d6b0 tempest-ServerRescueNegativeTestJSON-1316004756 None] Created volume successfully. Feb 05 21:10:44.047073 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2d3afb3-b6e2-4358-bab2-d982128b5834 tempest-ServerRescueNegativeTestJSON-1316004756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:10:44.056525 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-b2d3afb3-b6e2-4358-bab2-d982128b5834 tempest-ServerRescueNegativeTestJSON-1316004756 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:10:44.057880 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-b2d3afb3-b6e2-4358-bab2-d982128b5834 tempest-ServerRescueNegativeTestJSON-1316004756 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:10:44.090693 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b2d3afb3-b6e2-4358-bab2-d982128b5834 tempest-ServerRescueNegativeTestJSON-1316004756 None] Flow 'volume_create_manager' (7b16fe93-360c-4f5f-8e5e-d76ce35812f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:10:44.099786 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b2d3afb3-b6e2-4358-bab2-d982128b5834 tempest-ServerRescueNegativeTestJSON-1316004756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f31bc031-61ed-44fb-8240-f4ffb6a86fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:10:44.112242 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-b2d3afb3-b6e2-4358-bab2-d982128b5834 tempest-ServerRescueNegativeTestJSON-1316004756 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:10:44.130726 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b2d3afb3-b6e2-4358-bab2-d982128b5834 tempest-ServerRescueNegativeTestJSON-1316004756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f31bc031-61ed-44fb-8240-f4ffb6a86fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-119521530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f48df254-035f-4cdb-90b5-2796a89c1a42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52eadb29309f4abb8ff8f5903643d9da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:10:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:10:44Z,use_quota=True,user_id='fab99209ed2947fab2bd58185fe491a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:10:44.143658 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b2d3afb3-b6e2-4358-bab2-d982128b5834 tempest-ServerRescueNegativeTestJSON-1316004756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e4f0338-0583-44cf-969d-398d74018ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:10:44.150225 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b2d3afb3-b6e2-4358-bab2-d982128b5834 tempest-ServerRescueNegativeTestJSON-1316004756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e4f0338-0583-44cf-969d-398d74018ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:10:44.155828 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b2d3afb3-b6e2-4358-bab2-d982128b5834 tempest-ServerRescueNegativeTestJSON-1316004756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b37e548c-b8e5-4073-aa74-1428de95b0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:10:44.160832 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b2d3afb3-b6e2-4358-bab2-d982128b5834 tempest-ServerRescueNegativeTestJSON-1316004756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b37e548c-b8e5-4073-aa74-1428de95b0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f48df254-035f-4cdb-90b5-2796a89c1a42', 'volume_name': 'volume-f48df254-035f-4cdb-90b5-2796a89c1a42', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:10:44.167140 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b2d3afb3-b6e2-4358-bab2-d982128b5834 tempest-ServerRescueNegativeTestJSON-1316004756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01be7e21-61e2-463b-a8e3-6b6a85c94aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:10:44.172560 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b2d3afb3-b6e2-4358-bab2-d982128b5834 tempest-ServerRescueNegativeTestJSON-1316004756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01be7e21-61e2-463b-a8e3-6b6a85c94aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:10:44.183820 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b2d3afb3-b6e2-4358-bab2-d982128b5834 tempest-ServerRescueNegativeTestJSON-1316004756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d716f7e-2f53-4efa-8c40-700068e7522d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:10:44.185028 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-b2d3afb3-b6e2-4358-bab2-d982128b5834 tempest-ServerRescueNegativeTestJSON-1316004756 None] Volume f48df254-035f-4cdb-90b5-2796a89c1a42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f48df254-035f-4cdb-90b5-2796a89c1a42', 'volume_size': 1} Feb 05 21:10:44.185421 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-b2d3afb3-b6e2-4358-bab2-d982128b5834 tempest-ServerRescueNegativeTestJSON-1316004756 None] creating volume 'volume-f48df254-035f-4cdb-90b5-2796a89c1a42' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:10:44.186510 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-b2d3afb3-b6e2-4358-bab2-d982128b5834 tempest-ServerRescueNegativeTestJSON-1316004756 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:10:44.285015 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-b2d3afb3-b6e2-4358-bab2-d982128b5834 tempest-ServerRescueNegativeTestJSON-1316004756 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:10:44.285391 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-b2d3afb3-b6e2-4358-bab2-d982128b5834 tempest-ServerRescueNegativeTestJSON-1316004756 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:10:44.290316 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b2d3afb3-b6e2-4358-bab2-d982128b5834 tempest-ServerRescueNegativeTestJSON-1316004756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d716f7e-2f53-4efa-8c40-700068e7522d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f48df254-035f-4cdb-90b5-2796a89c1a42', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:10:44.295547 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b2d3afb3-b6e2-4358-bab2-d982128b5834 tempest-ServerRescueNegativeTestJSON-1316004756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d428d41b-04a0-4647-ae6e-562d863dc875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:10:44.308155 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-b2d3afb3-b6e2-4358-bab2-d982128b5834 tempest-ServerRescueNegativeTestJSON-1316004756 None] Volume volume-f48df254-035f-4cdb-90b5-2796a89c1a42 (f48df254-035f-4cdb-90b5-2796a89c1a42): created successfully Feb 05 21:10:44.313660 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b2d3afb3-b6e2-4358-bab2-d982128b5834 tempest-ServerRescueNegativeTestJSON-1316004756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d428d41b-04a0-4647-ae6e-562d863dc875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:10:44.323994 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b2d3afb3-b6e2-4358-bab2-d982128b5834 tempest-ServerRescueNegativeTestJSON-1316004756 None] Flow 'volume_create_manager' (7b16fe93-360c-4f5f-8e5e-d76ce35812f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:10:44.339629 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-b2d3afb3-b6e2-4358-bab2-d982128b5834 tempest-ServerRescueNegativeTestJSON-1316004756 None] Created volume successfully. Feb 05 21:10:45.986403 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-404bb8de-da9d-406a-b77c-8a8b32ae8583 req-d3a888fa-f7c0-42aa-a156-a4507337c7ec tempest-ServerRescueNegativeTestJSON-1316004756 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 21:10:46.740025 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-404bb8de-da9d-406a-b77c-8a8b32ae8583 req-d3a888fa-f7c0-42aa-a156-a4507337c7ec tempest-ServerRescueNegativeTestJSON-1316004756 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.753s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 21:10:46.740828 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-404bb8de-da9d-406a-b77c-8a8b32ae8583 req-d3a888fa-f7c0-42aa-a156-a4507337c7ec tempest-ServerRescueNegativeTestJSON-1316004756 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f48df254-035f-4cdb-90b5-2796a89c1a42', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': 'f48df254-035f-4cdb-90b5-2796a89c1a42', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 21:10:46.765809 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-404bb8de-da9d-406a-b77c-8a8b32ae8583 req-d3a888fa-f7c0-42aa-a156-a4507337c7ec tempest-ServerRescueNegativeTestJSON-1316004756 None] Connection info returned from driver {'name': 'volumes/volume-f48df254-035f-4cdb-90b5-2796a89c1a42', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f48df254-035f-4cdb-90b5-2796a89c1a42', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'e013d318-d82d-4f2e-a735-8ff45e75d1a4'} {{(pid=122683) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 05 21:10:46.811253 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-404bb8de-da9d-406a-b77c-8a8b32ae8583 req-d3a888fa-f7c0-42aa-a156-a4507337c7ec tempest-ServerRescueNegativeTestJSON-1316004756 None] attachment_update completed successfully. Feb 05 21:10:52.689702 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:10:52.691327 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:10:52.726099 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:10:52.757544 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:10:57.692672 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-865efeb3-7590-4a43-aa20-f867b6732e1c tempest-VolumesSnapshotTestJSON-1761633007 None] Created reservations ['1f2c859a-dc3d-4935-b85c-30d71b589394', '58d8ecca-f4e4-4a88-a820-459cdecbdd0a', '3b2f90d4-f57b-4f49-a770-8e5778e3bdc6', '64495378-cf41-453e-a952-874b4f3e6798'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:10:57.745202 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-865efeb3-7590-4a43-aa20-f867b6732e1c tempest-VolumesSnapshotTestJSON-1761633007 None] Delete snapshot completed successfully. Feb 05 21:10:57.761175 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-865efeb3-7590-4a43-aa20-f867b6732e1c tempest-VolumesSnapshotTestJSON-1761633007 None] Lock "b'cinder-4a9cf734-c506-42fb-a2ba-3d9e31ca651b-delete_snapshot'" released by "delete_snapshot" :: held 30.272s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:10:58.757981 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-834054e4-2279-4068-aa84-8a941e686f4e tempest-VolumesSnapshotTestJSON-1761633007 None] Lock "b'cinder-a1808b98-1e82-4ae0-99c9-0a82ec1a0e41-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:10:58.760957 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-834054e4-2279-4068-aa84-8a941e686f4e tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:11:23.140739 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-a92da598-2c6c-4143-ae3f-7a75554c953b tempest-ServersNegativeTestJSON-1381166818 None] Lock "b'cinder-c46c46c9-4865-463e-b891-4cf43955ae33-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:11:23.173204 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-a92da598-2c6c-4143-ae3f-7a75554c953b tempest-ServersNegativeTestJSON-1381166818 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:11:23.214885 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-a92da598-2c6c-4143-ae3f-7a75554c953b tempest-ServersNegativeTestJSON-1381166818 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:11:23.215520 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-a92da598-2c6c-4143-ae3f-7a75554c953b tempest-ServersNegativeTestJSON-1381166818 None] Volume volume-c46c46c9-4865-463e-b891-4cf43955ae33 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:11:23.223490 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-a92da598-2c6c-4143-ae3f-7a75554c953b tempest-ServersNegativeTestJSON-1381166818 None] deleting rbd volume volume-c46c46c9-4865-463e-b891-4cf43955ae33 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:11:23.536090 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-a92da598-2c6c-4143-ae3f-7a75554c953b tempest-ServersNegativeTestJSON-1381166818 None] Created reservations ['6c17bdf8-a25c-4d3a-9020-43d5757cea55', '15732a5a-68c0-43e8-a330-f07af4d36a2a', 'e24ff2fd-aadf-4b1f-b86b-dafe21fc7112', 'bc0a9db1-2d87-45fd-85bc-14baee912348'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:11:23.589363 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-a92da598-2c6c-4143-ae3f-7a75554c953b tempest-ServersNegativeTestJSON-1381166818 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:11:23.619256 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-a92da598-2c6c-4143-ae3f-7a75554c953b tempest-ServersNegativeTestJSON-1381166818 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:11:23.664166 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-a92da598-2c6c-4143-ae3f-7a75554c953b tempest-ServersNegativeTestJSON-1381166818 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:11:23.669712 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-a92da598-2c6c-4143-ae3f-7a75554c953b tempest-ServersNegativeTestJSON-1381166818 None] Deleted volume successfully. Feb 05 21:11:23.683132 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-a92da598-2c6c-4143-ae3f-7a75554c953b tempest-ServersNegativeTestJSON-1381166818 None] Lock "b'cinder-c46c46c9-4865-463e-b891-4cf43955ae33-delete_volume'" released by "delete_volume" :: held 0.542s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:11:24.275755 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-e7798524-a28d-4d76-bc51-6f77cad1561f tempest-ServersNegativeTestJSON-1381166818 None] Lock "b'cinder-0d6a4521-f825-4fa5-a5e5-626cee2ec7f8-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:11:24.315589 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e7798524-a28d-4d76-bc51-6f77cad1561f tempest-ServersNegativeTestJSON-1381166818 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:11:24.351108 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e7798524-a28d-4d76-bc51-6f77cad1561f tempest-ServersNegativeTestJSON-1381166818 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:11:24.351537 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e7798524-a28d-4d76-bc51-6f77cad1561f tempest-ServersNegativeTestJSON-1381166818 None] Volume volume-0d6a4521-f825-4fa5-a5e5-626cee2ec7f8 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:11:24.360119 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e7798524-a28d-4d76-bc51-6f77cad1561f tempest-ServersNegativeTestJSON-1381166818 None] deleting rbd volume volume-0d6a4521-f825-4fa5-a5e5-626cee2ec7f8 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:11:24.452977 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-65df48a6-b0e4-4b61-aff4-fecfdf06fc62 req-74fdffd8-5ad8-4a0b-bdb8-698a5ec15f3f tempest-ServerRescueNegativeTestJSON-1316004756 None] Terminate volume connection completed successfully. Feb 05 21:11:24.453394 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-65df48a6-b0e4-4b61-aff4-fecfdf06fc62 req-74fdffd8-5ad8-4a0b-bdb8-698a5ec15f3f tempest-ServerRescueNegativeTestJSON-1316004756 None] Deleting attachment e013d318-d82d-4f2e-a735-8ff45e75d1a4. {{(pid=122683) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 05 21:11:24.679628 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-e7798524-a28d-4d76-bc51-6f77cad1561f tempest-ServersNegativeTestJSON-1381166818 None] Created reservations ['96dc3034-71b5-4d4d-a570-78dc74f29d80', '7cc9d27f-3188-4994-b379-6a261e3417a5', '914bccf7-51b6-4f5b-81e9-e4a8c3c41709', '41c1956c-4f8d-4126-887f-fddbaed95e9a'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:11:24.720982 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e7798524-a28d-4d76-bc51-6f77cad1561f tempest-ServersNegativeTestJSON-1381166818 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:11:24.745661 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e7798524-a28d-4d76-bc51-6f77cad1561f tempest-ServersNegativeTestJSON-1381166818 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:11:24.770995 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-e7798524-a28d-4d76-bc51-6f77cad1561f tempest-ServersNegativeTestJSON-1381166818 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:11:24.776386 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-e7798524-a28d-4d76-bc51-6f77cad1561f tempest-ServersNegativeTestJSON-1381166818 None] Deleted volume successfully. Feb 05 21:11:24.789250 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-e7798524-a28d-4d76-bc51-6f77cad1561f tempest-ServersNegativeTestJSON-1381166818 None] Lock "b'cinder-0d6a4521-f825-4fa5-a5e5-626cee2ec7f8-delete_volume'" released by "delete_volume" :: held 0.513s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:11:25.095747 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-75bdccae-b8cc-442c-86a5-6b52f25b8ded tempest-ServerRescueNegativeTestJSON-1316004756 None] Lock "b'cinder-f48df254-035f-4cdb-90b5-2796a89c1a42-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:11:25.127925 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-75bdccae-b8cc-442c-86a5-6b52f25b8ded tempest-ServerRescueNegativeTestJSON-1316004756 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:11:25.167872 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-75bdccae-b8cc-442c-86a5-6b52f25b8ded tempest-ServerRescueNegativeTestJSON-1316004756 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:11:25.168500 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-75bdccae-b8cc-442c-86a5-6b52f25b8ded tempest-ServerRescueNegativeTestJSON-1316004756 None] Volume volume-f48df254-035f-4cdb-90b5-2796a89c1a42 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:11:25.177568 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-75bdccae-b8cc-442c-86a5-6b52f25b8ded tempest-ServerRescueNegativeTestJSON-1316004756 None] deleting rbd volume volume-f48df254-035f-4cdb-90b5-2796a89c1a42 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:11:25.468504 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-75bdccae-b8cc-442c-86a5-6b52f25b8ded tempest-ServerRescueNegativeTestJSON-1316004756 None] Created reservations ['4e4df518-c33d-48f1-b934-24491a7573ca', 'e0b48241-1c8e-4109-897c-71663902dd59', '8d3ca75d-7897-4922-9513-9087c310e2a5', 'be45f5fd-971a-4f98-ab26-2134b450e7cc'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:11:25.525356 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-75bdccae-b8cc-442c-86a5-6b52f25b8ded tempest-ServerRescueNegativeTestJSON-1316004756 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:11:25.561761 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-75bdccae-b8cc-442c-86a5-6b52f25b8ded tempest-ServerRescueNegativeTestJSON-1316004756 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:11:25.590583 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-75bdccae-b8cc-442c-86a5-6b52f25b8ded tempest-ServerRescueNegativeTestJSON-1316004756 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:11:25.595002 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-75bdccae-b8cc-442c-86a5-6b52f25b8ded tempest-ServerRescueNegativeTestJSON-1316004756 None] Deleted volume successfully. Feb 05 21:11:25.613878 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-75bdccae-b8cc-442c-86a5-6b52f25b8ded tempest-ServerRescueNegativeTestJSON-1316004756 None] Lock "b'cinder-f48df254-035f-4cdb-90b5-2796a89c1a42-delete_volume'" released by "delete_volume" :: held 0.518s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:11:26.231908 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-4931bc6c-e7de-452c-b289-bf695c743fda tempest-ServerRescueNegativeTestJSON-1316004756 None] Lock "b'cinder-8fdfb2d0-6d85-4059-ab04-b07d4d64ba60-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:11:26.268862 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-4931bc6c-e7de-452c-b289-bf695c743fda tempest-ServerRescueNegativeTestJSON-1316004756 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:11:26.311759 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-4931bc6c-e7de-452c-b289-bf695c743fda tempest-ServerRescueNegativeTestJSON-1316004756 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:11:26.312185 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-4931bc6c-e7de-452c-b289-bf695c743fda tempest-ServerRescueNegativeTestJSON-1316004756 None] Volume volume-8fdfb2d0-6d85-4059-ab04-b07d4d64ba60 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:11:26.320080 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-4931bc6c-e7de-452c-b289-bf695c743fda tempest-ServerRescueNegativeTestJSON-1316004756 None] deleting rbd volume volume-8fdfb2d0-6d85-4059-ab04-b07d4d64ba60 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:11:26.615038 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-4931bc6c-e7de-452c-b289-bf695c743fda tempest-ServerRescueNegativeTestJSON-1316004756 None] Created reservations ['2f7ad3c8-3e43-4b7e-972f-ddfc38ee21da', '03dba736-1645-4591-8f3c-ceea8e32a344', '8c855f9c-3a5e-43c5-9b59-8cc29ec1d4f3', '06e44fdb-cf42-4f4d-8b7c-022e5e8e9dc4'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:11:26.659519 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-4931bc6c-e7de-452c-b289-bf695c743fda tempest-ServerRescueNegativeTestJSON-1316004756 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:11:26.689303 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-4931bc6c-e7de-452c-b289-bf695c743fda tempest-ServerRescueNegativeTestJSON-1316004756 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:11:26.712651 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-4931bc6c-e7de-452c-b289-bf695c743fda tempest-ServerRescueNegativeTestJSON-1316004756 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:11:26.721025 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-4931bc6c-e7de-452c-b289-bf695c743fda tempest-ServerRescueNegativeTestJSON-1316004756 None] Deleted volume successfully. Feb 05 21:11:26.734406 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-4931bc6c-e7de-452c-b289-bf695c743fda tempest-ServerRescueNegativeTestJSON-1316004756 None] Lock "b'cinder-8fdfb2d0-6d85-4059-ab04-b07d4d64ba60-delete_volume'" released by "delete_volume" :: held 0.503s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:11:28.950983 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-834054e4-2279-4068-aa84-8a941e686f4e tempest-VolumesSnapshotTestJSON-1761633007 None] Created reservations ['404fc269-efd8-47e1-88c1-3a5f53b56461', '7b1adf1b-6753-4615-b55b-eb6975f4068a', 'ff0296a9-5086-4bb8-af20-8126fa292185', '75c72f57-60d8-403e-b2ad-39f39f70b523'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:11:28.987641 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-834054e4-2279-4068-aa84-8a941e686f4e tempest-VolumesSnapshotTestJSON-1761633007 None] Delete snapshot completed successfully. Feb 05 21:11:28.992050 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-834054e4-2279-4068-aa84-8a941e686f4e tempest-VolumesSnapshotTestJSON-1761633007 None] Lock "b'cinder-a1808b98-1e82-4ae0-99c9-0a82ec1a0e41-delete_snapshot'" released by "delete_snapshot" :: held 30.235s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:11:29.694705 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-2bf2b88a-a796-4b33-b38a-0e3e2f1e8a35 tempest-VolumesSnapshotTestJSON-1761633007 None] Lock "b'cinder-f87310b5-d9d1-449a-8312-ad9671112da2-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.019s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:11:29.699174 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-2bf2b88a-a796-4b33-b38a-0e3e2f1e8a35 tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:11:52.689023 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:11:52.689904 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:11:52.722116 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:11:52.752388 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:11:55.659601 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3393459-36e3-42dd-9c66-f6533f6253f8 tempest-AttachVolumeShelveTestJSON-1952389738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:11:55.663348 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-f3393459-36e3-42dd-9c66-f6533f6253f8 tempest-AttachVolumeShelveTestJSON-1952389738 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:11:55.663838 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-f3393459-36e3-42dd-9c66-f6533f6253f8 tempest-AttachVolumeShelveTestJSON-1952389738 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:11:55.712560 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-f3393459-36e3-42dd-9c66-f6533f6253f8 tempest-AttachVolumeShelveTestJSON-1952389738 None] Flow 'volume_create_manager' (8481d6c4-12ec-42ea-ac3f-91ce0b093564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:11:55.719403 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-f3393459-36e3-42dd-9c66-f6533f6253f8 tempest-AttachVolumeShelveTestJSON-1952389738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (639523fe-16ad-4d4c-8a9b-1137e0f1c7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:11:55.726187 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-f3393459-36e3-42dd-9c66-f6533f6253f8 tempest-AttachVolumeShelveTestJSON-1952389738 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:11:55.744910 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-f3393459-36e3-42dd-9c66-f6533f6253f8 tempest-AttachVolumeShelveTestJSON-1952389738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (639523fe-16ad-4d4c-8a9b-1137e0f1c7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1077275307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b093fb5f-d647-4b97-a068-532afc9faa5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2af23abad4048358818a1b4ba0f5aa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:11:56Z,use_quota=True,user_id='e8ace6d411c247d6bbb7ca533da72ce7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:11:55.750507 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-f3393459-36e3-42dd-9c66-f6533f6253f8 tempest-AttachVolumeShelveTestJSON-1952389738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bfc086a-4bd8-4460-a715-ca1e8710ce4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:11:55.754706 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-f3393459-36e3-42dd-9c66-f6533f6253f8 tempest-AttachVolumeShelveTestJSON-1952389738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bfc086a-4bd8-4460-a715-ca1e8710ce4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:11:55.760549 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-f3393459-36e3-42dd-9c66-f6533f6253f8 tempest-AttachVolumeShelveTestJSON-1952389738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5629622d-0fbc-4455-964c-692241d21440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:11:55.765102 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-f3393459-36e3-42dd-9c66-f6533f6253f8 tempest-AttachVolumeShelveTestJSON-1952389738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5629622d-0fbc-4455-964c-692241d21440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b093fb5f-d647-4b97-a068-532afc9faa5b', 'volume_name': 'volume-b093fb5f-d647-4b97-a068-532afc9faa5b', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:11:55.770674 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-f3393459-36e3-42dd-9c66-f6533f6253f8 tempest-AttachVolumeShelveTestJSON-1952389738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc46459e-3f17-46c5-8ba3-7b88897d1372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:11:55.775943 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-f3393459-36e3-42dd-9c66-f6533f6253f8 tempest-AttachVolumeShelveTestJSON-1952389738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc46459e-3f17-46c5-8ba3-7b88897d1372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:11:55.780945 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-f3393459-36e3-42dd-9c66-f6533f6253f8 tempest-AttachVolumeShelveTestJSON-1952389738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (597d7d2f-f64b-4179-a445-7520aeb033a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:11:55.782059 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-f3393459-36e3-42dd-9c66-f6533f6253f8 tempest-AttachVolumeShelveTestJSON-1952389738 None] Volume b093fb5f-d647-4b97-a068-532afc9faa5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b093fb5f-d647-4b97-a068-532afc9faa5b', 'volume_size': 1} Feb 05 21:11:55.782485 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-f3393459-36e3-42dd-9c66-f6533f6253f8 tempest-AttachVolumeShelveTestJSON-1952389738 None] creating volume 'volume-b093fb5f-d647-4b97-a068-532afc9faa5b' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:11:55.783479 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-f3393459-36e3-42dd-9c66-f6533f6253f8 tempest-AttachVolumeShelveTestJSON-1952389738 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:11:55.841756 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-f3393459-36e3-42dd-9c66-f6533f6253f8 tempest-AttachVolumeShelveTestJSON-1952389738 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:11:55.842136 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-f3393459-36e3-42dd-9c66-f6533f6253f8 tempest-AttachVolumeShelveTestJSON-1952389738 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:11:55.845916 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-f3393459-36e3-42dd-9c66-f6533f6253f8 tempest-AttachVolumeShelveTestJSON-1952389738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (597d7d2f-f64b-4179-a445-7520aeb033a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b093fb5f-d647-4b97-a068-532afc9faa5b', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:11:55.850766 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-f3393459-36e3-42dd-9c66-f6533f6253f8 tempest-AttachVolumeShelveTestJSON-1952389738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94f74e3a-21fa-4871-9dc9-5153a3d80340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:11:55.861037 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-f3393459-36e3-42dd-9c66-f6533f6253f8 tempest-AttachVolumeShelveTestJSON-1952389738 None] Volume volume-b093fb5f-d647-4b97-a068-532afc9faa5b (b093fb5f-d647-4b97-a068-532afc9faa5b): created successfully Feb 05 21:11:55.864787 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-f3393459-36e3-42dd-9c66-f6533f6253f8 tempest-AttachVolumeShelveTestJSON-1952389738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94f74e3a-21fa-4871-9dc9-5153a3d80340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:11:55.870988 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-f3393459-36e3-42dd-9c66-f6533f6253f8 tempest-AttachVolumeShelveTestJSON-1952389738 None] Flow 'volume_create_manager' (8481d6c4-12ec-42ea-ac3f-91ce0b093564) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:11:55.880090 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-f3393459-36e3-42dd-9c66-f6533f6253f8 tempest-AttachVolumeShelveTestJSON-1952389738 None] Created volume successfully. Feb 05 21:11:59.888797 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-2bf2b88a-a796-4b33-b38a-0e3e2f1e8a35 tempest-VolumesSnapshotTestJSON-1761633007 None] Created reservations ['972800e3-8231-4c32-a4d1-1b00b151ab3d', 'e84acc39-90d7-49e6-a614-55da61a99f4c', 'a499a497-f318-4b79-8312-9137c1b6d2fe', '40970935-03ce-40b8-a064-f450ae37e54d'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:11:59.930285 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-2bf2b88a-a796-4b33-b38a-0e3e2f1e8a35 tempest-VolumesSnapshotTestJSON-1761633007 None] Delete snapshot completed successfully. Feb 05 21:11:59.935005 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-2bf2b88a-a796-4b33-b38a-0e3e2f1e8a35 tempest-VolumesSnapshotTestJSON-1761633007 None] Lock "b'cinder-f87310b5-d9d1-449a-8312-ad9671112da2-delete_snapshot'" released by "delete_snapshot" :: held 30.240s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:12:01.443800 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-eed228f8-5389-452e-9933-c5132a09660c req-0b4f306e-7ba6-4ccd-9868-59ed252e35d5 tempest-VolumesSnapshotTestJSON-1761633007 None] Terminate volume connection completed successfully. Feb 05 21:12:01.444412 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-eed228f8-5389-452e-9933-c5132a09660c req-0b4f306e-7ba6-4ccd-9868-59ed252e35d5 tempest-VolumesSnapshotTestJSON-1761633007 None] Deleting attachment 70841f5d-b67f-462f-a540-07b45e12cc7a. {{(pid=122683) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 05 21:12:04.654520 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-96d81577-9d7f-4e63-a975-ef2bf7eb6eb2 tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:12:05.337230 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-96d81577-9d7f-4e63-a975-ef2bf7eb6eb2 tempest-VolumesSnapshotTestJSON-1761633007 None] Create snapshot completed successfully Feb 05 21:12:05.861515 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-5aabbe24-7930-420c-84b9-8dfe2ac74d67 tempest-VolumesSnapshotTestJSON-1761633007 None] Lock "b'cinder-302d8a3a-3542-4704-be11-68d745717187-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:12:05.863754 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5aabbe24-7930-420c-84b9-8dfe2ac74d67 tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:12:06.393813 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-5aabbe24-7930-420c-84b9-8dfe2ac74d67 tempest-VolumesSnapshotTestJSON-1761633007 None] Created reservations ['1594feb7-b1fd-4a5c-8f8e-5759f230885b', '97356362-e2a6-40a3-bb20-efad9e902896', '10d921e7-1ab8-43e0-ad71-4dbebab5cbb4', '01762742-0885-47c6-84a7-34a7f83e8938'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:12:06.442962 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-5aabbe24-7930-420c-84b9-8dfe2ac74d67 tempest-VolumesSnapshotTestJSON-1761633007 None] Delete snapshot completed successfully. Feb 05 21:12:06.457123 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-5aabbe24-7930-420c-84b9-8dfe2ac74d67 tempest-VolumesSnapshotTestJSON-1761633007 None] Lock "b'cinder-302d8a3a-3542-4704-be11-68d745717187-delete_snapshot'" released by "delete_snapshot" :: held 0.595s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:12:07.127900 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-30e7a50c-4076-42a8-b0dd-3d9119c0da75 tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:12:07.365509 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-30e7a50c-4076-42a8-b0dd-3d9119c0da75 tempest-VolumesSnapshotTestJSON-1761633007 None] Create snapshot completed successfully Feb 05 21:12:17.616531 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e8217e3c-9da3-4fc1-99ec-6ad512ca151a tempest-TestVolumeBootPattern-571902767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:12:18.367001 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-e8217e3c-9da3-4fc1-99ec-6ad512ca151a tempest-TestVolumeBootPattern-571902767 None] Create snapshot completed successfully Feb 05 21:12:19.047790 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-da2110bc-c2ed-486b-96a3-4ff5522d22bb tempest-TestVolumeBootPattern-571902767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:12:19.052217 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-da2110bc-c2ed-486b-96a3-4ff5522d22bb tempest-TestVolumeBootPattern-571902767 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:12:19.052672 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-da2110bc-c2ed-486b-96a3-4ff5522d22bb tempest-TestVolumeBootPattern-571902767 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:12:19.088359 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-da2110bc-c2ed-486b-96a3-4ff5522d22bb tempest-TestVolumeBootPattern-571902767 None] Flow 'volume_create_manager' (3fa21128-a7ba-4add-8c3e-081b5d93b833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:12:19.095585 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-da2110bc-c2ed-486b-96a3-4ff5522d22bb tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bb6ef14-9174-4bdf-8022-d921da1d9120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:12:19.104187 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-da2110bc-c2ed-486b-96a3-4ff5522d22bb tempest-TestVolumeBootPattern-571902767 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:12:19.119142 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-da2110bc-c2ed-486b-96a3-4ff5522d22bb tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bb6ef14-9174-4bdf-8022-d921da1d9120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-2017930566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9db3567a-f3e3-45e6-99f4-0de39787a5cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af1c8d8fd0ce4d51947fd02afc3a9fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=89d44f58-cf24-4c84-b194-449478786291,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:12:19Z,use_quota=True,user_id='2a43cfedc8824ef8a0dd76c24ed654c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:12:19.124694 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-da2110bc-c2ed-486b-96a3-4ff5522d22bb tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dacd6971-dbcc-48bc-b863-2aad8c229086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:12:19.128916 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-da2110bc-c2ed-486b-96a3-4ff5522d22bb tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dacd6971-dbcc-48bc-b863-2aad8c229086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:12:19.134243 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-da2110bc-c2ed-486b-96a3-4ff5522d22bb tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (002bf1e6-3dab-4458-874c-a3eaf7b975da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:12:19.138505 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-da2110bc-c2ed-486b-96a3-4ff5522d22bb tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (002bf1e6-3dab-4458-874c-a3eaf7b975da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9db3567a-f3e3-45e6-99f4-0de39787a5cc', 'volume_name': 'volume-9db3567a-f3e3-45e6-99f4-0de39787a5cc', 'volume_size': 1, 'snapshot_id': '89d44f58-cf24-4c84-b194-449478786291'}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:12:19.143570 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-da2110bc-c2ed-486b-96a3-4ff5522d22bb tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81d38c26-f422-48cb-8240-0fc249240988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:12:19.148337 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-da2110bc-c2ed-486b-96a3-4ff5522d22bb tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81d38c26-f422-48cb-8240-0fc249240988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:12:19.153687 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-da2110bc-c2ed-486b-96a3-4ff5522d22bb tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fbf9500-c6f1-48a9-9404-646dd7732c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:12:19.154826 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-da2110bc-c2ed-486b-96a3-4ff5522d22bb tempest-TestVolumeBootPattern-571902767 None] Volume 9db3567a-f3e3-45e6-99f4-0de39787a5cc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9db3567a-f3e3-45e6-99f4-0de39787a5cc', 'volume_size': 1, 'snapshot_id': '89d44f58-cf24-4c84-b194-449478786291'} Feb 05 21:12:19.176487 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-da2110bc-c2ed-486b-96a3-4ff5522d22bb tempest-TestVolumeBootPattern-571902767 None] cloning volumes/volume-882c36fd-3df2-4b63-92a4-d96715cad128@snapshot-89d44f58-cf24-4c84-b194-449478786291 to volume-9db3567a-f3e3-45e6-99f4-0de39787a5cc {{(pid=122683) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Feb 05 21:12:19.177429 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-da2110bc-c2ed-486b-96a3-4ff5522d22bb tempest-TestVolumeBootPattern-571902767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:12:19.240555 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-da2110bc-c2ed-486b-96a3-4ff5522d22bb tempest-TestVolumeBootPattern-571902767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:12:19.372697 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-da2110bc-c2ed-486b-96a3-4ff5522d22bb tempest-TestVolumeBootPattern-571902767 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:12:19.373003 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-da2110bc-c2ed-486b-96a3-4ff5522d22bb tempest-TestVolumeBootPattern-571902767 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:12:19.397052 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.volume_utils [None req-da2110bc-c2ed-486b-96a3-4ff5522d22bb tempest-TestVolumeBootPattern-571902767 None] Marking volume 9db3567a-f3e3-45e6-99f4-0de39787a5cc as bootable. {{(pid=122683) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Feb 05 21:12:19.402679 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-da2110bc-c2ed-486b-96a3-4ff5522d22bb tempest-TestVolumeBootPattern-571902767 None] Copying metadata from snapshot 89d44f58-cf24-4c84-b194-449478786291 to 9db3567a-f3e3-45e6-99f4-0de39787a5cc. {{(pid=122683) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:422}} Feb 05 21:12:19.438203 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-da2110bc-c2ed-486b-96a3-4ff5522d22bb tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fbf9500-c6f1-48a9-9404-646dd7732c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9db3567a-f3e3-45e6-99f4-0de39787a5cc', 'volume_size': 1, 'snapshot_id': '89d44f58-cf24-4c84-b194-449478786291'}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:12:19.443760 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-da2110bc-c2ed-486b-96a3-4ff5522d22bb tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89139882-e839-46e6-bba0-3555e11a2d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:12:19.453577 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-da2110bc-c2ed-486b-96a3-4ff5522d22bb tempest-TestVolumeBootPattern-571902767 None] Volume volume-9db3567a-f3e3-45e6-99f4-0de39787a5cc (9db3567a-f3e3-45e6-99f4-0de39787a5cc): created successfully Feb 05 21:12:19.457377 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-da2110bc-c2ed-486b-96a3-4ff5522d22bb tempest-TestVolumeBootPattern-571902767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89139882-e839-46e6-bba0-3555e11a2d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:12:19.463862 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-da2110bc-c2ed-486b-96a3-4ff5522d22bb tempest-TestVolumeBootPattern-571902767 None] Flow 'volume_create_manager' (3fa21128-a7ba-4add-8c3e-081b5d93b833) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:12:19.477440 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-da2110bc-c2ed-486b-96a3-4ff5522d22bb tempest-TestVolumeBootPattern-571902767 None] Created volume successfully. Feb 05 21:12:21.446545 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-007a0781-05e4-4a28-b23e-1aea2ed948c4 req-cc7ddf92-8aef-4e2d-a89b-464892309ffe tempest-VolumesSnapshotTestJSON-1761633007 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 21:12:22.223755 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-007a0781-05e4-4a28-b23e-1aea2ed948c4 req-cc7ddf92-8aef-4e2d-a89b-464892309ffe tempest-VolumesSnapshotTestJSON-1761633007 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.777s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 21:12:22.225101 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-007a0781-05e4-4a28-b23e-1aea2ed948c4 req-cc7ddf92-8aef-4e2d-a89b-464892309ffe tempest-VolumesSnapshotTestJSON-1761633007 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-419ad4d0-6b45-4fb7-9e6f-920b37e4a0ea', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': '419ad4d0-6b45-4fb7-9e6f-920b37e4a0ea', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 21:12:22.247668 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-a30d7eba-73f2-4525-b72a-789bb42d3c40 req-2abb4109-3c13-4b76-9bcf-f344e358dc39 tempest-TestVolumeBootPattern-571902767 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 21:12:22.285269 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-007a0781-05e4-4a28-b23e-1aea2ed948c4 req-cc7ddf92-8aef-4e2d-a89b-464892309ffe tempest-VolumesSnapshotTestJSON-1761633007 None] Connection info returned from driver {'name': 'volumes/volume-419ad4d0-6b45-4fb7-9e6f-920b37e4a0ea', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '419ad4d0-6b45-4fb7-9e6f-920b37e4a0ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '5b9ee519-9609-4465-a557-876952a39e35'} {{(pid=122683) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 05 21:12:22.365333 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-007a0781-05e4-4a28-b23e-1aea2ed948c4 req-cc7ddf92-8aef-4e2d-a89b-464892309ffe tempest-VolumesSnapshotTestJSON-1761633007 None] attachment_update completed successfully. Feb 05 21:12:23.175842 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-a30d7eba-73f2-4525-b72a-789bb42d3c40 req-2abb4109-3c13-4b76-9bcf-f344e358dc39 tempest-TestVolumeBootPattern-571902767 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.928s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 21:12:23.177385 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-a30d7eba-73f2-4525-b72a-789bb42d3c40 req-2abb4109-3c13-4b76-9bcf-f344e358dc39 tempest-TestVolumeBootPattern-571902767 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9db3567a-f3e3-45e6-99f4-0de39787a5cc', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': '9db3567a-f3e3-45e6-99f4-0de39787a5cc', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 21:12:23.210253 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-a30d7eba-73f2-4525-b72a-789bb42d3c40 req-2abb4109-3c13-4b76-9bcf-f344e358dc39 tempest-TestVolumeBootPattern-571902767 None] Connection info returned from driver {'name': 'volumes/volume-9db3567a-f3e3-45e6-99f4-0de39787a5cc', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '9db3567a-f3e3-45e6-99f4-0de39787a5cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '61ecb50e-10fe-4ff3-983e-5da5d9eeaa8c'} {{(pid=122683) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 05 21:12:23.285869 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-a30d7eba-73f2-4525-b72a-789bb42d3c40 req-2abb4109-3c13-4b76-9bcf-f344e358dc39 tempest-TestVolumeBootPattern-571902767 None] attachment_update completed successfully. Feb 05 21:12:25.060280 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-67989d34-9ebe-4213-9871-5f2c94d761f1 tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:12:25.443780 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-67989d34-9ebe-4213-9871-5f2c94d761f1 tempest-VolumesSnapshotTestJSON-1761633007 None] Create snapshot completed successfully Feb 05 21:12:26.198782 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-f427fc30-a39f-48dd-8a83-0b8811608d9a tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:12:26.447461 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-f427fc30-a39f-48dd-8a83-0b8811608d9a tempest-VolumesSnapshotTestJSON-1761633007 None] Create snapshot completed successfully Feb 05 21:12:27.309007 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-ac278fac-b4bc-46e0-aa73-f67c4ec3f554 tempest-VolumesSnapshotTestJSON-1761633007 None] Lock "b'cinder-413a70b6-faf7-4c0a-b2f7-3014a75abcf5-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.017s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:12:27.310685 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ac278fac-b4bc-46e0-aa73-f67c4ec3f554 tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:12:52.692972 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:12:52.694672 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:12:52.765080 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:12:52.837558 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:12:57.501648 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-ac278fac-b4bc-46e0-aa73-f67c4ec3f554 tempest-VolumesSnapshotTestJSON-1761633007 None] Created reservations ['49782a04-dab5-477f-9fb7-3b82a615e318', 'd0e73530-2531-4e36-8798-52c98a72970e', 'cd6ec303-871d-4713-8742-648153d423f5', '7931c9ae-3062-463b-af85-86f23ed08f7c'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:12:57.552175 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-ac278fac-b4bc-46e0-aa73-f67c4ec3f554 tempest-VolumesSnapshotTestJSON-1761633007 None] Delete snapshot completed successfully. Feb 05 21:12:57.558678 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-ac278fac-b4bc-46e0-aa73-f67c4ec3f554 tempest-VolumesSnapshotTestJSON-1761633007 None] Lock "b'cinder-413a70b6-faf7-4c0a-b2f7-3014a75abcf5-delete_snapshot'" released by "delete_snapshot" :: held 30.249s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:12:58.327845 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-3edd9df3-61be-4c60-b829-77a674367f0e tempest-VolumesSnapshotTestJSON-1761633007 None] Lock "b'cinder-72c16f4c-303b-4435-b237-40fce734416b-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.028s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:12:58.330905 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3edd9df3-61be-4c60-b829-77a674367f0e tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:13:28.593330 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-3edd9df3-61be-4c60-b829-77a674367f0e tempest-VolumesSnapshotTestJSON-1761633007 None] Created reservations ['f2d6986b-040c-4cca-a336-398570192696', '7c7c965e-0bab-4569-8a94-bbe3e8a6f09b', 'c6f36107-26ef-4ecc-bc33-674804187d72', '7cbb42fa-0073-45d3-900b-1af784186441'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:13:28.654812 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-3edd9df3-61be-4c60-b829-77a674367f0e tempest-VolumesSnapshotTestJSON-1761633007 None] Delete snapshot completed successfully. Feb 05 21:13:28.664690 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-3edd9df3-61be-4c60-b829-77a674367f0e tempest-VolumesSnapshotTestJSON-1761633007 None] Lock "b'cinder-72c16f4c-303b-4435-b237-40fce734416b-delete_snapshot'" released by "delete_snapshot" :: held 30.336s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:13:29.675327 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-5a74e80c-cafc-4df8-a9b6-f01bb3f4d904 tempest-VolumesSnapshotTestJSON-1761633007 None] Lock "b'cinder-87a80b0a-ade6-4860-a89e-c4605cd7efbf-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.020s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:13:29.677540 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5a74e80c-cafc-4df8-a9b6-f01bb3f4d904 tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:13:47.093711 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-e317a011-014d-49cd-8514-7faa0c22b87a req-960ed3fd-0c01-4842-84ec-25e10be200b3 tempest-AttachVolumeShelveTestJSON-1952389738 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 21:13:47.785398 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-e317a011-014d-49cd-8514-7faa0c22b87a req-960ed3fd-0c01-4842-84ec-25e10be200b3 tempest-AttachVolumeShelveTestJSON-1952389738 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.690s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 21:13:47.787275 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-e317a011-014d-49cd-8514-7faa0c22b87a req-960ed3fd-0c01-4842-84ec-25e10be200b3 tempest-AttachVolumeShelveTestJSON-1952389738 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b093fb5f-d647-4b97-a068-532afc9faa5b', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': 'b093fb5f-d647-4b97-a068-532afc9faa5b', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 21:13:47.819252 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-e317a011-014d-49cd-8514-7faa0c22b87a req-960ed3fd-0c01-4842-84ec-25e10be200b3 tempest-AttachVolumeShelveTestJSON-1952389738 None] Connection info returned from driver {'name': 'volumes/volume-b093fb5f-d647-4b97-a068-532afc9faa5b', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'b093fb5f-d647-4b97-a068-532afc9faa5b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0553eb3d-c674-454c-86bd-3dc2ee607455'} {{(pid=122683) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 05 21:13:47.889511 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-e317a011-014d-49cd-8514-7faa0c22b87a req-960ed3fd-0c01-4842-84ec-25e10be200b3 tempest-AttachVolumeShelveTestJSON-1952389738 None] attachment_update completed successfully. Feb 05 21:13:52.692658 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:13:52.695253 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:13:52.768224 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:13:52.837850 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:13:59.991024 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-5a74e80c-cafc-4df8-a9b6-f01bb3f4d904 tempest-VolumesSnapshotTestJSON-1761633007 None] Created reservations ['e5517072-2c4c-44f8-9372-02326d1278d3', '8f0f1add-f44a-4bda-9b9a-7eecd8a3d367', '229dea99-9408-40d9-aacb-9ffecd484a2b', '362ae509-15ba-4376-96f4-523f2697644b'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:14:00.124233 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-5a74e80c-cafc-4df8-a9b6-f01bb3f4d904 tempest-VolumesSnapshotTestJSON-1761633007 None] Delete snapshot completed successfully. Feb 05 21:14:00.133482 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-5a74e80c-cafc-4df8-a9b6-f01bb3f4d904 tempest-VolumesSnapshotTestJSON-1761633007 None] Lock "b'cinder-87a80b0a-ade6-4860-a89e-c4605cd7efbf-delete_snapshot'" released by "delete_snapshot" :: held 30.458s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:14:02.302535 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-14ce9604-444c-42f5-b86a-ed68eac8822d req-69b549e4-b696-4523-a1c4-39e449a072b1 tempest-VolumesSnapshotTestJSON-1761633007 None] Terminate volume connection completed successfully. Feb 05 21:14:02.303843 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-14ce9604-444c-42f5-b86a-ed68eac8822d req-69b549e4-b696-4523-a1c4-39e449a072b1 tempest-VolumesSnapshotTestJSON-1761633007 None] Deleting attachment 5b9ee519-9609-4465-a557-876952a39e35. {{(pid=122683) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 05 21:14:08.467508 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-44638b27-d03c-4eba-8dce-2d051afe5f99 tempest-VolumesSnapshotTestJSON-1761633007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:14:08.474629 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-44638b27-d03c-4eba-8dce-2d051afe5f99 tempest-VolumesSnapshotTestJSON-1761633007 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:14:08.475406 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-44638b27-d03c-4eba-8dce-2d051afe5f99 tempest-VolumesSnapshotTestJSON-1761633007 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:14:08.498391 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-44638b27-d03c-4eba-8dce-2d051afe5f99 tempest-VolumesSnapshotTestJSON-1761633007 None] Flow 'volume_create_manager' (69fdfa17-01f9-49bb-9c7e-16c03f2b2c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:14:08.506890 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-44638b27-d03c-4eba-8dce-2d051afe5f99 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c98b66c-796b-4180-95db-edd5d0c227bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:08.514103 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-44638b27-d03c-4eba-8dce-2d051afe5f99 tempest-VolumesSnapshotTestJSON-1761633007 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:14:08.534181 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-44638b27-d03c-4eba-8dce-2d051afe5f99 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c98b66c-796b-4180-95db-edd5d0c227bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-974559954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2be222d4-a9aa-49bd-a9ba-178e44bfc55b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c04615402925462792ca03f711db23c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:14:08Z,use_quota=True,user_id='6682477b172d460881a96d68f6bd053c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:08.539851 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-44638b27-d03c-4eba-8dce-2d051afe5f99 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6693d7a6-a4e3-4e6d-a6b9-24765b305999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:08.544487 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-44638b27-d03c-4eba-8dce-2d051afe5f99 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6693d7a6-a4e3-4e6d-a6b9-24765b305999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:08.556992 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-44638b27-d03c-4eba-8dce-2d051afe5f99 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a829a219-ee99-4e26-8d85-5bcd93af7311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:08.562099 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-44638b27-d03c-4eba-8dce-2d051afe5f99 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a829a219-ee99-4e26-8d85-5bcd93af7311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2be222d4-a9aa-49bd-a9ba-178e44bfc55b', 'volume_name': 'volume-2be222d4-a9aa-49bd-a9ba-178e44bfc55b', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:08.567787 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-44638b27-d03c-4eba-8dce-2d051afe5f99 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c96329-882b-4f01-92f8-b9ca89720e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:08.572103 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-44638b27-d03c-4eba-8dce-2d051afe5f99 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c96329-882b-4f01-92f8-b9ca89720e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:08.578563 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-44638b27-d03c-4eba-8dce-2d051afe5f99 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33a04c55-79c4-456e-8856-4d58cd1d876f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:08.579596 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-44638b27-d03c-4eba-8dce-2d051afe5f99 tempest-VolumesSnapshotTestJSON-1761633007 None] Volume 2be222d4-a9aa-49bd-a9ba-178e44bfc55b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2be222d4-a9aa-49bd-a9ba-178e44bfc55b', 'volume_size': 1} Feb 05 21:14:08.580181 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-44638b27-d03c-4eba-8dce-2d051afe5f99 tempest-VolumesSnapshotTestJSON-1761633007 None] creating volume 'volume-2be222d4-a9aa-49bd-a9ba-178e44bfc55b' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:14:08.582027 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-44638b27-d03c-4eba-8dce-2d051afe5f99 tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:08.659411 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-44638b27-d03c-4eba-8dce-2d051afe5f99 tempest-VolumesSnapshotTestJSON-1761633007 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:14:08.659886 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-44638b27-d03c-4eba-8dce-2d051afe5f99 tempest-VolumesSnapshotTestJSON-1761633007 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:14:08.668439 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-44638b27-d03c-4eba-8dce-2d051afe5f99 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33a04c55-79c4-456e-8856-4d58cd1d876f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2be222d4-a9aa-49bd-a9ba-178e44bfc55b', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:08.677715 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-44638b27-d03c-4eba-8dce-2d051afe5f99 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec8da1c9-8a01-465d-9709-f55e1c5915e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:08.686948 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-44638b27-d03c-4eba-8dce-2d051afe5f99 tempest-VolumesSnapshotTestJSON-1761633007 None] Volume volume-2be222d4-a9aa-49bd-a9ba-178e44bfc55b (2be222d4-a9aa-49bd-a9ba-178e44bfc55b): created successfully Feb 05 21:14:08.692059 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-44638b27-d03c-4eba-8dce-2d051afe5f99 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec8da1c9-8a01-465d-9709-f55e1c5915e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:08.698652 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-44638b27-d03c-4eba-8dce-2d051afe5f99 tempest-VolumesSnapshotTestJSON-1761633007 None] Flow 'volume_create_manager' (69fdfa17-01f9-49bb-9c7e-16c03f2b2c07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:14:08.710465 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-44638b27-d03c-4eba-8dce-2d051afe5f99 tempest-VolumesSnapshotTestJSON-1761633007 None] Created volume successfully. Feb 05 21:14:09.629479 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-cf8044b7-5f98-4c69-b1df-8d5e12a6b9cd tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:09.989322 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-cf8044b7-5f98-4c69-b1df-8d5e12a6b9cd tempest-VolumesSnapshotTestJSON-1761633007 None] Create snapshot completed successfully Feb 05 21:14:11.243630 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4ea2349-4e23-41e5-9afc-16cec26a89e3 tempest-VolumesSnapshotTestJSON-1761633007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:14:11.248495 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-c4ea2349-4e23-41e5-9afc-16cec26a89e3 tempest-VolumesSnapshotTestJSON-1761633007 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:14:11.249038 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-c4ea2349-4e23-41e5-9afc-16cec26a89e3 tempest-VolumesSnapshotTestJSON-1761633007 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:14:11.293354 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-c4ea2349-4e23-41e5-9afc-16cec26a89e3 tempest-VolumesSnapshotTestJSON-1761633007 None] Flow 'volume_create_manager' (2d48ec07-ff7c-457f-afcc-310f77bd2878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:14:11.301148 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-c4ea2349-4e23-41e5-9afc-16cec26a89e3 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ba69d73-9647-4a17-adc5-ab4c2a490afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:11.307881 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-c4ea2349-4e23-41e5-9afc-16cec26a89e3 tempest-VolumesSnapshotTestJSON-1761633007 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:14:11.324868 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-c4ea2349-4e23-41e5-9afc-16cec26a89e3 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ba69d73-9647-4a17-adc5-ab4c2a490afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-573665912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=207e6102-29a7-4625-a416-704d1efe82a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c04615402925462792ca03f711db23c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:14:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=c6bef1fe-f6d1-4549-8c66-68fa64ad737f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:14:11Z,use_quota=True,user_id='6682477b172d460881a96d68f6bd053c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:11.331111 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-c4ea2349-4e23-41e5-9afc-16cec26a89e3 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba816aac-38b8-4db4-a149-3bde5aaadde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:11.335803 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-c4ea2349-4e23-41e5-9afc-16cec26a89e3 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba816aac-38b8-4db4-a149-3bde5aaadde0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:11.345047 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-c4ea2349-4e23-41e5-9afc-16cec26a89e3 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f732332a-2421-4432-82c8-2c5255197b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:11.350522 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-c4ea2349-4e23-41e5-9afc-16cec26a89e3 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f732332a-2421-4432-82c8-2c5255197b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '207e6102-29a7-4625-a416-704d1efe82a1', 'volume_name': 'volume-207e6102-29a7-4625-a416-704d1efe82a1', 'volume_size': 2, 'snapshot_id': 'c6bef1fe-f6d1-4549-8c66-68fa64ad737f'}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:11.356367 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-c4ea2349-4e23-41e5-9afc-16cec26a89e3 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acf16318-500f-4b6d-b9b2-bf776dab3664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:11.360724 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-c4ea2349-4e23-41e5-9afc-16cec26a89e3 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acf16318-500f-4b6d-b9b2-bf776dab3664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:11.366058 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-c4ea2349-4e23-41e5-9afc-16cec26a89e3 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85de6913-413a-4808-baa6-cca363ee8287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:11.367197 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-c4ea2349-4e23-41e5-9afc-16cec26a89e3 tempest-VolumesSnapshotTestJSON-1761633007 None] Volume 207e6102-29a7-4625-a416-704d1efe82a1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-207e6102-29a7-4625-a416-704d1efe82a1', 'volume_size': 2, 'snapshot_id': 'c6bef1fe-f6d1-4549-8c66-68fa64ad737f'} Feb 05 21:14:11.393880 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c4ea2349-4e23-41e5-9afc-16cec26a89e3 tempest-VolumesSnapshotTestJSON-1761633007 None] cloning volumes/volume-2be222d4-a9aa-49bd-a9ba-178e44bfc55b@snapshot-c6bef1fe-f6d1-4549-8c66-68fa64ad737f to volume-207e6102-29a7-4625-a416-704d1efe82a1 {{(pid=122683) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Feb 05 21:14:11.395510 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c4ea2349-4e23-41e5-9afc-16cec26a89e3 tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:11.452080 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c4ea2349-4e23-41e5-9afc-16cec26a89e3 tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:11.617923 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c4ea2349-4e23-41e5-9afc-16cec26a89e3 tempest-VolumesSnapshotTestJSON-1761633007 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:14:11.618700 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c4ea2349-4e23-41e5-9afc-16cec26a89e3 tempest-VolumesSnapshotTestJSON-1761633007 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:14:11.625360 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c4ea2349-4e23-41e5-9afc-16cec26a89e3 tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:11.777367 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-c4ea2349-4e23-41e5-9afc-16cec26a89e3 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85de6913-413a-4808-baa6-cca363ee8287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-207e6102-29a7-4625-a416-704d1efe82a1', 'volume_size': 2, 'snapshot_id': 'c6bef1fe-f6d1-4549-8c66-68fa64ad737f'}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:11.783381 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-c4ea2349-4e23-41e5-9afc-16cec26a89e3 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc6b9b8b-4d9a-408a-b12f-717a19ecd1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:11.795424 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-c4ea2349-4e23-41e5-9afc-16cec26a89e3 tempest-VolumesSnapshotTestJSON-1761633007 None] Volume volume-207e6102-29a7-4625-a416-704d1efe82a1 (207e6102-29a7-4625-a416-704d1efe82a1): created successfully Feb 05 21:14:11.799939 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-c4ea2349-4e23-41e5-9afc-16cec26a89e3 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc6b9b8b-4d9a-408a-b12f-717a19ecd1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:11.805677 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-c4ea2349-4e23-41e5-9afc-16cec26a89e3 tempest-VolumesSnapshotTestJSON-1761633007 None] Flow 'volume_create_manager' (2d48ec07-ff7c-457f-afcc-310f77bd2878) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:14:11.823573 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-c4ea2349-4e23-41e5-9afc-16cec26a89e3 tempest-VolumesSnapshotTestJSON-1761633007 None] Created volume successfully. Feb 05 21:14:12.303455 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-8bf95dd7-0c33-467a-b0c6-171c324eac56 tempest-VolumesSnapshotTestJSON-1761633007 None] Lock "b'cinder-207e6102-29a7-4625-a416-704d1efe82a1-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:14:12.335575 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8bf95dd7-0c33-467a-b0c6-171c324eac56 tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:12.389340 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8bf95dd7-0c33-467a-b0c6-171c324eac56 tempest-VolumesSnapshotTestJSON-1761633007 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:14:12.401151 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8bf95dd7-0c33-467a-b0c6-171c324eac56 tempest-VolumesSnapshotTestJSON-1761633007 None] deleting rbd volume volume-207e6102-29a7-4625-a416-704d1efe82a1 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:14:12.676753 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-8bf95dd7-0c33-467a-b0c6-171c324eac56 tempest-VolumesSnapshotTestJSON-1761633007 None] Created reservations ['7db39d0e-b675-425a-b111-9b6f144dc630', '959f445e-0578-479d-84b2-fdb3ef411a2e', '5ed9511c-8aa8-4fa5-8bdf-7b8c8e376652', '16428b62-0af3-4bc9-9f56-713fd6f4d9c5'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:14:12.720538 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8bf95dd7-0c33-467a-b0c6-171c324eac56 tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:12.749691 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8bf95dd7-0c33-467a-b0c6-171c324eac56 tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:12.777547 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-8bf95dd7-0c33-467a-b0c6-171c324eac56 tempest-VolumesSnapshotTestJSON-1761633007 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:14:12.787273 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-8bf95dd7-0c33-467a-b0c6-171c324eac56 tempest-VolumesSnapshotTestJSON-1761633007 None] Deleted volume successfully. Feb 05 21:14:12.798507 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-8bf95dd7-0c33-467a-b0c6-171c324eac56 tempest-VolumesSnapshotTestJSON-1761633007 None] Lock "b'cinder-207e6102-29a7-4625-a416-704d1efe82a1-delete_volume'" released by "delete_volume" :: held 0.495s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:14:13.724901 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bbf3e7b-208b-4914-8289-ae37a48af932 tempest-VolumesSnapshotTestJSON-1761633007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:14:13.729041 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-9bbf3e7b-208b-4914-8289-ae37a48af932 tempest-VolumesSnapshotTestJSON-1761633007 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:14:13.729606 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-9bbf3e7b-208b-4914-8289-ae37a48af932 tempest-VolumesSnapshotTestJSON-1761633007 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:14:13.751183 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9bbf3e7b-208b-4914-8289-ae37a48af932 tempest-VolumesSnapshotTestJSON-1761633007 None] Flow 'volume_create_manager' (0a252f95-95fe-4d2b-9e0d-70f715c63acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:14:13.761897 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9bbf3e7b-208b-4914-8289-ae37a48af932 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b748e25-5127-4b17-9713-ad66a198a4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:13.769974 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-9bbf3e7b-208b-4914-8289-ae37a48af932 tempest-VolumesSnapshotTestJSON-1761633007 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:14:13.788099 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9bbf3e7b-208b-4914-8289-ae37a48af932 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b748e25-5127-4b17-9713-ad66a198a4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2073839835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=339121aa-e2a7-4de1-8759-b0f78867fc46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c04615402925462792ca03f711db23c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:14:14Z,use_quota=True,user_id='6682477b172d460881a96d68f6bd053c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:13.795503 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9bbf3e7b-208b-4914-8289-ae37a48af932 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7662329-4dbb-435f-87fc-fbc8886b338c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:13.800278 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9bbf3e7b-208b-4914-8289-ae37a48af932 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7662329-4dbb-435f-87fc-fbc8886b338c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:13.806444 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9bbf3e7b-208b-4914-8289-ae37a48af932 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f11b2c62-aba2-4d26-8939-2a6e74c9cace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:13.815387 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9bbf3e7b-208b-4914-8289-ae37a48af932 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f11b2c62-aba2-4d26-8939-2a6e74c9cace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '339121aa-e2a7-4de1-8759-b0f78867fc46', 'volume_name': 'volume-339121aa-e2a7-4de1-8759-b0f78867fc46', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:13.820831 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9bbf3e7b-208b-4914-8289-ae37a48af932 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eb9e35a-6e16-495a-9fff-16cd6734377c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:13.831214 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9bbf3e7b-208b-4914-8289-ae37a48af932 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eb9e35a-6e16-495a-9fff-16cd6734377c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:13.837593 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9bbf3e7b-208b-4914-8289-ae37a48af932 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3507750e-702e-407b-8d35-e4bef653fb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:13.837804 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-9bbf3e7b-208b-4914-8289-ae37a48af932 tempest-VolumesSnapshotTestJSON-1761633007 None] Volume 339121aa-e2a7-4de1-8759-b0f78867fc46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-339121aa-e2a7-4de1-8759-b0f78867fc46', 'volume_size': 1} Feb 05 21:14:13.838154 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-9bbf3e7b-208b-4914-8289-ae37a48af932 tempest-VolumesSnapshotTestJSON-1761633007 None] creating volume 'volume-339121aa-e2a7-4de1-8759-b0f78867fc46' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:14:13.839366 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-9bbf3e7b-208b-4914-8289-ae37a48af932 tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:13.961984 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-9bbf3e7b-208b-4914-8289-ae37a48af932 tempest-VolumesSnapshotTestJSON-1761633007 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:14:13.963072 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-9bbf3e7b-208b-4914-8289-ae37a48af932 tempest-VolumesSnapshotTestJSON-1761633007 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:14:13.967133 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9bbf3e7b-208b-4914-8289-ae37a48af932 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3507750e-702e-407b-8d35-e4bef653fb64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-339121aa-e2a7-4de1-8759-b0f78867fc46', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:13.973259 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9bbf3e7b-208b-4914-8289-ae37a48af932 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d558d1b8-26d0-4d0b-a866-63fded8d0a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:13.985639 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-9bbf3e7b-208b-4914-8289-ae37a48af932 tempest-VolumesSnapshotTestJSON-1761633007 None] Volume volume-339121aa-e2a7-4de1-8759-b0f78867fc46 (339121aa-e2a7-4de1-8759-b0f78867fc46): created successfully Feb 05 21:14:13.989590 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9bbf3e7b-208b-4914-8289-ae37a48af932 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d558d1b8-26d0-4d0b-a866-63fded8d0a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:13.995902 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9bbf3e7b-208b-4914-8289-ae37a48af932 tempest-VolumesSnapshotTestJSON-1761633007 None] Flow 'volume_create_manager' (0a252f95-95fe-4d2b-9e0d-70f715c63acb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:14:14.007266 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-9bbf3e7b-208b-4914-8289-ae37a48af932 tempest-VolumesSnapshotTestJSON-1761633007 None] Created volume successfully. Feb 05 21:14:14.888544 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-0e5584be-62bf-42b8-bd4a-135c2bd20814 tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:15.093930 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-0e5584be-62bf-42b8-bd4a-135c2bd20814 tempest-VolumesSnapshotTestJSON-1761633007 None] Create snapshot completed successfully Feb 05 21:14:16.370417 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-e22e753f-ced0-4850-8134-1c391e6341c6 tempest-VolumesSnapshotTestJSON-1761633007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:14:16.375731 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-e22e753f-ced0-4850-8134-1c391e6341c6 tempest-VolumesSnapshotTestJSON-1761633007 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:14:16.376112 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-e22e753f-ced0-4850-8134-1c391e6341c6 tempest-VolumesSnapshotTestJSON-1761633007 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:14:16.413991 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-e22e753f-ced0-4850-8134-1c391e6341c6 tempest-VolumesSnapshotTestJSON-1761633007 None] Flow 'volume_create_manager' (f11924f5-a69b-42ac-b955-d2154403be67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:14:16.421939 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-e22e753f-ced0-4850-8134-1c391e6341c6 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92b489ad-9e15-4d47-a981-88dab0bc56f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:16.431124 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-e22e753f-ced0-4850-8134-1c391e6341c6 tempest-VolumesSnapshotTestJSON-1761633007 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:14:16.450115 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-e22e753f-ced0-4850-8134-1c391e6341c6 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92b489ad-9e15-4d47-a981-88dab0bc56f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-306014525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=671f32ed-0f49-47a2-8ad8-62a73e22aab1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c04615402925462792ca03f711db23c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:14:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=10653c29-1fef-4a20-8278-b39845321c7f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:14:16Z,use_quota=True,user_id='6682477b172d460881a96d68f6bd053c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:16.456628 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-e22e753f-ced0-4850-8134-1c391e6341c6 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbacbd7e-697f-467d-81c4-8ae0b081fd97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:16.461787 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-e22e753f-ced0-4850-8134-1c391e6341c6 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbacbd7e-697f-467d-81c4-8ae0b081fd97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:16.468472 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-e22e753f-ced0-4850-8134-1c391e6341c6 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa1a18f-9c39-4011-967d-1078b8bd7712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:16.473542 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-e22e753f-ced0-4850-8134-1c391e6341c6 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa1a18f-9c39-4011-967d-1078b8bd7712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '671f32ed-0f49-47a2-8ad8-62a73e22aab1', 'volume_name': 'volume-671f32ed-0f49-47a2-8ad8-62a73e22aab1', 'volume_size': 1, 'snapshot_id': '10653c29-1fef-4a20-8278-b39845321c7f'}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:16.478957 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-e22e753f-ced0-4850-8134-1c391e6341c6 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a4ccf53-99d1-449f-84d6-3dc4c9de6348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:16.483246 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-e22e753f-ced0-4850-8134-1c391e6341c6 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a4ccf53-99d1-449f-84d6-3dc4c9de6348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:16.489179 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-e22e753f-ced0-4850-8134-1c391e6341c6 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77d2143b-e837-4d0f-ad89-b6ba41fb00f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:16.490745 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-e22e753f-ced0-4850-8134-1c391e6341c6 tempest-VolumesSnapshotTestJSON-1761633007 None] Volume 671f32ed-0f49-47a2-8ad8-62a73e22aab1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-671f32ed-0f49-47a2-8ad8-62a73e22aab1', 'volume_size': 1, 'snapshot_id': '10653c29-1fef-4a20-8278-b39845321c7f'} Feb 05 21:14:16.512707 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e22e753f-ced0-4850-8134-1c391e6341c6 tempest-VolumesSnapshotTestJSON-1761633007 None] cloning volumes/volume-339121aa-e2a7-4de1-8759-b0f78867fc46@snapshot-10653c29-1fef-4a20-8278-b39845321c7f to volume-671f32ed-0f49-47a2-8ad8-62a73e22aab1 {{(pid=122683) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Feb 05 21:14:16.513626 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e22e753f-ced0-4850-8134-1c391e6341c6 tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:16.570866 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e22e753f-ced0-4850-8134-1c391e6341c6 tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:16.770536 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e22e753f-ced0-4850-8134-1c391e6341c6 tempest-VolumesSnapshotTestJSON-1761633007 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:14:16.771279 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e22e753f-ced0-4850-8134-1c391e6341c6 tempest-VolumesSnapshotTestJSON-1761633007 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:14:16.793611 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-e22e753f-ced0-4850-8134-1c391e6341c6 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77d2143b-e837-4d0f-ad89-b6ba41fb00f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-671f32ed-0f49-47a2-8ad8-62a73e22aab1', 'volume_size': 1, 'snapshot_id': '10653c29-1fef-4a20-8278-b39845321c7f'}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:16.798886 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-e22e753f-ced0-4850-8134-1c391e6341c6 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e87d9104-5748-40c7-a87b-9ec36057a846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:16.811832 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-e22e753f-ced0-4850-8134-1c391e6341c6 tempest-VolumesSnapshotTestJSON-1761633007 None] Volume volume-671f32ed-0f49-47a2-8ad8-62a73e22aab1 (671f32ed-0f49-47a2-8ad8-62a73e22aab1): created successfully Feb 05 21:14:16.817337 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-e22e753f-ced0-4850-8134-1c391e6341c6 tempest-VolumesSnapshotTestJSON-1761633007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e87d9104-5748-40c7-a87b-9ec36057a846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:16.823369 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-e22e753f-ced0-4850-8134-1c391e6341c6 tempest-VolumesSnapshotTestJSON-1761633007 None] Flow 'volume_create_manager' (f11924f5-a69b-42ac-b955-d2154403be67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:14:16.837620 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-e22e753f-ced0-4850-8134-1c391e6341c6 tempest-VolumesSnapshotTestJSON-1761633007 None] Created volume successfully. Feb 05 21:14:17.496639 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-1789a425-8c46-4375-97cd-5d198113d9cc tempest-VolumesSnapshotTestJSON-1761633007 None] Lock "b'cinder-671f32ed-0f49-47a2-8ad8-62a73e22aab1-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:14:17.553484 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1789a425-8c46-4375-97cd-5d198113d9cc tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:17.619225 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1789a425-8c46-4375-97cd-5d198113d9cc tempest-VolumesSnapshotTestJSON-1761633007 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:14:17.628239 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1789a425-8c46-4375-97cd-5d198113d9cc tempest-VolumesSnapshotTestJSON-1761633007 None] deleting rbd volume volume-671f32ed-0f49-47a2-8ad8-62a73e22aab1 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:14:17.866400 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-1789a425-8c46-4375-97cd-5d198113d9cc tempest-VolumesSnapshotTestJSON-1761633007 None] Created reservations ['e3cad1ec-9591-4b2e-b0c5-dddb57506cf8', '5d56fe4d-19ce-415b-b12e-25f37f28197f', '60beca61-822a-4be6-ab23-5511bedfeb9f', '77bf9abb-9212-4b88-86c8-5da518bbc02e'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:14:17.907160 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1789a425-8c46-4375-97cd-5d198113d9cc tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:17.957155 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1789a425-8c46-4375-97cd-5d198113d9cc tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:17.985200 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-1789a425-8c46-4375-97cd-5d198113d9cc tempest-VolumesSnapshotTestJSON-1761633007 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:14:17.991517 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-1789a425-8c46-4375-97cd-5d198113d9cc tempest-VolumesSnapshotTestJSON-1761633007 None] Deleted volume successfully. Feb 05 21:14:18.009937 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-1789a425-8c46-4375-97cd-5d198113d9cc tempest-VolumesSnapshotTestJSON-1761633007 None] Lock "b'cinder-671f32ed-0f49-47a2-8ad8-62a73e22aab1-delete_volume'" released by "delete_volume" :: held 0.513s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:14:18.650943 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-90e2cd46-5d4f-4563-a5e9-e9b7b6dcec76 tempest-VolumesSnapshotTestJSON-1761633007 None] Lock "b'cinder-10653c29-1fef-4a20-8278-b39845321c7f-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:14:18.653230 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-90e2cd46-5d4f-4563-a5e9-e9b7b6dcec76 tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:19.386587 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-90e2cd46-5d4f-4563-a5e9-e9b7b6dcec76 tempest-VolumesSnapshotTestJSON-1761633007 None] Created reservations ['8f43eba4-0cd5-4bee-bddb-406d70341edf', '635a2ca4-9fb8-4537-b8dd-88463ce70770', 'd7f12fd0-5fbb-4993-abcf-def9eba409e9', 'f53bf9bd-bee9-4e44-acd8-f3af2089ade1'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:14:19.444196 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-90e2cd46-5d4f-4563-a5e9-e9b7b6dcec76 tempest-VolumesSnapshotTestJSON-1761633007 None] Delete snapshot completed successfully. Feb 05 21:14:19.450177 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-90e2cd46-5d4f-4563-a5e9-e9b7b6dcec76 tempest-VolumesSnapshotTestJSON-1761633007 None] Lock "b'cinder-10653c29-1fef-4a20-8278-b39845321c7f-delete_snapshot'" released by "delete_snapshot" :: held 0.799s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:14:19.752440 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-2ac82334-24eb-4baf-a796-72070db093e3 tempest-VolumesSnapshotTestJSON-1761633007 None] Lock "b'cinder-339121aa-e2a7-4de1-8759-b0f78867fc46-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:14:19.787959 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-2ac82334-24eb-4baf-a796-72070db093e3 tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:19.831425 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-2ac82334-24eb-4baf-a796-72070db093e3 tempest-VolumesSnapshotTestJSON-1761633007 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:14:19.831905 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-2ac82334-24eb-4baf-a796-72070db093e3 tempest-VolumesSnapshotTestJSON-1761633007 None] Volume volume-339121aa-e2a7-4de1-8759-b0f78867fc46 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:14:19.840430 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-2ac82334-24eb-4baf-a796-72070db093e3 tempest-VolumesSnapshotTestJSON-1761633007 None] deleting rbd volume volume-339121aa-e2a7-4de1-8759-b0f78867fc46 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:14:20.097850 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-2ac82334-24eb-4baf-a796-72070db093e3 tempest-VolumesSnapshotTestJSON-1761633007 None] Created reservations ['bc9210b0-6f30-41f5-9cf5-d4500ce31a0b', '2fe93cdb-685c-4d54-92fb-9bc7d54a876a', 'b8cffbfd-0786-4553-a373-605bfe1067d1', 'dc12741e-b6ac-4daf-854e-fcdcd6b500e1'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:14:20.139736 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-2ac82334-24eb-4baf-a796-72070db093e3 tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:20.163911 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-2ac82334-24eb-4baf-a796-72070db093e3 tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:20.200617 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-2ac82334-24eb-4baf-a796-72070db093e3 tempest-VolumesSnapshotTestJSON-1761633007 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:14:20.206981 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-2ac82334-24eb-4baf-a796-72070db093e3 tempest-VolumesSnapshotTestJSON-1761633007 None] Deleted volume successfully. Feb 05 21:14:20.219833 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-2ac82334-24eb-4baf-a796-72070db093e3 tempest-VolumesSnapshotTestJSON-1761633007 None] Lock "b'cinder-339121aa-e2a7-4de1-8759-b0f78867fc46-delete_volume'" released by "delete_volume" :: held 0.467s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:14:20.904629 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-34459c2e-a996-4248-af47-7e741502a199 tempest-VolumesSnapshotTestJSON-1761633007 None] Lock "b'cinder-c6bef1fe-f6d1-4549-8c66-68fa64ad737f-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:14:20.906717 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-34459c2e-a996-4248-af47-7e741502a199 tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:21.387001 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-34459c2e-a996-4248-af47-7e741502a199 tempest-VolumesSnapshotTestJSON-1761633007 None] Created reservations ['52c5afc5-00a8-42e6-8f28-e996a0b4716b', '3214ead1-26a0-4cb7-a96b-41f46ef0b8bf', '72c30819-be54-4c7f-9ac1-c17a10d6e620', '778d21b8-a251-4bd5-bc95-a253d9dd2ba5'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:14:21.424888 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-34459c2e-a996-4248-af47-7e741502a199 tempest-VolumesSnapshotTestJSON-1761633007 None] Delete snapshot completed successfully. Feb 05 21:14:21.430184 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-34459c2e-a996-4248-af47-7e741502a199 tempest-VolumesSnapshotTestJSON-1761633007 None] Lock "b'cinder-c6bef1fe-f6d1-4549-8c66-68fa64ad737f-delete_snapshot'" released by "delete_snapshot" :: held 0.526s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:14:22.021195 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-1e153a35-52e4-4dde-8d7f-5d86a571eda8 tempest-VolumesSnapshotTestJSON-1761633007 None] Lock "b'cinder-2be222d4-a9aa-49bd-a9ba-178e44bfc55b-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:14:22.059720 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1e153a35-52e4-4dde-8d7f-5d86a571eda8 tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:22.111639 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1e153a35-52e4-4dde-8d7f-5d86a571eda8 tempest-VolumesSnapshotTestJSON-1761633007 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:14:22.112167 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1e153a35-52e4-4dde-8d7f-5d86a571eda8 tempest-VolumesSnapshotTestJSON-1761633007 None] Volume volume-2be222d4-a9aa-49bd-a9ba-178e44bfc55b is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:14:22.119273 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1e153a35-52e4-4dde-8d7f-5d86a571eda8 tempest-VolumesSnapshotTestJSON-1761633007 None] deleting rbd volume volume-2be222d4-a9aa-49bd-a9ba-178e44bfc55b {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:14:22.415427 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-1e153a35-52e4-4dde-8d7f-5d86a571eda8 tempest-VolumesSnapshotTestJSON-1761633007 None] Created reservations ['671318a6-87a0-463d-89cf-d8b6f8b33ffd', '61fc057d-cb78-4ef3-8ff3-becfad0b943f', '1127c46e-d9e3-4119-8050-74160ef080de', '9956d822-b4bf-4d23-9cac-60aebf9d4db4'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:14:22.458397 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1e153a35-52e4-4dde-8d7f-5d86a571eda8 tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:22.490072 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1e153a35-52e4-4dde-8d7f-5d86a571eda8 tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:22.524768 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-1e153a35-52e4-4dde-8d7f-5d86a571eda8 tempest-VolumesSnapshotTestJSON-1761633007 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:14:22.529637 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-1e153a35-52e4-4dde-8d7f-5d86a571eda8 tempest-VolumesSnapshotTestJSON-1761633007 None] Deleted volume successfully. Feb 05 21:14:22.541781 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-1e153a35-52e4-4dde-8d7f-5d86a571eda8 tempest-VolumesSnapshotTestJSON-1761633007 None] Lock "b'cinder-2be222d4-a9aa-49bd-a9ba-178e44bfc55b-delete_volume'" released by "delete_volume" :: held 0.521s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:14:23.283142 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-d48a1fd1-e7cc-4801-8f9f-c55d6e2f7ec2 tempest-VolumesSnapshotTestJSON-1761633007 None] Lock "b'cinder-efeb3240-d992-46c6-8d1c-28d353568b08-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:14:23.321445 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-d48a1fd1-e7cc-4801-8f9f-c55d6e2f7ec2 tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:23.386033 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-d48a1fd1-e7cc-4801-8f9f-c55d6e2f7ec2 tempest-VolumesSnapshotTestJSON-1761633007 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:14:23.394995 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-d48a1fd1-e7cc-4801-8f9f-c55d6e2f7ec2 tempest-VolumesSnapshotTestJSON-1761633007 None] deleting rbd volume volume-efeb3240-d992-46c6-8d1c-28d353568b08 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:14:23.612094 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-d48a1fd1-e7cc-4801-8f9f-c55d6e2f7ec2 tempest-VolumesSnapshotTestJSON-1761633007 None] volume is a clone so cleaning references {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 05 21:14:23.645850 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-d48a1fd1-e7cc-4801-8f9f-c55d6e2f7ec2 tempest-VolumesSnapshotTestJSON-1761633007 None] deleting parent snapshot volume-efeb3240-d992-46c6-8d1c-28d353568b08.clone_snap {{(pid=122683) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 05 21:14:24.428146 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-d48a1fd1-e7cc-4801-8f9f-c55d6e2f7ec2 tempest-VolumesSnapshotTestJSON-1761633007 None] Created reservations ['9958df35-0106-43b6-9b32-aa41cc606dd5', 'cd455439-9b1a-46fe-8d00-5b7b28bd044a', '40295a61-6cd8-49b8-9cad-70569d2e3f30', 'c880778c-16aa-45a4-a320-ebcbcaeef4ed'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:14:24.479382 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-d48a1fd1-e7cc-4801-8f9f-c55d6e2f7ec2 tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:24.513283 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-d48a1fd1-e7cc-4801-8f9f-c55d6e2f7ec2 tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:24.541493 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-d48a1fd1-e7cc-4801-8f9f-c55d6e2f7ec2 tempest-VolumesSnapshotTestJSON-1761633007 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:14:24.551157 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-d48a1fd1-e7cc-4801-8f9f-c55d6e2f7ec2 tempest-VolumesSnapshotTestJSON-1761633007 None] Deleted volume successfully. Feb 05 21:14:24.563956 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-d48a1fd1-e7cc-4801-8f9f-c55d6e2f7ec2 tempest-VolumesSnapshotTestJSON-1761633007 None] Lock "b'cinder-efeb3240-d992-46c6-8d1c-28d353568b08-delete_volume'" released by "delete_volume" :: held 1.281s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:14:25.494502 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-57ed89b2-9c87-4777-9d09-c0b73be72133 tempest-VolumesSnapshotTestJSON-1761633007 None] Lock "b'cinder-37619e5a-7495-43b1-bc07-3cb25b99c0bd-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.021s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:14:25.496182 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-57ed89b2-9c87-4777-9d09-c0b73be72133 tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:26.500385 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-57ed89b2-9c87-4777-9d09-c0b73be72133 tempest-VolumesSnapshotTestJSON-1761633007 None] Created reservations ['4f26887a-4902-4669-a267-5f11915f95f4', '72eb1fa2-82f6-4696-99ad-3bb262aa9e65', 'db6d81a3-edf1-4dcd-8d3c-80e7c13a4c4f', '60f4a2eb-f6a8-4998-b41f-df1d3b21f694'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:14:26.575378 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-57ed89b2-9c87-4777-9d09-c0b73be72133 tempest-VolumesSnapshotTestJSON-1761633007 None] Delete snapshot completed successfully. Feb 05 21:14:26.582070 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-57ed89b2-9c87-4777-9d09-c0b73be72133 tempest-VolumesSnapshotTestJSON-1761633007 None] Lock "b'cinder-37619e5a-7495-43b1-bc07-3cb25b99c0bd-delete_snapshot'" released by "delete_snapshot" :: held 1.087s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:14:27.621692 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-f546b1c4-f406-417c-b4f9-d1a2f2296e07 tempest-VolumesSnapshotTestJSON-1761633007 None] Lock "b'cinder-419ad4d0-6b45-4fb7-9e6f-920b37e4a0ea-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:14:27.677059 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-f546b1c4-f406-417c-b4f9-d1a2f2296e07 tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:27.754108 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-f546b1c4-f406-417c-b4f9-d1a2f2296e07 tempest-VolumesSnapshotTestJSON-1761633007 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:14:27.754669 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-f546b1c4-f406-417c-b4f9-d1a2f2296e07 tempest-VolumesSnapshotTestJSON-1761633007 None] Volume volume-419ad4d0-6b45-4fb7-9e6f-920b37e4a0ea is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:14:27.766879 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-f546b1c4-f406-417c-b4f9-d1a2f2296e07 tempest-VolumesSnapshotTestJSON-1761633007 None] deleting rbd volume volume-419ad4d0-6b45-4fb7-9e6f-920b37e4a0ea {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:14:28.117035 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-f546b1c4-f406-417c-b4f9-d1a2f2296e07 tempest-VolumesSnapshotTestJSON-1761633007 None] Created reservations ['430543a0-3b85-4711-9e8d-a79d91b8837b', '2e84f523-81d6-4fb2-b1f1-f315e687e366', '62bb1700-2c77-4d22-88e2-aa007f52ba29', 'e521d45f-28f3-4b2d-8d40-5ceb6bf560d6'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:14:28.175387 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-f546b1c4-f406-417c-b4f9-d1a2f2296e07 tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:28.229955 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-f546b1c4-f406-417c-b4f9-d1a2f2296e07 tempest-VolumesSnapshotTestJSON-1761633007 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:28.277630 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-f546b1c4-f406-417c-b4f9-d1a2f2296e07 tempest-VolumesSnapshotTestJSON-1761633007 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:14:28.282685 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-f546b1c4-f406-417c-b4f9-d1a2f2296e07 tempest-VolumesSnapshotTestJSON-1761633007 None] Deleted volume successfully. Feb 05 21:14:28.298827 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-f546b1c4-f406-417c-b4f9-d1a2f2296e07 tempest-VolumesSnapshotTestJSON-1761633007 None] Lock "b'cinder-419ad4d0-6b45-4fb7-9e6f-920b37e4a0ea-delete_volume'" released by "delete_volume" :: held 0.677s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:14:29.804051 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-8f042f74-571c-4b91-819d-1ddf3ad42775 req-85f60959-15ee-4e05-976c-838d4b17b6a8 tempest-TestVolumeBootPattern-571902767 None] Terminate volume connection completed successfully. Feb 05 21:14:29.804596 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-8f042f74-571c-4b91-819d-1ddf3ad42775 req-85f60959-15ee-4e05-976c-838d4b17b6a8 tempest-TestVolumeBootPattern-571902767 None] Deleting attachment 61ecb50e-10fe-4ff3-983e-5da5d9eeaa8c. {{(pid=122683) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 05 21:14:31.157631 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-52f716b0-fc63-4cb8-a9e7-a44f5579dc89 tempest-VolumesSnapshotListTestJSON-677859655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:14:31.161747 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-52f716b0-fc63-4cb8-a9e7-a44f5579dc89 tempest-VolumesSnapshotListTestJSON-677859655 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:14:31.162215 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-52f716b0-fc63-4cb8-a9e7-a44f5579dc89 tempest-VolumesSnapshotListTestJSON-677859655 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:14:31.182754 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-52f716b0-fc63-4cb8-a9e7-a44f5579dc89 tempest-VolumesSnapshotListTestJSON-677859655 None] Flow 'volume_create_manager' (278da37d-0b58-445d-ae4d-9950ad1b578d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:14:31.191070 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-52f716b0-fc63-4cb8-a9e7-a44f5579dc89 tempest-VolumesSnapshotListTestJSON-677859655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8afc23b4-8d9f-47b8-a10c-3048b416f119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:31.197499 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-52f716b0-fc63-4cb8-a9e7-a44f5579dc89 tempest-VolumesSnapshotListTestJSON-677859655 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:14:31.213320 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-52f716b0-fc63-4cb8-a9e7-a44f5579dc89 tempest-VolumesSnapshotListTestJSON-677859655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8afc23b4-8d9f-47b8-a10c-3048b416f119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-408257282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c59e504a-a582-4618-8f6f-e28e622f2b5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='904017c74b3045d8bb40ede8d6c5e501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:14:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:14:31Z,use_quota=True,user_id='f6c5d33d9c634d539d98e54938e4509d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:31.219038 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-52f716b0-fc63-4cb8-a9e7-a44f5579dc89 tempest-VolumesSnapshotListTestJSON-677859655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1c45797-2e36-471f-965d-76f1f9f6d07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:31.224022 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-52f716b0-fc63-4cb8-a9e7-a44f5579dc89 tempest-VolumesSnapshotListTestJSON-677859655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1c45797-2e36-471f-965d-76f1f9f6d07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:31.229329 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-52f716b0-fc63-4cb8-a9e7-a44f5579dc89 tempest-VolumesSnapshotListTestJSON-677859655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (601945ec-1dbb-4de0-9d40-3e959ba4c4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:31.233652 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-52f716b0-fc63-4cb8-a9e7-a44f5579dc89 tempest-VolumesSnapshotListTestJSON-677859655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (601945ec-1dbb-4de0-9d40-3e959ba4c4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c59e504a-a582-4618-8f6f-e28e622f2b5b', 'volume_name': 'volume-c59e504a-a582-4618-8f6f-e28e622f2b5b', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:31.238760 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-52f716b0-fc63-4cb8-a9e7-a44f5579dc89 tempest-VolumesSnapshotListTestJSON-677859655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0d52a6f-dab3-456c-87d9-7d735d49e9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:31.242850 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-52f716b0-fc63-4cb8-a9e7-a44f5579dc89 tempest-VolumesSnapshotListTestJSON-677859655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0d52a6f-dab3-456c-87d9-7d735d49e9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:31.247687 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-52f716b0-fc63-4cb8-a9e7-a44f5579dc89 tempest-VolumesSnapshotListTestJSON-677859655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1639f9bf-9f2e-489c-8b4d-0d6f4aafd11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:31.248822 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-52f716b0-fc63-4cb8-a9e7-a44f5579dc89 tempest-VolumesSnapshotListTestJSON-677859655 None] Volume c59e504a-a582-4618-8f6f-e28e622f2b5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c59e504a-a582-4618-8f6f-e28e622f2b5b', 'volume_size': 1} Feb 05 21:14:31.249215 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-52f716b0-fc63-4cb8-a9e7-a44f5579dc89 tempest-VolumesSnapshotListTestJSON-677859655 None] creating volume 'volume-c59e504a-a582-4618-8f6f-e28e622f2b5b' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:14:31.250200 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-52f716b0-fc63-4cb8-a9e7-a44f5579dc89 tempest-VolumesSnapshotListTestJSON-677859655 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:31.310828 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-52f716b0-fc63-4cb8-a9e7-a44f5579dc89 tempest-VolumesSnapshotListTestJSON-677859655 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:14:31.311291 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-52f716b0-fc63-4cb8-a9e7-a44f5579dc89 tempest-VolumesSnapshotListTestJSON-677859655 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:14:31.316711 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-52f716b0-fc63-4cb8-a9e7-a44f5579dc89 tempest-VolumesSnapshotListTestJSON-677859655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1639f9bf-9f2e-489c-8b4d-0d6f4aafd11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c59e504a-a582-4618-8f6f-e28e622f2b5b', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:31.321981 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-52f716b0-fc63-4cb8-a9e7-a44f5579dc89 tempest-VolumesSnapshotListTestJSON-677859655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3510897c-7947-477f-b6ab-6a1d19830e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:31.332605 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-52f716b0-fc63-4cb8-a9e7-a44f5579dc89 tempest-VolumesSnapshotListTestJSON-677859655 None] Volume volume-c59e504a-a582-4618-8f6f-e28e622f2b5b (c59e504a-a582-4618-8f6f-e28e622f2b5b): created successfully Feb 05 21:14:31.338123 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-52f716b0-fc63-4cb8-a9e7-a44f5579dc89 tempest-VolumesSnapshotListTestJSON-677859655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3510897c-7947-477f-b6ab-6a1d19830e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:31.346659 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-52f716b0-fc63-4cb8-a9e7-a44f5579dc89 tempest-VolumesSnapshotListTestJSON-677859655 None] Flow 'volume_create_manager' (278da37d-0b58-445d-ae4d-9950ad1b578d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:14:31.358919 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-52f716b0-fc63-4cb8-a9e7-a44f5579dc89 tempest-VolumesSnapshotListTestJSON-677859655 None] Created volume successfully. Feb 05 21:14:31.430577 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-ab0fcb1f-e896-4a8c-bb1c-58a1a82a09aa tempest-TestVolumeBootPattern-571902767 None] Lock "b'cinder-9db3567a-f3e3-45e6-99f4-0de39787a5cc-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:14:31.463127 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ab0fcb1f-e896-4a8c-bb1c-58a1a82a09aa tempest-TestVolumeBootPattern-571902767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:31.565747 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ab0fcb1f-e896-4a8c-bb1c-58a1a82a09aa tempest-TestVolumeBootPattern-571902767 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:14:31.581008 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ab0fcb1f-e896-4a8c-bb1c-58a1a82a09aa tempest-TestVolumeBootPattern-571902767 None] deleting rbd volume volume-9db3567a-f3e3-45e6-99f4-0de39787a5cc {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:14:31.896656 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-ab0fcb1f-e896-4a8c-bb1c-58a1a82a09aa tempest-TestVolumeBootPattern-571902767 None] Created reservations ['b626e8b7-3f8d-4b63-ac38-07100bd24939', '91f1e360-8869-46d3-ad37-8e56b1a6a33b', '3ab5f0a9-33cb-439f-b83d-eadb8351ca2a', '5a7257be-1bdd-46d1-8304-99637d82f10d'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:14:31.938933 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ab0fcb1f-e896-4a8c-bb1c-58a1a82a09aa tempest-TestVolumeBootPattern-571902767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:31.964748 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ab0fcb1f-e896-4a8c-bb1c-58a1a82a09aa tempest-TestVolumeBootPattern-571902767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:31.990697 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-ab0fcb1f-e896-4a8c-bb1c-58a1a82a09aa tempest-TestVolumeBootPattern-571902767 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:14:31.994625 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-ab0fcb1f-e896-4a8c-bb1c-58a1a82a09aa tempest-TestVolumeBootPattern-571902767 None] Deleted volume successfully. Feb 05 21:14:32.007702 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-ab0fcb1f-e896-4a8c-bb1c-58a1a82a09aa tempest-TestVolumeBootPattern-571902767 None] Lock "b'cinder-9db3567a-f3e3-45e6-99f4-0de39787a5cc-delete_volume'" released by "delete_volume" :: held 0.577s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:14:32.367493 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6f519bfa-a85c-4b95-9848-81e9568c9a3f tempest-VolumesSnapshotListTestJSON-677859655 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:32.558606 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-59838117-bddf-4ede-954b-21c5ca2a8611 tempest-TestVolumeBootPattern-571902767 None] Lock "b'cinder-89d44f58-cf24-4c84-b194-449478786291-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:14:32.558606 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-59838117-bddf-4ede-954b-21c5ca2a8611 tempest-TestVolumeBootPattern-571902767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:33.395823 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-6f519bfa-a85c-4b95-9848-81e9568c9a3f tempest-VolumesSnapshotListTestJSON-677859655 None] Create snapshot completed successfully Feb 05 21:14:34.611990 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-91e336a4-9772-4980-931a-479bec8b56a0 tempest-VolumesSnapshotListTestJSON-677859655 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:35.399295 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-91e336a4-9772-4980-931a-479bec8b56a0 tempest-VolumesSnapshotListTestJSON-677859655 None] Create snapshot completed successfully Feb 05 21:14:35.949666 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-9298799e-624c-40af-927d-65b933d85386 tempest-VolumesSnapshotListTestJSON-677859655 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:36.428541 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-9298799e-624c-40af-927d-65b933d85386 tempest-VolumesSnapshotListTestJSON-677859655 None] Create snapshot completed successfully Feb 05 21:14:37.272076 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-e1baca71-fc64-43df-a79e-d171fce723ff tempest-GroupSnapshotsV319Test-52705672 None] Group tempest-GroupSnapshotsV319Test-Group-508818463: creating Feb 05 21:14:37.299264 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-e1baca71-fc64-43df-a79e-d171fce723ff tempest-GroupSnapshotsV319Test-52705672 None] Group tempest-GroupSnapshotsV319Test-Group-508818463: created successfully Feb 05 21:14:37.309503 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-e1baca71-fc64-43df-a79e-d171fce723ff tempest-GroupSnapshotsV319Test-52705672 None] Create group completed successfully. Feb 05 21:14:37.612332 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-64d57cf2-1563-4366-a012-1d7abb0eb853 tempest-VolumesSnapshotListTestJSON-677859655 None] Lock "b'cinder-ee058e88-5f4c-4291-99db-6965d16805b3-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:14:37.613732 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-64d57cf2-1563-4366-a012-1d7abb0eb853 tempest-VolumesSnapshotListTestJSON-677859655 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:38.461858 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-64d57cf2-1563-4366-a012-1d7abb0eb853 tempest-VolumesSnapshotListTestJSON-677859655 None] Created reservations ['836bf404-7348-4d6c-a474-3bc7dda49e9a', '98477a70-a3ae-4cdc-8123-9c26b7fb3676', '1e393693-c068-4918-87a3-04d1424f187e', '8aca8431-7f38-4290-9be2-15f041553c28'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:14:38.527891 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-64d57cf2-1563-4366-a012-1d7abb0eb853 tempest-VolumesSnapshotListTestJSON-677859655 None] Delete snapshot completed successfully. Feb 05 21:14:38.534592 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-64d57cf2-1563-4366-a012-1d7abb0eb853 tempest-VolumesSnapshotListTestJSON-677859655 None] Lock "b'cinder-ee058e88-5f4c-4291-99db-6965d16805b3-delete_snapshot'" released by "delete_snapshot" :: held 0.922s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:14:38.728515 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-14fef6f2-d22f-44d4-8b96-bad1faa08da2 tempest-VolumesSnapshotListTestJSON-677859655 None] Lock "b'cinder-701d53fd-9363-4bf8-bacd-71604122aec6-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.019s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:14:38.732452 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-14fef6f2-d22f-44d4-8b96-bad1faa08da2 tempest-VolumesSnapshotListTestJSON-677859655 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:38.804660 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-bda31da2-1b44-49be-a028-fb6f70e82573 tempest-GroupSnapshotsV319Test-52705672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:14:38.808377 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-bda31da2-1b44-49be-a028-fb6f70e82573 tempest-GroupSnapshotsV319Test-52705672 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:14:38.809088 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-bda31da2-1b44-49be-a028-fb6f70e82573 tempest-GroupSnapshotsV319Test-52705672 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:14:38.831204 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-bda31da2-1b44-49be-a028-fb6f70e82573 tempest-GroupSnapshotsV319Test-52705672 None] Flow 'volume_create_manager' (88282280-b3ee-437a-bff3-bfd783db93af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:14:38.838396 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-bda31da2-1b44-49be-a028-fb6f70e82573 tempest-GroupSnapshotsV319Test-52705672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c627a2e-9dc3-4364-85e6-61cde9d1d49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:38.844875 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-bda31da2-1b44-49be-a028-fb6f70e82573 tempest-GroupSnapshotsV319Test-52705672 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:14:38.861876 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-bda31da2-1b44-49be-a028-fb6f70e82573 tempest-GroupSnapshotsV319Test-52705672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c627a2e-9dc3-4364-85e6-61cde9d1d49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsV319Test-Volume-2014013160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8e4a1faf-88cb-422c-8841-72ab94b802a4,host='ncdv-master-1@ceph#ceph',id=3d932127-bbfb-42c1-877e-1a97542e521f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='822b63515bc84271af85bdf18ab31c42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:14:39Z,use_quota=True,user_id='124a108d47fc44398cffda313eecfcff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4985a66f-248b-45ff-95b4-4bf6eae07eaa),volume_type_id=4985a66f-248b-45ff-95b4-4bf6eae07eaa)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:38.867363 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-bda31da2-1b44-49be-a028-fb6f70e82573 tempest-GroupSnapshotsV319Test-52705672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e319eb47-b216-417b-afbb-286882155461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:38.871514 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-bda31da2-1b44-49be-a028-fb6f70e82573 tempest-GroupSnapshotsV319Test-52705672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e319eb47-b216-417b-afbb-286882155461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:38.877264 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-bda31da2-1b44-49be-a028-fb6f70e82573 tempest-GroupSnapshotsV319Test-52705672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed92cd0a-3a6d-4823-8aa9-972225e5c58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:38.881890 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-bda31da2-1b44-49be-a028-fb6f70e82573 tempest-GroupSnapshotsV319Test-52705672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed92cd0a-3a6d-4823-8aa9-972225e5c58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d932127-bbfb-42c1-877e-1a97542e521f', 'volume_name': 'volume-3d932127-bbfb-42c1-877e-1a97542e521f', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:38.886877 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-bda31da2-1b44-49be-a028-fb6f70e82573 tempest-GroupSnapshotsV319Test-52705672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38762de9-23e2-497d-a081-c55e0c69c071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:38.891001 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-bda31da2-1b44-49be-a028-fb6f70e82573 tempest-GroupSnapshotsV319Test-52705672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38762de9-23e2-497d-a081-c55e0c69c071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:38.896556 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-bda31da2-1b44-49be-a028-fb6f70e82573 tempest-GroupSnapshotsV319Test-52705672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71ff99c4-b44d-4646-94db-01cea962d45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:38.897667 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-bda31da2-1b44-49be-a028-fb6f70e82573 tempest-GroupSnapshotsV319Test-52705672 None] Volume 3d932127-bbfb-42c1-877e-1a97542e521f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d932127-bbfb-42c1-877e-1a97542e521f', 'volume_size': 1} Feb 05 21:14:38.898050 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-bda31da2-1b44-49be-a028-fb6f70e82573 tempest-GroupSnapshotsV319Test-52705672 None] creating volume 'volume-3d932127-bbfb-42c1-877e-1a97542e521f' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:14:38.899038 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-bda31da2-1b44-49be-a028-fb6f70e82573 tempest-GroupSnapshotsV319Test-52705672 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:38.948174 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-bda31da2-1b44-49be-a028-fb6f70e82573 tempest-GroupSnapshotsV319Test-52705672 None] extra_specs: {} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:14:38.948672 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-bda31da2-1b44-49be-a028-fb6f70e82573 tempest-GroupSnapshotsV319Test-52705672 None] extra_specs: {} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:14:38.952458 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-bda31da2-1b44-49be-a028-fb6f70e82573 tempest-GroupSnapshotsV319Test-52705672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71ff99c4-b44d-4646-94db-01cea962d45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d932127-bbfb-42c1-877e-1a97542e521f', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:38.957771 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-bda31da2-1b44-49be-a028-fb6f70e82573 tempest-GroupSnapshotsV319Test-52705672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8346ef44-a47e-4112-b52f-f49c55400b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:38.966862 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-bda31da2-1b44-49be-a028-fb6f70e82573 tempest-GroupSnapshotsV319Test-52705672 None] Volume volume-3d932127-bbfb-42c1-877e-1a97542e521f (3d932127-bbfb-42c1-877e-1a97542e521f): created successfully Feb 05 21:14:38.970314 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-bda31da2-1b44-49be-a028-fb6f70e82573 tempest-GroupSnapshotsV319Test-52705672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8346ef44-a47e-4112-b52f-f49c55400b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:38.975843 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-bda31da2-1b44-49be-a028-fb6f70e82573 tempest-GroupSnapshotsV319Test-52705672 None] Flow 'volume_create_manager' (88282280-b3ee-437a-bff3-bfd783db93af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:14:38.982771 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-bda31da2-1b44-49be-a028-fb6f70e82573 tempest-GroupSnapshotsV319Test-52705672 None] Created volume successfully. Feb 05 21:14:39.441900 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-14fef6f2-d22f-44d4-8b96-bad1faa08da2 tempest-VolumesSnapshotListTestJSON-677859655 None] Created reservations ['11aadb0c-4c72-46b6-8ac1-29b3461e3824', 'ada3de0d-76c9-4bc3-99e7-7bb4160ab805', '12ea808e-c7ca-434f-85af-06624c1d1ccc', '55601467-adbc-49b3-bc83-ff9c1772d721'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:14:39.475365 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-14fef6f2-d22f-44d4-8b96-bad1faa08da2 tempest-VolumesSnapshotListTestJSON-677859655 None] Delete snapshot completed successfully. Feb 05 21:14:39.480638 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-14fef6f2-d22f-44d4-8b96-bad1faa08da2 tempest-VolumesSnapshotListTestJSON-677859655 None] Lock "b'cinder-701d53fd-9363-4bf8-bacd-71604122aec6-delete_snapshot'" released by "delete_snapshot" :: held 0.752s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:14:39.843822 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-44369a67-ad1e-4fef-b55f-288b60d95844 tempest-VolumesSnapshotListTestJSON-677859655 None] Lock "b'cinder-9a66ba86-58d5-42b4-ad3c-f401e43e012c-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.017s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:14:39.846018 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-44369a67-ad1e-4fef-b55f-288b60d95844 tempest-VolumesSnapshotListTestJSON-677859655 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:40.019280 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-f57cba79-7c07-46e6-ad83-709b8aa6a032 tempest-GroupSnapshotsV319Test-52705672 None] GroupSnapshot fa0f6098-2726-41df-bafa-f2fcfa6aee88: creating. Feb 05 21:14:40.035697 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-f57cba79-7c07-46e6-ad83-709b8aa6a032 tempest-GroupSnapshotsV319Test-52705672 None] Group snapshot fa0f6098-2726-41df-bafa-f2fcfa6aee88: creating. {{(pid=122683) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4078}} Feb 05 21:14:40.052464 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-f57cba79-7c07-46e6-ad83-709b8aa6a032 tempest-GroupSnapshotsV319Test-52705672 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:41.055308 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-44369a67-ad1e-4fef-b55f-288b60d95844 tempest-VolumesSnapshotListTestJSON-677859655 None] Created reservations ['c8f25f16-3715-48f5-a22c-ec3b9d06bac7', 'edda8e2c-b5fb-4392-ae19-f718434249c6', '55e787a5-ebfb-467e-ab91-d77d2d05ead8', 'fe08a6f6-4261-44c5-b590-1c3f673efedb'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:14:41.072140 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-f57cba79-7c07-46e6-ad83-709b8aa6a032 tempest-GroupSnapshotsV319Test-52705672 None] group_snapshot fa0f6098-2726-41df-bafa-f2fcfa6aee88: created successfully Feb 05 21:14:41.104959 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-44369a67-ad1e-4fef-b55f-288b60d95844 tempest-VolumesSnapshotListTestJSON-677859655 None] Delete snapshot completed successfully. Feb 05 21:14:41.112722 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-44369a67-ad1e-4fef-b55f-288b60d95844 tempest-VolumesSnapshotListTestJSON-677859655 None] Lock "b'cinder-9a66ba86-58d5-42b4-ad3c-f401e43e012c-delete_snapshot'" released by "delete_snapshot" :: held 1.269s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:14:41.421987 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-8c01904b-ca22-44f4-839a-0b8864c89796 tempest-GroupSnapshotsV319Test-52705672 None] group_snapshot fa0f6098-2726-41df-bafa-f2fcfa6aee88: deleting Feb 05 21:14:41.471178 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8c01904b-ca22-44f4-839a-0b8864c89796 tempest-GroupSnapshotsV319Test-52705672 None] group_snapshot fa0f6098-2726-41df-bafa-f2fcfa6aee88: deleting {{(pid=122683) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4253}} Feb 05 21:14:41.494086 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8c01904b-ca22-44f4-839a-0b8864c89796 tempest-GroupSnapshotsV319Test-52705672 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:42.081879 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-0947418b-8303-4785-a84b-4a11817baa3e tempest-VolumesSnapshotListTestJSON-677859655 None] Lock "b'cinder-c59e504a-a582-4618-8f6f-e28e622f2b5b-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:14:42.138578 ncdv-master-1 cinder-volume[122683]: WARNING cinder.quota [None req-8c01904b-ca22-44f4-839a-0b8864c89796 tempest-GroupSnapshotsV319Test-52705672 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-669640004 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-669640004, it is now deprecated. Please use the default quota class for default quota. Feb 05 21:14:42.143229 ncdv-master-1 cinder-volume[122683]: WARNING cinder.quota [None req-8c01904b-ca22-44f4-839a-0b8864c89796 tempest-GroupSnapshotsV319Test-52705672 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-669640004 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-669640004, it is now deprecated. Please use the default quota class for default quota. Feb 05 21:14:42.154530 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-0947418b-8303-4785-a84b-4a11817baa3e tempest-VolumesSnapshotListTestJSON-677859655 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:42.243560 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-0947418b-8303-4785-a84b-4a11817baa3e tempest-VolumesSnapshotListTestJSON-677859655 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:14:42.244081 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-0947418b-8303-4785-a84b-4a11817baa3e tempest-VolumesSnapshotListTestJSON-677859655 None] Volume volume-c59e504a-a582-4618-8f6f-e28e622f2b5b is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:14:42.255347 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-0947418b-8303-4785-a84b-4a11817baa3e tempest-VolumesSnapshotListTestJSON-677859655 None] deleting rbd volume volume-c59e504a-a582-4618-8f6f-e28e622f2b5b {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:14:42.297670 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-8c01904b-ca22-44f4-839a-0b8864c89796 tempest-GroupSnapshotsV319Test-52705672 None] Created reservations ['b3cfb454-7951-481c-aea7-f63a1b5634d5', '68accdf5-3ab3-4b96-9f2a-7cfc25ec6835', '9767c24f-6e45-4d00-acdb-b191018739b1', 'b3d7e37a-d9e8-4d3e-9757-1098efe90fed'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:14:42.418976 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-8c01904b-ca22-44f4-839a-0b8864c89796 tempest-GroupSnapshotsV319Test-52705672 None] group_snapshot fa0f6098-2726-41df-bafa-f2fcfa6aee88: deleted successfully Feb 05 21:14:42.665007 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-0947418b-8303-4785-a84b-4a11817baa3e tempest-VolumesSnapshotListTestJSON-677859655 None] Created reservations ['7b6a4d9f-9d3e-4e4e-9300-84b6a07830c5', '7416ae41-b9d4-4762-a781-0445e3929f69', 'f8a19304-e17d-422e-bb14-c13bf7354bed', '8569718f-855b-40ed-b2f1-238f047dc6c0'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:14:42.717207 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-0947418b-8303-4785-a84b-4a11817baa3e tempest-VolumesSnapshotListTestJSON-677859655 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:42.758542 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-0947418b-8303-4785-a84b-4a11817baa3e tempest-VolumesSnapshotListTestJSON-677859655 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:42.806441 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-0947418b-8303-4785-a84b-4a11817baa3e tempest-VolumesSnapshotListTestJSON-677859655 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:14:42.812376 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-0947418b-8303-4785-a84b-4a11817baa3e tempest-VolumesSnapshotListTestJSON-677859655 None] Deleted volume successfully. Feb 05 21:14:42.825183 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-0947418b-8303-4785-a84b-4a11817baa3e tempest-VolumesSnapshotListTestJSON-677859655 None] Lock "b'cinder-c59e504a-a582-4618-8f6f-e28e622f2b5b-delete_volume'" released by "delete_volume" :: held 0.743s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:14:42.937307 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c3e88de7-ed08-4231-be87-eef3da80b953 tempest-GroupSnapshotsV319Test-52705672 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:43.013247 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c3e88de7-ed08-4231-be87-eef3da80b953 tempest-GroupSnapshotsV319Test-52705672 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:14:43.014199 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c3e88de7-ed08-4231-be87-eef3da80b953 tempest-GroupSnapshotsV319Test-52705672 None] Volume volume-3d932127-bbfb-42c1-877e-1a97542e521f is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:14:43.023804 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c3e88de7-ed08-4231-be87-eef3da80b953 tempest-GroupSnapshotsV319Test-52705672 None] deleting rbd volume volume-3d932127-bbfb-42c1-877e-1a97542e521f {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:14:43.040107 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-f16e6258-6885-4886-bf49-93b4ad791f01 req-af004972-1070-40fc-858f-7e2978c690f4 tempest-AttachVolumeShelveTestJSON-1952389738 None] Terminate volume connection completed successfully. Feb 05 21:14:43.040533 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-f16e6258-6885-4886-bf49-93b4ad791f01 req-af004972-1070-40fc-858f-7e2978c690f4 tempest-AttachVolumeShelveTestJSON-1952389738 None] Deleting attachment 0553eb3d-c674-454c-86bd-3dc2ee607455. {{(pid=122683) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 05 21:14:43.349673 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-c3e88de7-ed08-4231-be87-eef3da80b953 tempest-GroupSnapshotsV319Test-52705672 None] Created reservations ['d4a5ec2e-31a8-42aa-9d71-8512fbe9e0cd'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:14:43.373132 ncdv-master-1 cinder-volume[122683]: WARNING cinder.quota [None req-c3e88de7-ed08-4231-be87-eef3da80b953 tempest-GroupSnapshotsV319Test-52705672 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-669640004 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-669640004, it is now deprecated. Please use the default quota class for default quota. Feb 05 21:14:43.391653 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-c3e88de7-ed08-4231-be87-eef3da80b953 tempest-GroupSnapshotsV319Test-52705672 None] Created reservations ['c2f4b16d-b871-4daf-9946-cd3b078f0fc4', 'd6a934c8-c54d-43e2-b110-7bb7fe9a9b19', 'f881bec4-e85c-41f4-9499-215d0657a2d3', 'e8a36d58-c7cd-429f-8cbe-7e61a9697b09'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:14:43.501293 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c3e88de7-ed08-4231-be87-eef3da80b953 tempest-GroupSnapshotsV319Test-52705672 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:43.559587 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c3e88de7-ed08-4231-be87-eef3da80b953 tempest-GroupSnapshotsV319Test-52705672 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:43.610129 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-c3e88de7-ed08-4231-be87-eef3da80b953 tempest-GroupSnapshotsV319Test-52705672 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:14:43.615834 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-c3e88de7-ed08-4231-be87-eef3da80b953 tempest-GroupSnapshotsV319Test-52705672 None] Delete group completed successfully. Feb 05 21:14:48.254189 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-1290e72f-7086-4d9a-bc7c-9fedfc74ef97 tempest-GroupsTest-67999006 None] Group tempest-Group1-213055740: creating Feb 05 21:14:48.289255 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-1290e72f-7086-4d9a-bc7c-9fedfc74ef97 tempest-GroupsTest-67999006 None] Group tempest-Group1-213055740: created successfully Feb 05 21:14:48.300425 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-1290e72f-7086-4d9a-bc7c-9fedfc74ef97 tempest-GroupsTest-67999006 None] Create group completed successfully. Feb 05 21:14:49.503199 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-d48bf4f6-37c9-4abc-afa6-bfc2bf5fc463 tempest-GroupsTest-67999006 None] Group tempest-Group2-1115723541: creating Feb 05 21:14:49.527644 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-d48bf4f6-37c9-4abc-afa6-bfc2bf5fc463 tempest-GroupsTest-67999006 None] Group tempest-Group2-1115723541: created successfully Feb 05 21:14:49.537108 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-d48bf4f6-37c9-4abc-afa6-bfc2bf5fc463 tempest-GroupsTest-67999006 None] Create group completed successfully. Feb 05 21:14:51.134230 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-1468f9a1-bb29-42be-b89c-7af78b060d19 tempest-GroupsTest-67999006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:14:51.143732 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-1468f9a1-bb29-42be-b89c-7af78b060d19 tempest-GroupsTest-67999006 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:14:51.144396 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-1468f9a1-bb29-42be-b89c-7af78b060d19 tempest-GroupsTest-67999006 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:14:51.165724 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1468f9a1-bb29-42be-b89c-7af78b060d19 tempest-GroupsTest-67999006 None] Flow 'volume_create_manager' (68a337b2-41d4-49e8-bffe-3d5a51ebd191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:14:51.176691 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1468f9a1-bb29-42be-b89c-7af78b060d19 tempest-GroupsTest-67999006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1747361-2469-47a2-acd3-23c859ec2443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:51.185225 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-1468f9a1-bb29-42be-b89c-7af78b060d19 tempest-GroupsTest-67999006 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:14:51.204194 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1468f9a1-bb29-42be-b89c-7af78b060d19 tempest-GroupsTest-67999006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1747361-2469-47a2-acd3-23c859ec2443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1722985984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=748b5218-081e-43ba-945b-83f6360196d9,host='ncdv-master-1@ceph#ceph',id=7c6feaf3-cb75-457a-8921-05a5a86de9d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dbc4431206b43a282ed38393beea545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:14:51Z,use_quota=True,user_id='5b76d8606e3d4d2a8cb9f58802cba5d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03c119d5-59f1-43a4-be75-a5fb75518890),volume_type_id=03c119d5-59f1-43a4-be75-a5fb75518890)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:51.213258 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1468f9a1-bb29-42be-b89c-7af78b060d19 tempest-GroupsTest-67999006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (673e9b7a-fa91-4c30-98e2-d57fa2fac8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:51.219071 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1468f9a1-bb29-42be-b89c-7af78b060d19 tempest-GroupsTest-67999006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (673e9b7a-fa91-4c30-98e2-d57fa2fac8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:51.226946 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1468f9a1-bb29-42be-b89c-7af78b060d19 tempest-GroupsTest-67999006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3524a038-9d23-43cd-a61e-3a599e1f72f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:51.232575 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1468f9a1-bb29-42be-b89c-7af78b060d19 tempest-GroupsTest-67999006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3524a038-9d23-43cd-a61e-3a599e1f72f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c6feaf3-cb75-457a-8921-05a5a86de9d2', 'volume_name': 'volume-7c6feaf3-cb75-457a-8921-05a5a86de9d2', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:51.238949 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1468f9a1-bb29-42be-b89c-7af78b060d19 tempest-GroupsTest-67999006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63b9cf82-be9e-446f-9192-008cbcafa278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:51.243865 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1468f9a1-bb29-42be-b89c-7af78b060d19 tempest-GroupsTest-67999006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63b9cf82-be9e-446f-9192-008cbcafa278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:51.249420 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1468f9a1-bb29-42be-b89c-7af78b060d19 tempest-GroupsTest-67999006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff4e9305-16fd-4ef4-ae47-7eeedee944c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:51.250783 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-1468f9a1-bb29-42be-b89c-7af78b060d19 tempest-GroupsTest-67999006 None] Volume 7c6feaf3-cb75-457a-8921-05a5a86de9d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c6feaf3-cb75-457a-8921-05a5a86de9d2', 'volume_size': 1} Feb 05 21:14:51.251843 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1468f9a1-bb29-42be-b89c-7af78b060d19 tempest-GroupsTest-67999006 None] creating volume 'volume-7c6feaf3-cb75-457a-8921-05a5a86de9d2' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:14:51.253348 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1468f9a1-bb29-42be-b89c-7af78b060d19 tempest-GroupsTest-67999006 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:51.378457 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1468f9a1-bb29-42be-b89c-7af78b060d19 tempest-GroupsTest-67999006 None] extra_specs: {} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:14:51.378838 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-1468f9a1-bb29-42be-b89c-7af78b060d19 tempest-GroupsTest-67999006 None] extra_specs: {} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:14:51.388566 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1468f9a1-bb29-42be-b89c-7af78b060d19 tempest-GroupsTest-67999006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff4e9305-16fd-4ef4-ae47-7eeedee944c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c6feaf3-cb75-457a-8921-05a5a86de9d2', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:51.395988 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1468f9a1-bb29-42be-b89c-7af78b060d19 tempest-GroupsTest-67999006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (811930c5-bc4f-4afa-b46f-11d1174647e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:51.408378 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-1468f9a1-bb29-42be-b89c-7af78b060d19 tempest-GroupsTest-67999006 None] Volume volume-7c6feaf3-cb75-457a-8921-05a5a86de9d2 (7c6feaf3-cb75-457a-8921-05a5a86de9d2): created successfully Feb 05 21:14:51.416670 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1468f9a1-bb29-42be-b89c-7af78b060d19 tempest-GroupsTest-67999006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (811930c5-bc4f-4afa-b46f-11d1174647e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:51.425732 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-1468f9a1-bb29-42be-b89c-7af78b060d19 tempest-GroupsTest-67999006 None] Flow 'volume_create_manager' (68a337b2-41d4-49e8-bffe-3d5a51ebd191) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:14:51.440877 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-1468f9a1-bb29-42be-b89c-7af78b060d19 tempest-GroupsTest-67999006 None] Created volume successfully. Feb 05 21:14:52.689161 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:14:52.691400 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:52.749556 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:52.795339 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:14:52.888816 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-776f0898-c551-45ed-9f32-2c48ff19a48f tempest-GroupsTest-67999006 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:52.971291 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-776f0898-c551-45ed-9f32-2c48ff19a48f tempest-GroupsTest-67999006 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:14:52.971972 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-776f0898-c551-45ed-9f32-2c48ff19a48f tempest-GroupsTest-67999006 None] Volume volume-7c6feaf3-cb75-457a-8921-05a5a86de9d2 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:14:52.988783 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-776f0898-c551-45ed-9f32-2c48ff19a48f tempest-GroupsTest-67999006 None] deleting rbd volume volume-7c6feaf3-cb75-457a-8921-05a5a86de9d2 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:14:53.481020 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-776f0898-c551-45ed-9f32-2c48ff19a48f tempest-GroupsTest-67999006 None] Created reservations ['5cc524f7-5604-4257-bc62-d2d8d22034cf'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:14:53.523680 ncdv-master-1 cinder-volume[122683]: WARNING cinder.quota [None req-776f0898-c551-45ed-9f32-2c48ff19a48f tempest-GroupsTest-67999006 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-779438914 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-779438914, it is now deprecated. Please use the default quota class for default quota. Feb 05 21:14:53.525847 ncdv-master-1 cinder-volume[122683]: WARNING cinder.quota [None req-776f0898-c551-45ed-9f32-2c48ff19a48f tempest-GroupsTest-67999006 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-779438914 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-779438914, it is now deprecated. Please use the default quota class for default quota. Feb 05 21:14:53.544739 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-776f0898-c551-45ed-9f32-2c48ff19a48f tempest-GroupsTest-67999006 None] Created reservations ['a9776220-08fb-4bb1-94f7-cefaf764c803', '3c07e364-6efd-45da-b228-bbe08e8c17ce', '79ec545d-1b63-4e15-a20a-4bae0cacf71e', 'c9cde8a2-c8c4-4dbf-9e98-8ee9558cf6e3'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:14:53.656632 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-776f0898-c551-45ed-9f32-2c48ff19a48f tempest-GroupsTest-67999006 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:53.715640 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-776f0898-c551-45ed-9f32-2c48ff19a48f tempest-GroupsTest-67999006 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:53.751250 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-776f0898-c551-45ed-9f32-2c48ff19a48f tempest-GroupsTest-67999006 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:14:53.759384 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-776f0898-c551-45ed-9f32-2c48ff19a48f tempest-GroupsTest-67999006 None] Delete group completed successfully. Feb 05 21:14:54.152659 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-e24ca54b-d4af-471f-89aa-4cef9e26684c tempest-GroupsTest-67999006 None] Created reservations ['2f370403-b7a0-4277-9fb2-0dc26d15bc8e'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:14:54.220795 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e24ca54b-d4af-471f-89aa-4cef9e26684c tempest-GroupsTest-67999006 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:54.310822 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e24ca54b-d4af-471f-89aa-4cef9e26684c tempest-GroupsTest-67999006 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:54.373219 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-e24ca54b-d4af-471f-89aa-4cef9e26684c tempest-GroupsTest-67999006 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:14:54.386515 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-e24ca54b-d4af-471f-89aa-4cef9e26684c tempest-GroupsTest-67999006 None] Delete group completed successfully. Feb 05 21:14:55.931992 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-714796ca-81dd-4654-acc1-1628ff87bd93 tempest-GroupsTest-67999006 None] Group tempest-GroupsTest-Group-864519486: creating Feb 05 21:14:55.968872 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-714796ca-81dd-4654-acc1-1628ff87bd93 tempest-GroupsTest-67999006 None] Group tempest-GroupsTest-Group-864519486: created successfully Feb 05 21:14:56.004903 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-714796ca-81dd-4654-acc1-1628ff87bd93 tempest-GroupsTest-67999006 None] Create group completed successfully. Feb 05 21:14:57.574047 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae6cf6bc-3853-4020-b2f6-ec9be1848817 tempest-GroupsTest-67999006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:14:57.583029 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-ae6cf6bc-3853-4020-b2f6-ec9be1848817 tempest-GroupsTest-67999006 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:14:57.583853 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-ae6cf6bc-3853-4020-b2f6-ec9be1848817 tempest-GroupsTest-67999006 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:14:57.615097 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ae6cf6bc-3853-4020-b2f6-ec9be1848817 tempest-GroupsTest-67999006 None] Flow 'volume_create_manager' (63701087-2254-4e26-93aa-9ce8ae63b35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:14:57.623968 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ae6cf6bc-3853-4020-b2f6-ec9be1848817 tempest-GroupsTest-67999006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9d420b6-ed29-47ae-ad26-dd9d032fcf20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:57.632083 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-ae6cf6bc-3853-4020-b2f6-ec9be1848817 tempest-GroupsTest-67999006 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:14:57.655716 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ae6cf6bc-3853-4020-b2f6-ec9be1848817 tempest-GroupsTest-67999006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9d420b6-ed29-47ae-ad26-dd9d032fcf20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-1367027359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a7edcb19-294d-49d9-ab10-f97682dae96d,host='ncdv-master-1@ceph#ceph',id=6abc1dd0-41fb-4031-ba44-28ab0e31e01f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dbc4431206b43a282ed38393beea545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:14:57Z,use_quota=True,user_id='5b76d8606e3d4d2a8cb9f58802cba5d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c6cb1a5-0c14-43e0-bef6-38d375be22ef),volume_type_id=4c6cb1a5-0c14-43e0-bef6-38d375be22ef)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:57.662799 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ae6cf6bc-3853-4020-b2f6-ec9be1848817 tempest-GroupsTest-67999006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3be14735-9386-46ac-88dd-0c0f63d23de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:57.670711 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ae6cf6bc-3853-4020-b2f6-ec9be1848817 tempest-GroupsTest-67999006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3be14735-9386-46ac-88dd-0c0f63d23de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:57.681339 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ae6cf6bc-3853-4020-b2f6-ec9be1848817 tempest-GroupsTest-67999006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b43bcb-6907-477a-9652-1849de799055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:57.687670 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ae6cf6bc-3853-4020-b2f6-ec9be1848817 tempest-GroupsTest-67999006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b43bcb-6907-477a-9652-1849de799055) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6abc1dd0-41fb-4031-ba44-28ab0e31e01f', 'volume_name': 'volume-6abc1dd0-41fb-4031-ba44-28ab0e31e01f', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:57.695838 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ae6cf6bc-3853-4020-b2f6-ec9be1848817 tempest-GroupsTest-67999006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92ec9395-86d6-4c2c-b251-d40e1a60fea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:57.701246 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ae6cf6bc-3853-4020-b2f6-ec9be1848817 tempest-GroupsTest-67999006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92ec9395-86d6-4c2c-b251-d40e1a60fea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:57.706888 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ae6cf6bc-3853-4020-b2f6-ec9be1848817 tempest-GroupsTest-67999006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5655106d-6d98-448f-8bd7-87cf37cc447d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:57.708295 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-ae6cf6bc-3853-4020-b2f6-ec9be1848817 tempest-GroupsTest-67999006 None] Volume 6abc1dd0-41fb-4031-ba44-28ab0e31e01f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6abc1dd0-41fb-4031-ba44-28ab0e31e01f', 'volume_size': 1} Feb 05 21:14:57.708915 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ae6cf6bc-3853-4020-b2f6-ec9be1848817 tempest-GroupsTest-67999006 None] creating volume 'volume-6abc1dd0-41fb-4031-ba44-28ab0e31e01f' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:14:57.710252 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ae6cf6bc-3853-4020-b2f6-ec9be1848817 tempest-GroupsTest-67999006 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:57.822473 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ae6cf6bc-3853-4020-b2f6-ec9be1848817 tempest-GroupsTest-67999006 None] extra_specs: {} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:14:57.822862 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ae6cf6bc-3853-4020-b2f6-ec9be1848817 tempest-GroupsTest-67999006 None] extra_specs: {} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:14:57.829883 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ae6cf6bc-3853-4020-b2f6-ec9be1848817 tempest-GroupsTest-67999006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5655106d-6d98-448f-8bd7-87cf37cc447d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6abc1dd0-41fb-4031-ba44-28ab0e31e01f', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:57.838023 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ae6cf6bc-3853-4020-b2f6-ec9be1848817 tempest-GroupsTest-67999006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5937b272-6281-4085-8fca-e9571bc9a7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:57.856338 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-ae6cf6bc-3853-4020-b2f6-ec9be1848817 tempest-GroupsTest-67999006 None] Volume volume-6abc1dd0-41fb-4031-ba44-28ab0e31e01f (6abc1dd0-41fb-4031-ba44-28ab0e31e01f): created successfully Feb 05 21:14:57.860044 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ae6cf6bc-3853-4020-b2f6-ec9be1848817 tempest-GroupsTest-67999006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5937b272-6281-4085-8fca-e9571bc9a7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:57.870170 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ae6cf6bc-3853-4020-b2f6-ec9be1848817 tempest-GroupsTest-67999006 None] Flow 'volume_create_manager' (63701087-2254-4e26-93aa-9ce8ae63b35d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:14:57.880097 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-ae6cf6bc-3853-4020-b2f6-ec9be1848817 tempest-GroupsTest-67999006 None] Created volume successfully. Feb 05 21:14:59.155103 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ea078b2-53db-4ab2-a2ea-94692a934658 tempest-GroupsTest-67999006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:14:59.160862 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-8ea078b2-53db-4ab2-a2ea-94692a934658 tempest-GroupsTest-67999006 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:14:59.161599 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-8ea078b2-53db-4ab2-a2ea-94692a934658 tempest-GroupsTest-67999006 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:14:59.183358 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8ea078b2-53db-4ab2-a2ea-94692a934658 tempest-GroupsTest-67999006 None] Flow 'volume_create_manager' (81723160-5f3d-4525-846c-f29110f239d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:14:59.191191 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8ea078b2-53db-4ab2-a2ea-94692a934658 tempest-GroupsTest-67999006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ddeb1d2-29dd-4d4a-a898-331a1ebb1210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:59.198058 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-8ea078b2-53db-4ab2-a2ea-94692a934658 tempest-GroupsTest-67999006 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:14:59.213031 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8ea078b2-53db-4ab2-a2ea-94692a934658 tempest-GroupsTest-67999006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ddeb1d2-29dd-4d4a-a898-331a1ebb1210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-1817054365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a7edcb19-294d-49d9-ab10-f97682dae96d,host='ncdv-master-1@ceph#ceph',id=e2030c22-17b7-4081-805f-7a24eb6b5163,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dbc4431206b43a282ed38393beea545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:14:59Z,use_quota=True,user_id='5b76d8606e3d4d2a8cb9f58802cba5d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c6cb1a5-0c14-43e0-bef6-38d375be22ef),volume_type_id=4c6cb1a5-0c14-43e0-bef6-38d375be22ef)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:59.219227 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8ea078b2-53db-4ab2-a2ea-94692a934658 tempest-GroupsTest-67999006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e418e98-6c7b-4c0d-b38c-382ec4155fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:59.224155 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8ea078b2-53db-4ab2-a2ea-94692a934658 tempest-GroupsTest-67999006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e418e98-6c7b-4c0d-b38c-382ec4155fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:59.229574 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8ea078b2-53db-4ab2-a2ea-94692a934658 tempest-GroupsTest-67999006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b049e039-578c-4c39-b30c-344b2f181135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:59.233825 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8ea078b2-53db-4ab2-a2ea-94692a934658 tempest-GroupsTest-67999006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b049e039-578c-4c39-b30c-344b2f181135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2030c22-17b7-4081-805f-7a24eb6b5163', 'volume_name': 'volume-e2030c22-17b7-4081-805f-7a24eb6b5163', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:59.239467 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8ea078b2-53db-4ab2-a2ea-94692a934658 tempest-GroupsTest-67999006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79a7c6bf-e8b2-4e7d-973d-09d342ae6b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:59.243686 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8ea078b2-53db-4ab2-a2ea-94692a934658 tempest-GroupsTest-67999006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79a7c6bf-e8b2-4e7d-973d-09d342ae6b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:59.248991 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8ea078b2-53db-4ab2-a2ea-94692a934658 tempest-GroupsTest-67999006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffe2479e-097a-4578-a9c5-e0a77546409c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:59.250160 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-8ea078b2-53db-4ab2-a2ea-94692a934658 tempest-GroupsTest-67999006 None] Volume e2030c22-17b7-4081-805f-7a24eb6b5163: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2030c22-17b7-4081-805f-7a24eb6b5163', 'volume_size': 1} Feb 05 21:14:59.250584 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8ea078b2-53db-4ab2-a2ea-94692a934658 tempest-GroupsTest-67999006 None] creating volume 'volume-e2030c22-17b7-4081-805f-7a24eb6b5163' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:14:59.252114 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8ea078b2-53db-4ab2-a2ea-94692a934658 tempest-GroupsTest-67999006 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:14:59.348481 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8ea078b2-53db-4ab2-a2ea-94692a934658 tempest-GroupsTest-67999006 None] extra_specs: {} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:14:59.348850 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-8ea078b2-53db-4ab2-a2ea-94692a934658 tempest-GroupsTest-67999006 None] extra_specs: {} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:14:59.354135 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8ea078b2-53db-4ab2-a2ea-94692a934658 tempest-GroupsTest-67999006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffe2479e-097a-4578-a9c5-e0a77546409c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2030c22-17b7-4081-805f-7a24eb6b5163', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:59.364108 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8ea078b2-53db-4ab2-a2ea-94692a934658 tempest-GroupsTest-67999006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a60b2b3d-20b8-41ff-8a64-b78db4d5aeb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:14:59.380167 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-8ea078b2-53db-4ab2-a2ea-94692a934658 tempest-GroupsTest-67999006 None] Volume volume-e2030c22-17b7-4081-805f-7a24eb6b5163 (e2030c22-17b7-4081-805f-7a24eb6b5163): created successfully Feb 05 21:14:59.384305 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8ea078b2-53db-4ab2-a2ea-94692a934658 tempest-GroupsTest-67999006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a60b2b3d-20b8-41ff-8a64-b78db4d5aeb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:14:59.391066 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-8ea078b2-53db-4ab2-a2ea-94692a934658 tempest-GroupsTest-67999006 None] Flow 'volume_create_manager' (81723160-5f3d-4525-846c-f29110f239d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:14:59.403099 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-8ea078b2-53db-4ab2-a2ea-94692a934658 tempest-GroupsTest-67999006 None] Created volume successfully. Feb 05 21:15:00.327409 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-5cb87cdf-e801-482a-b145-be953e8570f4 tempest-GroupsTest-67999006 None] Update group completed successfully. Feb 05 21:15:01.599705 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-603fbb67-522b-4e1a-8211-dfe72ec61641 tempest-GroupsTest-67999006 None] Update group completed successfully. Feb 05 21:15:02.870864 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-59838117-bddf-4ede-954b-21c5ca2a8611 tempest-TestVolumeBootPattern-571902767 None] Created reservations ['54fed521-1786-4a95-8dcd-fcb8a88b87ac', '5d8e76c3-7d79-42c0-8aa9-311bf14dd052', '3d7215f7-1017-4b6b-b03c-7ae02bef48b3', 'fb63f57d-2382-4db8-a197-b251edad762a'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:15:03.017727 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-59838117-bddf-4ede-954b-21c5ca2a8611 tempest-TestVolumeBootPattern-571902767 None] Delete snapshot completed successfully. Feb 05 21:15:03.027432 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-59838117-bddf-4ede-954b-21c5ca2a8611 tempest-TestVolumeBootPattern-571902767 None] Lock "b'cinder-89d44f58-cf24-4c84-b194-449478786291-delete_snapshot'" released by "delete_snapshot" :: held 30.471s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:15:03.435236 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-675090aa-e403-40fa-bc3e-4e9173939346 tempest-GroupsTest-67999006 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:15:03.538537 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-675090aa-e403-40fa-bc3e-4e9173939346 tempest-GroupsTest-67999006 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:15:03.539185 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-675090aa-e403-40fa-bc3e-4e9173939346 tempest-GroupsTest-67999006 None] Volume volume-6abc1dd0-41fb-4031-ba44-28ab0e31e01f is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:15:03.548450 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-675090aa-e403-40fa-bc3e-4e9173939346 tempest-GroupsTest-67999006 None] deleting rbd volume volume-6abc1dd0-41fb-4031-ba44-28ab0e31e01f {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:15:03.815978 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-675090aa-e403-40fa-bc3e-4e9173939346 tempest-GroupsTest-67999006 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:15:03.881390 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-675090aa-e403-40fa-bc3e-4e9173939346 tempest-GroupsTest-67999006 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:15:03.882110 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-675090aa-e403-40fa-bc3e-4e9173939346 tempest-GroupsTest-67999006 None] Volume volume-e2030c22-17b7-4081-805f-7a24eb6b5163 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:15:03.888357 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-675090aa-e403-40fa-bc3e-4e9173939346 tempest-GroupsTest-67999006 None] deleting rbd volume volume-e2030c22-17b7-4081-805f-7a24eb6b5163 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:15:04.335675 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-675090aa-e403-40fa-bc3e-4e9173939346 tempest-GroupsTest-67999006 None] Created reservations ['59c4b2d1-c1ee-4720-bf4e-5bc59751ede1'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:15:04.357469 ncdv-master-1 cinder-volume[122683]: WARNING cinder.quota [None req-675090aa-e403-40fa-bc3e-4e9173939346 tempest-GroupsTest-67999006 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-475964560 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-475964560, it is now deprecated. Please use the default quota class for default quota. Feb 05 21:15:04.358775 ncdv-master-1 cinder-volume[122683]: WARNING cinder.quota [None req-675090aa-e403-40fa-bc3e-4e9173939346 tempest-GroupsTest-67999006 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-475964560 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-475964560, it is now deprecated. Please use the default quota class for default quota. Feb 05 21:15:04.378887 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-675090aa-e403-40fa-bc3e-4e9173939346 tempest-GroupsTest-67999006 None] Created reservations ['d116d026-c412-4f68-8a21-4572b489fef3', 'a154f5fa-a043-42b3-aef4-a846f1c26b1a', 'd81105fb-017c-4ce3-9865-24f7e177f964', '79ac60b8-1d3b-4ddd-8e9c-b3c82c4f715b'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:15:04.470339 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-675090aa-e403-40fa-bc3e-4e9173939346 tempest-GroupsTest-67999006 None] Created reservations ['f9d21976-95ad-4178-a111-7b49d03fad82', '7380152f-0d54-4d7c-916c-ee2d3a6b00fa', '55e9b9ad-6137-4edb-b8b4-72d49167a3dd', '6895eb12-ceef-4938-8d1d-24a3af496e2d'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:15:04.581762 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-675090aa-e403-40fa-bc3e-4e9173939346 tempest-GroupsTest-67999006 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:15:04.655700 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-675090aa-e403-40fa-bc3e-4e9173939346 tempest-GroupsTest-67999006 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:15:04.715906 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-675090aa-e403-40fa-bc3e-4e9173939346 tempest-GroupsTest-67999006 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:15:04.722958 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-675090aa-e403-40fa-bc3e-4e9173939346 tempest-GroupsTest-67999006 None] Delete group completed successfully. Feb 05 21:15:08.717467 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-9e98eae3-f27c-4411-8865-f22291851759 req-4434ec47-c18c-4df9-84f2-30584363f184 tempest-TestVolumeBootPattern-571902767 None] Terminate volume connection completed successfully. Feb 05 21:15:08.718048 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-9e98eae3-f27c-4411-8865-f22291851759 req-4434ec47-c18c-4df9-84f2-30584363f184 tempest-TestVolumeBootPattern-571902767 None] Deleting attachment 323f5193-989b-4a1c-91ff-d60fb45f3f48. {{(pid=122683) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 05 21:15:10.653330 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-6589f58f-37d6-4ce3-b112-0ac4ff26ea43 tempest-TestVolumeBootPattern-571902767 None] Lock "b'cinder-882c36fd-3df2-4b63-92a4-d96715cad128-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:15:10.710742 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6589f58f-37d6-4ce3-b112-0ac4ff26ea43 tempest-TestVolumeBootPattern-571902767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:15:10.801335 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6589f58f-37d6-4ce3-b112-0ac4ff26ea43 tempest-TestVolumeBootPattern-571902767 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:15:10.808743 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6589f58f-37d6-4ce3-b112-0ac4ff26ea43 tempest-TestVolumeBootPattern-571902767 None] deleting rbd volume volume-882c36fd-3df2-4b63-92a4-d96715cad128 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:15:11.148414 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6589f58f-37d6-4ce3-b112-0ac4ff26ea43 tempest-TestVolumeBootPattern-571902767 None] volume is a clone so cleaning references {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 05 21:15:11.190764 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6589f58f-37d6-4ce3-b112-0ac4ff26ea43 tempest-TestVolumeBootPattern-571902767 None] deleting parent snapshot volume-882c36fd-3df2-4b63-92a4-d96715cad128.clone_snap {{(pid=122683) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 05 21:15:11.519968 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-6589f58f-37d6-4ce3-b112-0ac4ff26ea43 tempest-TestVolumeBootPattern-571902767 None] Created reservations ['28dc2b86-10ec-42c2-9331-63dcc2f1e655', 'fcf6fdb7-90a5-4a0e-9ea3-3e2e56d00cdb', 'c302596c-4b3c-4581-8aea-bf096df586b2', '7a1aa448-5b49-49c0-80ff-c25798da5818'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:15:11.587687 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6589f58f-37d6-4ce3-b112-0ac4ff26ea43 tempest-TestVolumeBootPattern-571902767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:15:11.640044 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6589f58f-37d6-4ce3-b112-0ac4ff26ea43 tempest-TestVolumeBootPattern-571902767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:15:11.699076 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6589f58f-37d6-4ce3-b112-0ac4ff26ea43 tempest-TestVolumeBootPattern-571902767 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:15:11.713826 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-6589f58f-37d6-4ce3-b112-0ac4ff26ea43 tempest-TestVolumeBootPattern-571902767 None] Deleted volume successfully. Feb 05 21:15:11.744853 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-6589f58f-37d6-4ce3-b112-0ac4ff26ea43 tempest-TestVolumeBootPattern-571902767 None] Lock "b'cinder-882c36fd-3df2-4b63-92a4-d96715cad128-delete_volume'" released by "delete_volume" :: held 1.091s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:15:12.113065 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-9586e2a4-c3e9-4c0d-8df6-cc3d54527c99 tempest-VolumesMetadataTest-1173381340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:15:12.117023 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-9586e2a4-c3e9-4c0d-8df6-cc3d54527c99 tempest-VolumesMetadataTest-1173381340 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:15:12.117535 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-9586e2a4-c3e9-4c0d-8df6-cc3d54527c99 tempest-VolumesMetadataTest-1173381340 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:15:12.139614 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9586e2a4-c3e9-4c0d-8df6-cc3d54527c99 tempest-VolumesMetadataTest-1173381340 None] Flow 'volume_create_manager' (0ed4cad6-94aa-4ecc-9d8b-ed497e942449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:15:12.146979 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9586e2a4-c3e9-4c0d-8df6-cc3d54527c99 tempest-VolumesMetadataTest-1173381340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99f509ee-c50c-42e5-a474-eafeea16784d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:15:12.153917 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-9586e2a4-c3e9-4c0d-8df6-cc3d54527c99 tempest-VolumesMetadataTest-1173381340 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:15:12.170662 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9586e2a4-c3e9-4c0d-8df6-cc3d54527c99 tempest-VolumesMetadataTest-1173381340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99f509ee-c50c-42e5-a474-eafeea16784d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1987612512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=982b3d4a-517f-4834-ad5b-15122dc92b7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27d6c1c3d2c3470eb6bcdbc6a1e4f60a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:15:12Z,use_quota=True,user_id='bb71bfa0583e42c797d53a74a9999554',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:15:12.178023 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9586e2a4-c3e9-4c0d-8df6-cc3d54527c99 tempest-VolumesMetadataTest-1173381340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efd4543a-fc56-4bc3-b641-753f6162ad5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:15:12.183047 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9586e2a4-c3e9-4c0d-8df6-cc3d54527c99 tempest-VolumesMetadataTest-1173381340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efd4543a-fc56-4bc3-b641-753f6162ad5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:15:12.196078 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9586e2a4-c3e9-4c0d-8df6-cc3d54527c99 tempest-VolumesMetadataTest-1173381340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a8f1206-b777-45bc-a60e-cf0de71c54d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:15:12.200550 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9586e2a4-c3e9-4c0d-8df6-cc3d54527c99 tempest-VolumesMetadataTest-1173381340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a8f1206-b777-45bc-a60e-cf0de71c54d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '982b3d4a-517f-4834-ad5b-15122dc92b7a', 'volume_name': 'volume-982b3d4a-517f-4834-ad5b-15122dc92b7a', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:15:12.206460 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9586e2a4-c3e9-4c0d-8df6-cc3d54527c99 tempest-VolumesMetadataTest-1173381340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4cdf7b2-7493-4c98-af9f-16620e7b0204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:15:12.211472 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9586e2a4-c3e9-4c0d-8df6-cc3d54527c99 tempest-VolumesMetadataTest-1173381340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4cdf7b2-7493-4c98-af9f-16620e7b0204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:15:12.217278 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9586e2a4-c3e9-4c0d-8df6-cc3d54527c99 tempest-VolumesMetadataTest-1173381340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34938649-abe3-4aff-b39b-145905fcd92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:15:12.218432 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-9586e2a4-c3e9-4c0d-8df6-cc3d54527c99 tempest-VolumesMetadataTest-1173381340 None] Volume 982b3d4a-517f-4834-ad5b-15122dc92b7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-982b3d4a-517f-4834-ad5b-15122dc92b7a', 'volume_size': 1} Feb 05 21:15:12.219110 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-9586e2a4-c3e9-4c0d-8df6-cc3d54527c99 tempest-VolumesMetadataTest-1173381340 None] creating volume 'volume-982b3d4a-517f-4834-ad5b-15122dc92b7a' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:15:12.220173 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-9586e2a4-c3e9-4c0d-8df6-cc3d54527c99 tempest-VolumesMetadataTest-1173381340 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:15:12.275828 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-9586e2a4-c3e9-4c0d-8df6-cc3d54527c99 tempest-VolumesMetadataTest-1173381340 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:15:12.276264 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-9586e2a4-c3e9-4c0d-8df6-cc3d54527c99 tempest-VolumesMetadataTest-1173381340 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:15:12.280146 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9586e2a4-c3e9-4c0d-8df6-cc3d54527c99 tempest-VolumesMetadataTest-1173381340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34938649-abe3-4aff-b39b-145905fcd92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-982b3d4a-517f-4834-ad5b-15122dc92b7a', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:15:12.285058 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9586e2a4-c3e9-4c0d-8df6-cc3d54527c99 tempest-VolumesMetadataTest-1173381340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff7ebfe-a76b-431c-8313-5111d998674c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:15:12.293942 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-9586e2a4-c3e9-4c0d-8df6-cc3d54527c99 tempest-VolumesMetadataTest-1173381340 None] Volume volume-982b3d4a-517f-4834-ad5b-15122dc92b7a (982b3d4a-517f-4834-ad5b-15122dc92b7a): created successfully Feb 05 21:15:12.298692 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9586e2a4-c3e9-4c0d-8df6-cc3d54527c99 tempest-VolumesMetadataTest-1173381340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff7ebfe-a76b-431c-8313-5111d998674c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:15:12.304494 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9586e2a4-c3e9-4c0d-8df6-cc3d54527c99 tempest-VolumesMetadataTest-1173381340 None] Flow 'volume_create_manager' (0ed4cad6-94aa-4ecc-9d8b-ed497e942449) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:15:12.312101 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-9586e2a4-c3e9-4c0d-8df6-cc3d54527c99 tempest-VolumesMetadataTest-1173381340 None] Created volume successfully. Feb 05 21:15:13.142678 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b355e76-55ef-42ce-80ad-3247f635bda8 tempest-AttachVolumeShelveTestJSON-1952389738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:15:13.147789 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-6b355e76-55ef-42ce-80ad-3247f635bda8 tempest-AttachVolumeShelveTestJSON-1952389738 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:15:13.149065 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-6b355e76-55ef-42ce-80ad-3247f635bda8 tempest-AttachVolumeShelveTestJSON-1952389738 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:15:13.172392 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6b355e76-55ef-42ce-80ad-3247f635bda8 tempest-AttachVolumeShelveTestJSON-1952389738 None] Flow 'volume_create_manager' (511b35f3-14f7-4a4a-a330-71c94f3b7c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:15:13.180131 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6b355e76-55ef-42ce-80ad-3247f635bda8 tempest-AttachVolumeShelveTestJSON-1952389738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce872bf8-fd0f-4467-828d-337c2165cbb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:15:13.187205 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-6b355e76-55ef-42ce-80ad-3247f635bda8 tempest-AttachVolumeShelveTestJSON-1952389738 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:15:13.204560 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6b355e76-55ef-42ce-80ad-3247f635bda8 tempest-AttachVolumeShelveTestJSON-1952389738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce872bf8-fd0f-4467-828d-337c2165cbb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1624805185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e3f89471-88d8-4161-a200-64c691fc183f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2af23abad4048358818a1b4ba0f5aa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:15:13Z,use_quota=True,user_id='e8ace6d411c247d6bbb7ca533da72ce7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:15:13.211641 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6b355e76-55ef-42ce-80ad-3247f635bda8 tempest-AttachVolumeShelveTestJSON-1952389738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1416a42f-804d-4a4c-9c39-96f07ee754fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:15:13.218325 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6b355e76-55ef-42ce-80ad-3247f635bda8 tempest-AttachVolumeShelveTestJSON-1952389738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1416a42f-804d-4a4c-9c39-96f07ee754fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:15:13.225057 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6b355e76-55ef-42ce-80ad-3247f635bda8 tempest-AttachVolumeShelveTestJSON-1952389738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dfcfa36-ddfc-4e55-bc48-33c5269da01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:15:13.230095 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6b355e76-55ef-42ce-80ad-3247f635bda8 tempest-AttachVolumeShelveTestJSON-1952389738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dfcfa36-ddfc-4e55-bc48-33c5269da01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3f89471-88d8-4161-a200-64c691fc183f', 'volume_name': 'volume-e3f89471-88d8-4161-a200-64c691fc183f', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:15:13.236872 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6b355e76-55ef-42ce-80ad-3247f635bda8 tempest-AttachVolumeShelveTestJSON-1952389738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0315a29f-3ca3-4cbd-ac74-f16d48ba863b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:15:13.241705 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6b355e76-55ef-42ce-80ad-3247f635bda8 tempest-AttachVolumeShelveTestJSON-1952389738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0315a29f-3ca3-4cbd-ac74-f16d48ba863b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:15:13.246991 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6b355e76-55ef-42ce-80ad-3247f635bda8 tempest-AttachVolumeShelveTestJSON-1952389738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bd63325-4c6c-4789-b48f-abffe74841e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:15:13.248366 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-6b355e76-55ef-42ce-80ad-3247f635bda8 tempest-AttachVolumeShelveTestJSON-1952389738 None] Volume e3f89471-88d8-4161-a200-64c691fc183f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3f89471-88d8-4161-a200-64c691fc183f', 'volume_size': 1} Feb 05 21:15:13.249064 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6b355e76-55ef-42ce-80ad-3247f635bda8 tempest-AttachVolumeShelveTestJSON-1952389738 None] creating volume 'volume-e3f89471-88d8-4161-a200-64c691fc183f' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:15:13.251369 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6b355e76-55ef-42ce-80ad-3247f635bda8 tempest-AttachVolumeShelveTestJSON-1952389738 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:15:13.337382 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6b355e76-55ef-42ce-80ad-3247f635bda8 tempest-AttachVolumeShelveTestJSON-1952389738 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:15:13.337761 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6b355e76-55ef-42ce-80ad-3247f635bda8 tempest-AttachVolumeShelveTestJSON-1952389738 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:15:13.343464 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6b355e76-55ef-42ce-80ad-3247f635bda8 tempest-AttachVolumeShelveTestJSON-1952389738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bd63325-4c6c-4789-b48f-abffe74841e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3f89471-88d8-4161-a200-64c691fc183f', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:15:13.351643 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6b355e76-55ef-42ce-80ad-3247f635bda8 tempest-AttachVolumeShelveTestJSON-1952389738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab4ae296-5e90-487c-8e89-bd6505cafd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:15:13.365417 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-6b355e76-55ef-42ce-80ad-3247f635bda8 tempest-AttachVolumeShelveTestJSON-1952389738 None] Volume volume-e3f89471-88d8-4161-a200-64c691fc183f (e3f89471-88d8-4161-a200-64c691fc183f): created successfully Feb 05 21:15:13.373949 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6b355e76-55ef-42ce-80ad-3247f635bda8 tempest-AttachVolumeShelveTestJSON-1952389738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab4ae296-5e90-487c-8e89-bd6505cafd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:15:13.382197 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6b355e76-55ef-42ce-80ad-3247f635bda8 tempest-AttachVolumeShelveTestJSON-1952389738 None] Flow 'volume_create_manager' (511b35f3-14f7-4a4a-a330-71c94f3b7c9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:15:13.395445 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-6b355e76-55ef-42ce-80ad-3247f635bda8 tempest-AttachVolumeShelveTestJSON-1952389738 None] Created volume successfully. Feb 05 21:15:13.835863 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-88ac95b8-64fd-4f3d-89ec-c2f59c6f9f3e tempest-VolumesMetadataTest-1173381340 None] Lock "b'cinder-982b3d4a-517f-4834-ad5b-15122dc92b7a-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:15:13.888227 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-88ac95b8-64fd-4f3d-89ec-c2f59c6f9f3e tempest-VolumesMetadataTest-1173381340 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:15:13.982985 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-88ac95b8-64fd-4f3d-89ec-c2f59c6f9f3e tempest-VolumesMetadataTest-1173381340 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:15:13.983419 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-88ac95b8-64fd-4f3d-89ec-c2f59c6f9f3e tempest-VolumesMetadataTest-1173381340 None] Volume volume-982b3d4a-517f-4834-ad5b-15122dc92b7a is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:15:13.999174 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-88ac95b8-64fd-4f3d-89ec-c2f59c6f9f3e tempest-VolumesMetadataTest-1173381340 None] deleting rbd volume volume-982b3d4a-517f-4834-ad5b-15122dc92b7a {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:15:14.362189 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-88ac95b8-64fd-4f3d-89ec-c2f59c6f9f3e tempest-VolumesMetadataTest-1173381340 None] Created reservations ['ee436341-befd-488f-bb85-dc501c617265', '989be5fa-5fbf-41c8-8b9c-3f7952b90044', 'e98d89ae-8af4-4b70-8ba1-931bc8a5dc1b', '6417c8f0-271d-49e6-b4ca-8b10a074e58f'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:15:14.427819 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-88ac95b8-64fd-4f3d-89ec-c2f59c6f9f3e tempest-VolumesMetadataTest-1173381340 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:15:14.477177 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-88ac95b8-64fd-4f3d-89ec-c2f59c6f9f3e tempest-VolumesMetadataTest-1173381340 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:15:14.523240 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-88ac95b8-64fd-4f3d-89ec-c2f59c6f9f3e tempest-VolumesMetadataTest-1173381340 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:15:14.530881 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-88ac95b8-64fd-4f3d-89ec-c2f59c6f9f3e tempest-VolumesMetadataTest-1173381340 None] Deleted volume successfully. Feb 05 21:15:14.549462 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-88ac95b8-64fd-4f3d-89ec-c2f59c6f9f3e tempest-VolumesMetadataTest-1173381340 None] Lock "b'cinder-982b3d4a-517f-4834-ad5b-15122dc92b7a-delete_volume'" released by "delete_volume" :: held 0.714s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:15:18.991210 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-5788565d-f8f8-4cce-ac62-4cb3ef0363cc tempest-VolumesActionsTest-1432060990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:15:18.995858 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-5788565d-f8f8-4cce-ac62-4cb3ef0363cc tempest-VolumesActionsTest-1432060990 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:15:18.996547 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-5788565d-f8f8-4cce-ac62-4cb3ef0363cc tempest-VolumesActionsTest-1432060990 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:15:19.019148 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5788565d-f8f8-4cce-ac62-4cb3ef0363cc tempest-VolumesActionsTest-1432060990 None] Flow 'volume_create_manager' (7df46980-e531-46b0-a871-1d62f4626614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:15:19.025798 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5788565d-f8f8-4cce-ac62-4cb3ef0363cc tempest-VolumesActionsTest-1432060990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (046450da-8043-4829-84b4-1ab06236194d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:15:19.033718 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-5788565d-f8f8-4cce-ac62-4cb3ef0363cc tempest-VolumesActionsTest-1432060990 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:15:19.050574 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5788565d-f8f8-4cce-ac62-4cb3ef0363cc tempest-VolumesActionsTest-1432060990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (046450da-8043-4829-84b4-1ab06236194d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-466190365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d894a429-9234-4297-8020-0f2629bf0e19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ad6548f8af9452f82b15bb4ffcfaa26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:15:19Z,use_quota=True,user_id='c13effb71ba94ceca9c00718bedec0a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:15:19.056270 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5788565d-f8f8-4cce-ac62-4cb3ef0363cc tempest-VolumesActionsTest-1432060990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27ecccf8-c5bf-4841-abc1-4f8a133fb834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:15:19.060499 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5788565d-f8f8-4cce-ac62-4cb3ef0363cc tempest-VolumesActionsTest-1432060990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27ecccf8-c5bf-4841-abc1-4f8a133fb834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:15:19.066037 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5788565d-f8f8-4cce-ac62-4cb3ef0363cc tempest-VolumesActionsTest-1432060990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16ec5462-2e99-4078-b20c-ad8883a16d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:15:19.070710 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5788565d-f8f8-4cce-ac62-4cb3ef0363cc tempest-VolumesActionsTest-1432060990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16ec5462-2e99-4078-b20c-ad8883a16d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd894a429-9234-4297-8020-0f2629bf0e19', 'volume_name': 'volume-d894a429-9234-4297-8020-0f2629bf0e19', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:15:19.075957 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5788565d-f8f8-4cce-ac62-4cb3ef0363cc tempest-VolumesActionsTest-1432060990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb456f55-a5e7-4e4b-87f7-e137d5088015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:15:19.080825 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5788565d-f8f8-4cce-ac62-4cb3ef0363cc tempest-VolumesActionsTest-1432060990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb456f55-a5e7-4e4b-87f7-e137d5088015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:15:19.085734 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5788565d-f8f8-4cce-ac62-4cb3ef0363cc tempest-VolumesActionsTest-1432060990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5abd7606-6c53-4e0e-a76f-ea289e5db42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:15:19.086861 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-5788565d-f8f8-4cce-ac62-4cb3ef0363cc tempest-VolumesActionsTest-1432060990 None] Volume d894a429-9234-4297-8020-0f2629bf0e19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d894a429-9234-4297-8020-0f2629bf0e19', 'volume_size': 1} Feb 05 21:15:19.087256 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5788565d-f8f8-4cce-ac62-4cb3ef0363cc tempest-VolumesActionsTest-1432060990 None] creating volume 'volume-d894a429-9234-4297-8020-0f2629bf0e19' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:15:19.088245 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5788565d-f8f8-4cce-ac62-4cb3ef0363cc tempest-VolumesActionsTest-1432060990 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:15:19.151395 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5788565d-f8f8-4cce-ac62-4cb3ef0363cc tempest-VolumesActionsTest-1432060990 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:15:19.151778 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5788565d-f8f8-4cce-ac62-4cb3ef0363cc tempest-VolumesActionsTest-1432060990 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:15:19.155608 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5788565d-f8f8-4cce-ac62-4cb3ef0363cc tempest-VolumesActionsTest-1432060990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5abd7606-6c53-4e0e-a76f-ea289e5db42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d894a429-9234-4297-8020-0f2629bf0e19', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:15:19.161138 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5788565d-f8f8-4cce-ac62-4cb3ef0363cc tempest-VolumesActionsTest-1432060990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6de7055-6a86-451c-aa10-2b09ba44436e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:15:19.170839 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-5788565d-f8f8-4cce-ac62-4cb3ef0363cc tempest-VolumesActionsTest-1432060990 None] Volume volume-d894a429-9234-4297-8020-0f2629bf0e19 (d894a429-9234-4297-8020-0f2629bf0e19): created successfully Feb 05 21:15:19.174502 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5788565d-f8f8-4cce-ac62-4cb3ef0363cc tempest-VolumesActionsTest-1432060990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6de7055-6a86-451c-aa10-2b09ba44436e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:15:19.180116 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5788565d-f8f8-4cce-ac62-4cb3ef0363cc tempest-VolumesActionsTest-1432060990 None] Flow 'volume_create_manager' (7df46980-e531-46b0-a871-1d62f4626614) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:15:19.189717 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-5788565d-f8f8-4cce-ac62-4cb3ef0363cc tempest-VolumesActionsTest-1432060990 None] Created volume successfully. Feb 05 21:15:31.298873 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-9cb56093-2166-45ef-8334-c824bcfa5028 tempest-VolumesActionsTest-1432060990 None] Lock "b'cinder-d894a429-9234-4297-8020-0f2629bf0e19'" acquired by "attach_volume" :: waited 0.009s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:15:31.334815 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-9cb56093-2166-45ef-8334-c824bcfa5028 tempest-VolumesActionsTest-1432060990 None] Attaching volume d894a429-9234-4297-8020-0f2629bf0e19 to instance 8d749470-4f50-417f-8446-a1a726fae5d8 at mountpoint /dev/sdb on host None. Feb 05 21:15:31.357408 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-9cb56093-2166-45ef-8334-c824bcfa5028 tempest-VolumesActionsTest-1432060990 None] Attach volume completed successfully. Feb 05 21:15:31.364191 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-9cb56093-2166-45ef-8334-c824bcfa5028 tempest-VolumesActionsTest-1432060990 None] Lock "b'cinder-d894a429-9234-4297-8020-0f2629bf0e19'" released by "attach_volume" :: held 0.065s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:15:31.465299 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-b0b52a9e-49d8-4dbb-884e-34f3d3615936 tempest-VolumesActionsTest-1432060990 None] Lock "b'cinder-d894a429-9234-4297-8020-0f2629bf0e19-detach_volume'" acquired by "detach_volume" :: waited 0.008s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:15:31.465803 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-b0b52a9e-49d8-4dbb-884e-34f3d3615936 tempest-VolumesActionsTest-1432060990 None] Detaching volume d894a429-9234-4297-8020-0f2629bf0e19 from instance 8d749470-4f50-417f-8446-a1a726fae5d8. Feb 05 21:15:31.499217 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-b0b52a9e-49d8-4dbb-884e-34f3d3615936 tempest-VolumesActionsTest-1432060990 None] Detach volume completed successfully. Feb 05 21:15:31.503768 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-b0b52a9e-49d8-4dbb-884e-34f3d3615936 tempest-VolumesActionsTest-1432060990 None] Lock "b'cinder-d894a429-9234-4297-8020-0f2629bf0e19-detach_volume'" released by "detach_volume" :: held 0.039s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:15:45.227494 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-d67ae1b0-7a03-467c-a030-aa2708d4d3b0 tempest-VolumesActionsTest-1432060990 None] Lock "b'cinder-d894a429-9234-4297-8020-0f2629bf0e19'" acquired by "attach_volume" :: waited 0.009s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:15:45.262588 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-d67ae1b0-7a03-467c-a030-aa2708d4d3b0 tempest-VolumesActionsTest-1432060990 None] Attaching volume d894a429-9234-4297-8020-0f2629bf0e19 to instance 09bfa0c7-25d8-427f-9b44-41819fa13ecc at mountpoint /dev/sdb on host None. Feb 05 21:15:45.285783 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-d67ae1b0-7a03-467c-a030-aa2708d4d3b0 tempest-VolumesActionsTest-1432060990 None] Attach volume completed successfully. Feb 05 21:15:45.290821 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-d67ae1b0-7a03-467c-a030-aa2708d4d3b0 tempest-VolumesActionsTest-1432060990 None] Lock "b'cinder-d894a429-9234-4297-8020-0f2629bf0e19'" released by "attach_volume" :: held 0.063s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:15:45.443836 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-be947593-0caa-410c-a486-8bf2b4703d96 tempest-VolumesActionsTest-1432060990 None] Lock "b'cinder-d894a429-9234-4297-8020-0f2629bf0e19-detach_volume'" acquired by "detach_volume" :: waited 0.008s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:15:45.444306 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-be947593-0caa-410c-a486-8bf2b4703d96 tempest-VolumesActionsTest-1432060990 None] Detaching volume d894a429-9234-4297-8020-0f2629bf0e19 from instance 09bfa0c7-25d8-427f-9b44-41819fa13ecc. Feb 05 21:15:45.479227 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-be947593-0caa-410c-a486-8bf2b4703d96 tempest-VolumesActionsTest-1432060990 None] Detach volume completed successfully. Feb 05 21:15:45.483175 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-be947593-0caa-410c-a486-8bf2b4703d96 tempest-VolumesActionsTest-1432060990 None] Lock "b'cinder-d894a429-9234-4297-8020-0f2629bf0e19-detach_volume'" released by "detach_volume" :: held 0.039s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:15:48.703964 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [None req-b0997d1f-beee-4c22-bfd7-1b0034e13420 tempest-VolumesActionsTest-1432060990 None] Running cmd (subprocess): rbd export --pool volumes volume-d894a429-9234-4297-8020-0f2629bf0e19 /opt/stack/data/cinder/conversion/volume-d894a429-9234-4297-8020-0f2629bf0e19-c4b9fc1b-4d45-4013-9460-87530ad03c79 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 21:15:49.201114 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [None req-b0997d1f-beee-4c22-bfd7-1b0034e13420 tempest-VolumesActionsTest-1432060990 None] CMD "rbd export --pool volumes volume-d894a429-9234-4297-8020-0f2629bf0e19 /opt/stack/data/cinder/conversion/volume-d894a429-9234-4297-8020-0f2629bf0e19-c4b9fc1b-4d45-4013-9460-87530ad03c79 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.497s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 21:15:49.210795 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.image_utils [None req-b0997d1f-beee-4c22-bfd7-1b0034e13420 tempest-VolumesActionsTest-1432060990 None] c4b9fc1b-4d45-4013-9460-87530ad03c79 was raw, no need to convert to raw {{(pid=122683) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:815}} Feb 05 21:15:52.693652 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:15:52.695218 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:15:52.743354 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:15:52.800873 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:16:03.411414 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b0997d1f-beee-4c22-bfd7-1b0034e13420 tempest-VolumesActionsTest-1432060990 None] Uploaded volume to glance image-id: c4b9fc1b-4d45-4013-9460-87530ad03c79. {{(pid=122683) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1747}} Feb 05 21:16:03.431009 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-b0997d1f-beee-4c22-bfd7-1b0034e13420 tempest-VolumesActionsTest-1432060990 None] Copy volume to image completed successfully. Feb 05 21:16:04.614465 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-99337002-c5f8-4abe-883f-ad23fe116375 tempest-VolumesActionsTest-1432060990 None] Lock "b'cinder-d894a429-9234-4297-8020-0f2629bf0e19-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:16:04.643958 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-99337002-c5f8-4abe-883f-ad23fe116375 tempest-VolumesActionsTest-1432060990 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:16:04.681398 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-99337002-c5f8-4abe-883f-ad23fe116375 tempest-VolumesActionsTest-1432060990 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:16:04.681959 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-99337002-c5f8-4abe-883f-ad23fe116375 tempest-VolumesActionsTest-1432060990 None] Volume volume-d894a429-9234-4297-8020-0f2629bf0e19 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:16:04.691355 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-99337002-c5f8-4abe-883f-ad23fe116375 tempest-VolumesActionsTest-1432060990 None] deleting rbd volume volume-d894a429-9234-4297-8020-0f2629bf0e19 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:16:04.887790 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-99337002-c5f8-4abe-883f-ad23fe116375 tempest-VolumesActionsTest-1432060990 None] Created reservations ['7bde4988-0405-4065-980a-ba10c01b1f3a', 'd9537485-0a86-4eca-85a2-ad09a46580f6', '8658d6f3-c0af-4273-ae9e-266e4d9e5dcd', '3443167f-610b-4f23-9f7a-4785a613dbd3'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:16:04.929664 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-99337002-c5f8-4abe-883f-ad23fe116375 tempest-VolumesActionsTest-1432060990 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:16:04.954852 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-99337002-c5f8-4abe-883f-ad23fe116375 tempest-VolumesActionsTest-1432060990 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:16:04.977747 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-99337002-c5f8-4abe-883f-ad23fe116375 tempest-VolumesActionsTest-1432060990 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:16:04.982792 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-99337002-c5f8-4abe-883f-ad23fe116375 tempest-VolumesActionsTest-1432060990 None] Deleted volume successfully. Feb 05 21:16:04.994810 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-99337002-c5f8-4abe-883f-ad23fe116375 tempest-VolumesActionsTest-1432060990 None] Lock "b'cinder-d894a429-9234-4297-8020-0f2629bf0e19-delete_volume'" released by "delete_volume" :: held 0.382s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:16:07.607545 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-3954a9b0-9978-4a71-8ac4-38850dd4da4d tempest-VolumesCloneNegativeTest-562879696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:16:07.612819 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-3954a9b0-9978-4a71-8ac4-38850dd4da4d tempest-VolumesCloneNegativeTest-562879696 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:16:07.613306 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-3954a9b0-9978-4a71-8ac4-38850dd4da4d tempest-VolumesCloneNegativeTest-562879696 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:16:07.633661 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3954a9b0-9978-4a71-8ac4-38850dd4da4d tempest-VolumesCloneNegativeTest-562879696 None] Flow 'volume_create_manager' (fd813616-3af5-4d81-9c36-963c45482e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:16:07.640359 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3954a9b0-9978-4a71-8ac4-38850dd4da4d tempest-VolumesCloneNegativeTest-562879696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e020f032-6c5b-4f4c-8acb-6da727780998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:16:07.646958 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-3954a9b0-9978-4a71-8ac4-38850dd4da4d tempest-VolumesCloneNegativeTest-562879696 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:16:07.661838 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3954a9b0-9978-4a71-8ac4-38850dd4da4d tempest-VolumesCloneNegativeTest-562879696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e020f032-6c5b-4f4c-8acb-6da727780998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1900477759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b2f673f3-e28f-4207-815a-b1b229441a54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8721b0e233454d2196752b92ac239bc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:16:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:16:08Z,use_quota=True,user_id='097d106b44a0448880a87c892b40858e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:16:07.667620 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3954a9b0-9978-4a71-8ac4-38850dd4da4d tempest-VolumesCloneNegativeTest-562879696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1962b426-5ac6-4358-a68c-cf83e7102d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:16:07.671749 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3954a9b0-9978-4a71-8ac4-38850dd4da4d tempest-VolumesCloneNegativeTest-562879696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1962b426-5ac6-4358-a68c-cf83e7102d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:16:07.677960 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3954a9b0-9978-4a71-8ac4-38850dd4da4d tempest-VolumesCloneNegativeTest-562879696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be64dc3f-f03d-41b5-a009-a45e2535c992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:16:07.682122 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3954a9b0-9978-4a71-8ac4-38850dd4da4d tempest-VolumesCloneNegativeTest-562879696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be64dc3f-f03d-41b5-a009-a45e2535c992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2f673f3-e28f-4207-815a-b1b229441a54', 'volume_name': 'volume-b2f673f3-e28f-4207-815a-b1b229441a54', 'volume_size': 2}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:16:07.687087 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3954a9b0-9978-4a71-8ac4-38850dd4da4d tempest-VolumesCloneNegativeTest-562879696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89d68893-2a6a-41f1-9c39-8ab3cda90599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:16:07.692230 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3954a9b0-9978-4a71-8ac4-38850dd4da4d tempest-VolumesCloneNegativeTest-562879696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89d68893-2a6a-41f1-9c39-8ab3cda90599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:16:07.697093 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3954a9b0-9978-4a71-8ac4-38850dd4da4d tempest-VolumesCloneNegativeTest-562879696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6f59b01-3d42-4d0c-89ab-d122721506cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:16:07.698190 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-3954a9b0-9978-4a71-8ac4-38850dd4da4d tempest-VolumesCloneNegativeTest-562879696 None] Volume b2f673f3-e28f-4207-815a-b1b229441a54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2f673f3-e28f-4207-815a-b1b229441a54', 'volume_size': 2} Feb 05 21:16:07.698608 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3954a9b0-9978-4a71-8ac4-38850dd4da4d tempest-VolumesCloneNegativeTest-562879696 None] creating volume 'volume-b2f673f3-e28f-4207-815a-b1b229441a54' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:16:07.699567 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3954a9b0-9978-4a71-8ac4-38850dd4da4d tempest-VolumesCloneNegativeTest-562879696 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:16:07.750233 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3954a9b0-9978-4a71-8ac4-38850dd4da4d tempest-VolumesCloneNegativeTest-562879696 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:16:07.750662 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3954a9b0-9978-4a71-8ac4-38850dd4da4d tempest-VolumesCloneNegativeTest-562879696 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:16:07.755120 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3954a9b0-9978-4a71-8ac4-38850dd4da4d tempest-VolumesCloneNegativeTest-562879696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6f59b01-3d42-4d0c-89ab-d122721506cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2f673f3-e28f-4207-815a-b1b229441a54', 'volume_size': 2}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:16:07.759808 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3954a9b0-9978-4a71-8ac4-38850dd4da4d tempest-VolumesCloneNegativeTest-562879696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72fe3dcd-6b90-44d0-a50f-318a8f392113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:16:07.769141 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-3954a9b0-9978-4a71-8ac4-38850dd4da4d tempest-VolumesCloneNegativeTest-562879696 None] Volume volume-b2f673f3-e28f-4207-815a-b1b229441a54 (b2f673f3-e28f-4207-815a-b1b229441a54): created successfully Feb 05 21:16:07.772530 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3954a9b0-9978-4a71-8ac4-38850dd4da4d tempest-VolumesCloneNegativeTest-562879696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72fe3dcd-6b90-44d0-a50f-318a8f392113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:16:07.778121 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-3954a9b0-9978-4a71-8ac4-38850dd4da4d tempest-VolumesCloneNegativeTest-562879696 None] Flow 'volume_create_manager' (fd813616-3af5-4d81-9c36-963c45482e41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:16:07.785348 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-3954a9b0-9978-4a71-8ac4-38850dd4da4d tempest-VolumesCloneNegativeTest-562879696 None] Created volume successfully. Feb 05 21:16:08.722295 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-c9c22f95-84c1-4485-8eb7-cbb9d8c4fe4c tempest-VolumesCloneNegativeTest-562879696 None] Lock "b'cinder-b2f673f3-e28f-4207-815a-b1b229441a54-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:16:08.760736 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c9c22f95-84c1-4485-8eb7-cbb9d8c4fe4c tempest-VolumesCloneNegativeTest-562879696 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:16:08.788708 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c9c22f95-84c1-4485-8eb7-cbb9d8c4fe4c tempest-VolumesCloneNegativeTest-562879696 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:16:08.789142 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c9c22f95-84c1-4485-8eb7-cbb9d8c4fe4c tempest-VolumesCloneNegativeTest-562879696 None] Volume volume-b2f673f3-e28f-4207-815a-b1b229441a54 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:16:08.795155 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c9c22f95-84c1-4485-8eb7-cbb9d8c4fe4c tempest-VolumesCloneNegativeTest-562879696 None] deleting rbd volume volume-b2f673f3-e28f-4207-815a-b1b229441a54 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:16:08.993328 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-c9c22f95-84c1-4485-8eb7-cbb9d8c4fe4c tempest-VolumesCloneNegativeTest-562879696 None] Created reservations ['2837ac10-db99-4c4d-8ba8-e3d67a18f2a9', '6fbecca0-1fd3-4c25-9dbb-408b482f1c08', '1e168456-54cb-44e5-8c00-b30a3d5787ae', 'c792909a-84c3-4ed6-868f-12cb0c61d3a5'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:16:09.031228 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c9c22f95-84c1-4485-8eb7-cbb9d8c4fe4c tempest-VolumesCloneNegativeTest-562879696 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:16:09.054113 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c9c22f95-84c1-4485-8eb7-cbb9d8c4fe4c tempest-VolumesCloneNegativeTest-562879696 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:16:09.081679 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-c9c22f95-84c1-4485-8eb7-cbb9d8c4fe4c tempest-VolumesCloneNegativeTest-562879696 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:16:09.085587 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-c9c22f95-84c1-4485-8eb7-cbb9d8c4fe4c tempest-VolumesCloneNegativeTest-562879696 None] Deleted volume successfully. Feb 05 21:16:09.097210 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-c9c22f95-84c1-4485-8eb7-cbb9d8c4fe4c tempest-VolumesCloneNegativeTest-562879696 None] Lock "b'cinder-b2f673f3-e28f-4207-815a-b1b229441a54-delete_volume'" released by "delete_volume" :: held 0.375s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:16:11.562191 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e115c68-442d-424a-84b0-29e996d57a47 tempest-VolumesExtendTest-43389089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:16:11.565457 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-9e115c68-442d-424a-84b0-29e996d57a47 tempest-VolumesExtendTest-43389089 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:16:11.565931 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-9e115c68-442d-424a-84b0-29e996d57a47 tempest-VolumesExtendTest-43389089 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:16:11.585674 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9e115c68-442d-424a-84b0-29e996d57a47 tempest-VolumesExtendTest-43389089 None] Flow 'volume_create_manager' (19b82d07-b4aa-49ed-97e6-0fe02541e1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:16:11.592501 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9e115c68-442d-424a-84b0-29e996d57a47 tempest-VolumesExtendTest-43389089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43f7d8df-c95d-409e-8c54-41e70b652df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:16:11.599964 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-9e115c68-442d-424a-84b0-29e996d57a47 tempest-VolumesExtendTest-43389089 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:16:11.614536 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9e115c68-442d-424a-84b0-29e996d57a47 tempest-VolumesExtendTest-43389089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43f7d8df-c95d-409e-8c54-41e70b652df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2056280009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=dd3a1f2a-5606-4f0c-9f64-3dba24e73040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f42d0d3f5beb4cc180eb8814dcdedf88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:16:12Z,use_quota=True,user_id='8c302b2dc4bf464a9a870379241f8dce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:16:11.620087 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9e115c68-442d-424a-84b0-29e996d57a47 tempest-VolumesExtendTest-43389089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d138db44-4cc1-40aa-810a-037b331c89d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:16:11.624273 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9e115c68-442d-424a-84b0-29e996d57a47 tempest-VolumesExtendTest-43389089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d138db44-4cc1-40aa-810a-037b331c89d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:16:11.629561 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9e115c68-442d-424a-84b0-29e996d57a47 tempest-VolumesExtendTest-43389089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12df4701-4b18-4850-a693-65a5613d3dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:16:11.712739 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9e115c68-442d-424a-84b0-29e996d57a47 tempest-VolumesExtendTest-43389089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12df4701-4b18-4850-a693-65a5613d3dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dd3a1f2a-5606-4f0c-9f64-3dba24e73040', 'volume_name': 'volume-dd3a1f2a-5606-4f0c-9f64-3dba24e73040', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:16:11.717834 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9e115c68-442d-424a-84b0-29e996d57a47 tempest-VolumesExtendTest-43389089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21d2c279-bb4b-4ab0-8cc1-40e819b91f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:16:11.722735 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9e115c68-442d-424a-84b0-29e996d57a47 tempest-VolumesExtendTest-43389089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21d2c279-bb4b-4ab0-8cc1-40e819b91f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:16:11.727646 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9e115c68-442d-424a-84b0-29e996d57a47 tempest-VolumesExtendTest-43389089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f5b68bc-f7f6-4a76-ba9f-ba1fcc03a767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:16:11.728773 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-9e115c68-442d-424a-84b0-29e996d57a47 tempest-VolumesExtendTest-43389089 None] Volume dd3a1f2a-5606-4f0c-9f64-3dba24e73040: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dd3a1f2a-5606-4f0c-9f64-3dba24e73040', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 05 21:16:11.729334 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e115c68-442d-424a-84b0-29e996d57a47 tempest-VolumesExtendTest-43389089 None] Cloning dd3a1f2a-5606-4f0c-9f64-3dba24e73040 from image e66a3a3b-d2f9-4d5d-8021-a6001dff419f at location (None, None). {{(pid=122683) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 05 21:16:11.740189 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-9e115c68-442d-424a-84b0-29e996d57a47 tempest-VolumesExtendTest-43389089 None] Lock "b'cinder-e66a3a3b-d2f9-4d5d-8021-a6001dff419f'" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:16:11.749653 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-9e115c68-442d-424a-84b0-29e996d57a47 tempest-VolumesExtendTest-43389089 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'volume_id': '311ef4be-45fd-4167-a3ad-6251d56550a7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57), 'last_used': datetime.datetime(2022, 2, 5, 21, 16, 11, 744510)}. {{(pid=122683) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 05 21:16:11.750329 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-9e115c68-442d-424a-84b0-29e996d57a47 tempest-VolumesExtendTest-43389089 None] Image-volume cache entry image_update_at = 2022-02-05 20:37:57+00:00, requested image updated_at = 2022-02-05 20:37:57+00:00. {{(pid=122683) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 05 21:16:11.750770 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e115c68-442d-424a-84b0-29e996d57a47 tempest-VolumesExtendTest-43389089 None] Found cache entry for image = e66a3a3b-d2f9-4d5d-8021-a6001dff419f on host ncdv-master-1@ceph#ceph. {{(pid=122683) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Feb 05 21:16:11.755706 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-9e115c68-442d-424a-84b0-29e996d57a47 tempest-VolumesExtendTest-43389089 None] Lock "b'cinder-e66a3a3b-d2f9-4d5d-8021-a6001dff419f'" released by "_prepare_image_cache_entry" :: held 0.016s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:16:11.756660 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e115c68-442d-424a-84b0-29e996d57a47 tempest-VolumesExtendTest-43389089 None] Attempting to retrieve cache entry for image = e66a3a3b-d2f9-4d5d-8021-a6001dff419f on host ncdv-master-1@ceph#ceph. {{(pid=122683) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 05 21:16:11.761978 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-9e115c68-442d-424a-84b0-29e996d57a47 tempest-VolumesExtendTest-43389089 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'volume_id': '311ef4be-45fd-4167-a3ad-6251d56550a7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57), 'last_used': datetime.datetime(2022, 2, 5, 21, 16, 11, 759820)}. {{(pid=122683) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 05 21:16:11.762409 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-9e115c68-442d-424a-84b0-29e996d57a47 tempest-VolumesExtendTest-43389089 None] Image-volume cache entry image_update_at = 2022-02-05 20:37:57+00:00, requested image updated_at = 2022-02-05 20:37:57+00:00. {{(pid=122683) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 05 21:16:11.762851 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e115c68-442d-424a-84b0-29e996d57a47 tempest-VolumesExtendTest-43389089 None] Creating from source image-volume 311ef4be-45fd-4167-a3ad-6251d56550a7 {{(pid=122683) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Feb 05 21:16:11.774307 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-9e115c68-442d-424a-84b0-29e996d57a47 tempest-VolumesExtendTest-43389089 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:16:11.827055 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-9e115c68-442d-424a-84b0-29e996d57a47 tempest-VolumesExtendTest-43389089 None] creating snapshot='volume-dd3a1f2a-5606-4f0c-9f64-3dba24e73040.clone_snap' {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 05 21:16:12.346269 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-9e115c68-442d-424a-84b0-29e996d57a47 tempest-VolumesExtendTest-43389089 None] cloning 'volume-311ef4be-45fd-4167-a3ad-6251d56550a7@volume-dd3a1f2a-5606-4f0c-9f64-3dba24e73040.clone_snap' to 'volume-dd3a1f2a-5606-4f0c-9f64-3dba24e73040' {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 05 21:16:12.467905 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-9e115c68-442d-424a-84b0-29e996d57a47 tempest-VolumesExtendTest-43389089 None] Volume volume-35445a36-a76c-48db-a9c5-3b58646c1e7b.deleted is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:16:12.469125 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-9e115c68-442d-424a-84b0-29e996d57a47 tempest-VolumesExtendTest-43389089 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:16:12.469499 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-9e115c68-442d-424a-84b0-29e996d57a47 tempest-VolumesExtendTest-43389089 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:16:12.487134 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-9e115c68-442d-424a-84b0-29e996d57a47 tempest-VolumesExtendTest-43389089 None] clone created successfully {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 05 21:16:12.487752 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.volume_utils [None req-9e115c68-442d-424a-84b0-29e996d57a47 tempest-VolumesExtendTest-43389089 None] Marking volume dd3a1f2a-5606-4f0c-9f64-3dba24e73040 as bootable. {{(pid=122683) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Feb 05 21:16:12.495189 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e115c68-442d-424a-84b0-29e996d57a47 tempest-VolumesExtendTest-43389089 None] Copying metadata from image e66a3a3b-d2f9-4d5d-8021-a6001dff419f to dd3a1f2a-5606-4f0c-9f64-3dba24e73040. {{(pid=122683) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 05 21:16:12.495562 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e115c68-442d-424a-84b0-29e996d57a47 tempest-VolumesExtendTest-43389089 None] Creating volume glance metadata for volume dd3a1f2a-5606-4f0c-9f64-3dba24e73040 backed by image e66a3a3b-d2f9-4d5d-8021-a6001dff419f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=122683) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 05 21:16:12.546128 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9e115c68-442d-424a-84b0-29e996d57a47 tempest-VolumesExtendTest-43389089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f5b68bc-f7f6-4a76-ba9f-ba1fcc03a767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd3a1f2a-5606-4f0c-9f64-3dba24e73040', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:16:12.552015 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9e115c68-442d-424a-84b0-29e996d57a47 tempest-VolumesExtendTest-43389089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d19e56a2-7b9f-4d32-892d-c989946aabee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:16:12.560507 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-9e115c68-442d-424a-84b0-29e996d57a47 tempest-VolumesExtendTest-43389089 None] Volume volume-dd3a1f2a-5606-4f0c-9f64-3dba24e73040 (dd3a1f2a-5606-4f0c-9f64-3dba24e73040): created successfully Feb 05 21:16:12.564151 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9e115c68-442d-424a-84b0-29e996d57a47 tempest-VolumesExtendTest-43389089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d19e56a2-7b9f-4d32-892d-c989946aabee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:16:12.570045 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-9e115c68-442d-424a-84b0-29e996d57a47 tempest-VolumesExtendTest-43389089 None] Flow 'volume_create_manager' (19b82d07-b4aa-49ed-97e6-0fe02541e1b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:16:12.577301 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-9e115c68-442d-424a-84b0-29e996d57a47 tempest-VolumesExtendTest-43389089 None] Created volume successfully. Feb 05 21:16:13.726761 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6046d4dd-3cde-45b4-a0fb-5d1ffc581ee5 tempest-VolumesExtendTest-43389089 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:16:13.823966 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6046d4dd-3cde-45b4-a0fb-5d1ffc581ee5 tempest-VolumesExtendTest-43389089 None] Extend volume from 1 GB to 2 GB. {{(pid=122683) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1732}} Feb 05 21:16:13.850078 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-6046d4dd-3cde-45b4-a0fb-5d1ffc581ee5 tempest-VolumesExtendTest-43389089 None] Extend volume completed successfully. Feb 05 21:16:15.170460 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6ed5686-3811-4586-9f5b-a7ed9b8c7f79 tempest-VolumesExtendTest-43389089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:16:15.174199 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-e6ed5686-3811-4586-9f5b-a7ed9b8c7f79 tempest-VolumesExtendTest-43389089 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:16:15.174625 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-e6ed5686-3811-4586-9f5b-a7ed9b8c7f79 tempest-VolumesExtendTest-43389089 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:16:15.194331 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-e6ed5686-3811-4586-9f5b-a7ed9b8c7f79 tempest-VolumesExtendTest-43389089 None] Flow 'volume_create_manager' (c2da50eb-ebfa-4ccc-9416-9dd0d8886335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:16:15.201124 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-e6ed5686-3811-4586-9f5b-a7ed9b8c7f79 tempest-VolumesExtendTest-43389089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4da53d64-af28-4515-9331-10e5a2c2bdf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:16:15.207738 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-e6ed5686-3811-4586-9f5b-a7ed9b8c7f79 tempest-VolumesExtendTest-43389089 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:16:15.221706 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-e6ed5686-3811-4586-9f5b-a7ed9b8c7f79 tempest-VolumesExtendTest-43389089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4da53d64-af28-4515-9331-10e5a2c2bdf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-761877008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=63a08467-9172-4288-815d-b243371d1302,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f42d0d3f5beb4cc180eb8814dcdedf88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:16:15Z,use_quota=True,user_id='8c302b2dc4bf464a9a870379241f8dce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:16:15.227276 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-e6ed5686-3811-4586-9f5b-a7ed9b8c7f79 tempest-VolumesExtendTest-43389089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40cbbf3f-1206-48ae-b0e6-273ed6cd547c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:16:15.231510 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-e6ed5686-3811-4586-9f5b-a7ed9b8c7f79 tempest-VolumesExtendTest-43389089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40cbbf3f-1206-48ae-b0e6-273ed6cd547c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:16:15.237526 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-e6ed5686-3811-4586-9f5b-a7ed9b8c7f79 tempest-VolumesExtendTest-43389089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a9da73-caf5-4aaf-93e5-d06085a43211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:16:15.241825 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-e6ed5686-3811-4586-9f5b-a7ed9b8c7f79 tempest-VolumesExtendTest-43389089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a9da73-caf5-4aaf-93e5-d06085a43211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63a08467-9172-4288-815d-b243371d1302', 'volume_name': 'volume-63a08467-9172-4288-815d-b243371d1302', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:16:15.247151 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-e6ed5686-3811-4586-9f5b-a7ed9b8c7f79 tempest-VolumesExtendTest-43389089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (459e6017-43c8-4232-85a6-e64bff085610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:16:15.251309 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-e6ed5686-3811-4586-9f5b-a7ed9b8c7f79 tempest-VolumesExtendTest-43389089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (459e6017-43c8-4232-85a6-e64bff085610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:16:15.256973 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-e6ed5686-3811-4586-9f5b-a7ed9b8c7f79 tempest-VolumesExtendTest-43389089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0553b11-2c18-4f73-90ed-965f3e4b5be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:16:15.258081 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-e6ed5686-3811-4586-9f5b-a7ed9b8c7f79 tempest-VolumesExtendTest-43389089 None] Volume 63a08467-9172-4288-815d-b243371d1302: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63a08467-9172-4288-815d-b243371d1302', 'volume_size': 1} Feb 05 21:16:15.258485 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e6ed5686-3811-4586-9f5b-a7ed9b8c7f79 tempest-VolumesExtendTest-43389089 None] creating volume 'volume-63a08467-9172-4288-815d-b243371d1302' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:16:15.259468 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e6ed5686-3811-4586-9f5b-a7ed9b8c7f79 tempest-VolumesExtendTest-43389089 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:16:15.322427 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e6ed5686-3811-4586-9f5b-a7ed9b8c7f79 tempest-VolumesExtendTest-43389089 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:16:15.322817 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e6ed5686-3811-4586-9f5b-a7ed9b8c7f79 tempest-VolumesExtendTest-43389089 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:16:15.326776 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-e6ed5686-3811-4586-9f5b-a7ed9b8c7f79 tempest-VolumesExtendTest-43389089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0553b11-2c18-4f73-90ed-965f3e4b5be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63a08467-9172-4288-815d-b243371d1302', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:16:15.332002 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-e6ed5686-3811-4586-9f5b-a7ed9b8c7f79 tempest-VolumesExtendTest-43389089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea07690d-7ff9-4d7d-8c81-7f67f8dcd5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:16:15.341144 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-e6ed5686-3811-4586-9f5b-a7ed9b8c7f79 tempest-VolumesExtendTest-43389089 None] Volume volume-63a08467-9172-4288-815d-b243371d1302 (63a08467-9172-4288-815d-b243371d1302): created successfully Feb 05 21:16:15.345668 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-e6ed5686-3811-4586-9f5b-a7ed9b8c7f79 tempest-VolumesExtendTest-43389089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea07690d-7ff9-4d7d-8c81-7f67f8dcd5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:16:15.352346 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-e6ed5686-3811-4586-9f5b-a7ed9b8c7f79 tempest-VolumesExtendTest-43389089 None] Flow 'volume_create_manager' (c2da50eb-ebfa-4ccc-9416-9dd0d8886335) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:16:15.360087 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-e6ed5686-3811-4586-9f5b-a7ed9b8c7f79 tempest-VolumesExtendTest-43389089 None] Created volume successfully. Feb 05 21:16:16.341624 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-d821da73-0862-4018-b75f-5828c386e0c2 tempest-VolumesExtendTest-43389089 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:16:17.411096 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-d821da73-0862-4018-b75f-5828c386e0c2 tempest-VolumesExtendTest-43389089 None] Create snapshot completed successfully Feb 05 21:16:18.486354 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-4cf174d2-89ca-414c-a8de-5dd902644e7b tempest-VolumesExtendTest-43389089 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:16:18.557802 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-4cf174d2-89ca-414c-a8de-5dd902644e7b tempest-VolumesExtendTest-43389089 None] Extend volume from 1 GB to 2 GB. {{(pid=122683) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1732}} Feb 05 21:16:18.583474 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-4cf174d2-89ca-414c-a8de-5dd902644e7b tempest-VolumesExtendTest-43389089 None] Extend volume completed successfully. Feb 05 21:16:19.665492 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-c3f05c4c-8962-4329-b3c2-c23dbb5b823b tempest-VolumesExtendTest-43389089 None] Lock "b'cinder-e7cec4c4-3112-4024-b4a1-12e9fe81178c-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:16:19.666908 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c3f05c4c-8962-4329-b3c2-c23dbb5b823b tempest-VolumesExtendTest-43389089 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:16:20.082195 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-c3f05c4c-8962-4329-b3c2-c23dbb5b823b tempest-VolumesExtendTest-43389089 None] Created reservations ['52eb1862-1539-4313-883a-3880178fd1ad', '3e6984af-acad-4054-b660-28ff117484a4', '9fb4095c-dcbf-408a-adbf-9560132621a7', '5720c705-dd2b-48ba-aaf1-4157d045f023'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:16:20.115831 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-c3f05c4c-8962-4329-b3c2-c23dbb5b823b tempest-VolumesExtendTest-43389089 None] Delete snapshot completed successfully. Feb 05 21:16:20.126469 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-c3f05c4c-8962-4329-b3c2-c23dbb5b823b tempest-VolumesExtendTest-43389089 None] Lock "b'cinder-e7cec4c4-3112-4024-b4a1-12e9fe81178c-delete_snapshot'" released by "delete_snapshot" :: held 0.455s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:16:20.759215 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-b67bfa97-255c-49a7-91ed-1120e2170462 tempest-VolumesExtendTest-43389089 None] Lock "b'cinder-63a08467-9172-4288-815d-b243371d1302-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:16:20.791681 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-b67bfa97-255c-49a7-91ed-1120e2170462 tempest-VolumesExtendTest-43389089 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:16:20.827746 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-b67bfa97-255c-49a7-91ed-1120e2170462 tempest-VolumesExtendTest-43389089 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:16:20.828206 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-b67bfa97-255c-49a7-91ed-1120e2170462 tempest-VolumesExtendTest-43389089 None] Volume volume-63a08467-9172-4288-815d-b243371d1302 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:16:20.833346 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-b67bfa97-255c-49a7-91ed-1120e2170462 tempest-VolumesExtendTest-43389089 None] deleting rbd volume volume-63a08467-9172-4288-815d-b243371d1302 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:16:21.028996 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-b67bfa97-255c-49a7-91ed-1120e2170462 tempest-VolumesExtendTest-43389089 None] Created reservations ['05083782-f440-40b1-afe9-a19a333f6567', '260ad7bd-d796-4bb2-83bc-f22c6cad6d6e', '63ce0d96-932f-4fbe-9394-163fedf5283d', '8efeb662-5d39-4ea4-a060-3c178e2e3096'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:16:21.068929 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-b67bfa97-255c-49a7-91ed-1120e2170462 tempest-VolumesExtendTest-43389089 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:16:21.090328 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-b67bfa97-255c-49a7-91ed-1120e2170462 tempest-VolumesExtendTest-43389089 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:16:21.112910 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-b67bfa97-255c-49a7-91ed-1120e2170462 tempest-VolumesExtendTest-43389089 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:16:21.117043 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-b67bfa97-255c-49a7-91ed-1120e2170462 tempest-VolumesExtendTest-43389089 None] Deleted volume successfully. Feb 05 21:16:21.132393 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-b67bfa97-255c-49a7-91ed-1120e2170462 tempest-VolumesExtendTest-43389089 None] Lock "b'cinder-63a08467-9172-4288-815d-b243371d1302-delete_volume'" released by "delete_volume" :: held 0.370s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:16:21.876145 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-e8fde400-98a1-4c5f-b2e0-3b85f534990e tempest-VolumesExtendTest-43389089 None] Lock "b'cinder-dd3a1f2a-5606-4f0c-9f64-3dba24e73040-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:16:21.908984 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e8fde400-98a1-4c5f-b2e0-3b85f534990e tempest-VolumesExtendTest-43389089 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:16:21.969421 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e8fde400-98a1-4c5f-b2e0-3b85f534990e tempest-VolumesExtendTest-43389089 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:16:21.975818 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e8fde400-98a1-4c5f-b2e0-3b85f534990e tempest-VolumesExtendTest-43389089 None] deleting rbd volume volume-dd3a1f2a-5606-4f0c-9f64-3dba24e73040 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:16:22.137659 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e8fde400-98a1-4c5f-b2e0-3b85f534990e tempest-VolumesExtendTest-43389089 None] volume is a clone so cleaning references {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 05 21:16:22.168696 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e8fde400-98a1-4c5f-b2e0-3b85f534990e tempest-VolumesExtendTest-43389089 None] deleting parent snapshot volume-dd3a1f2a-5606-4f0c-9f64-3dba24e73040.clone_snap {{(pid=122683) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 05 21:16:23.100265 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-e8fde400-98a1-4c5f-b2e0-3b85f534990e tempest-VolumesExtendTest-43389089 None] Created reservations ['098220a3-2136-4679-ab6c-54521b40cfa6', '4da1c335-9266-4da9-8ce9-4d999406ee79', '86d57416-30e5-4aa1-a8c8-9075e327d3e6', 'c82b39df-cb57-4395-939e-3ca19e226141'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:16:23.141333 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e8fde400-98a1-4c5f-b2e0-3b85f534990e tempest-VolumesExtendTest-43389089 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:16:23.163260 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e8fde400-98a1-4c5f-b2e0-3b85f534990e tempest-VolumesExtendTest-43389089 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:16:23.186339 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-e8fde400-98a1-4c5f-b2e0-3b85f534990e tempest-VolumesExtendTest-43389089 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:16:23.191748 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-e8fde400-98a1-4c5f-b2e0-3b85f534990e tempest-VolumesExtendTest-43389089 None] Deleted volume successfully. Feb 05 21:16:23.202999 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-e8fde400-98a1-4c5f-b2e0-3b85f534990e tempest-VolumesExtendTest-43389089 None] Lock "b'cinder-dd3a1f2a-5606-4f0c-9f64-3dba24e73040-delete_volume'" released by "delete_volume" :: held 1.327s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:16:48.084955 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-af874212-d1a8-4a45-a671-f57045d4949b req-08a79ac4-d124-4163-a2cf-7be62b4e21b2 tempest-AttachVolumeShelveTestJSON-1952389738 None] No connector for attachment 60c45abc-2e48-47a9-8ca0-9018b4737a54; skipping storage backend terminate_connection call. {{(pid=122683) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4915}} Feb 05 21:16:48.085665 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-af874212-d1a8-4a45-a671-f57045d4949b req-08a79ac4-d124-4163-a2cf-7be62b4e21b2 tempest-AttachVolumeShelveTestJSON-1952389738 None] Deleting attachment 60c45abc-2e48-47a9-8ca0-9018b4737a54. {{(pid=122683) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 05 21:16:52.695538 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:16:52.696251 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:16:52.745301 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:16:52.785347 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:17:42.768863 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-079f589c-f2e6-4d1c-9982-647d4c10a29c tempest-AttachVolumeShelveTestJSON-1952389738 None] Lock "b'cinder-e3f89471-88d8-4161-a200-64c691fc183f-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:17:42.809258 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-079f589c-f2e6-4d1c-9982-647d4c10a29c tempest-AttachVolumeShelveTestJSON-1952389738 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:17:42.857723 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-079f589c-f2e6-4d1c-9982-647d4c10a29c tempest-AttachVolumeShelveTestJSON-1952389738 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:17:42.858106 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-079f589c-f2e6-4d1c-9982-647d4c10a29c tempest-AttachVolumeShelveTestJSON-1952389738 None] Volume volume-e3f89471-88d8-4161-a200-64c691fc183f is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:17:42.863506 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-079f589c-f2e6-4d1c-9982-647d4c10a29c tempest-AttachVolumeShelveTestJSON-1952389738 None] deleting rbd volume volume-e3f89471-88d8-4161-a200-64c691fc183f {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:17:43.069690 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-079f589c-f2e6-4d1c-9982-647d4c10a29c tempest-AttachVolumeShelveTestJSON-1952389738 None] Created reservations ['6afb4b37-76d4-4086-9759-aae1f43fa974', 'ab87b8e2-7530-463a-8aec-c3e3a80b2c90', '1571e889-3f87-46ea-b287-c18d461dd4ce', '6027214b-3117-4937-b972-4b5dc229cd40'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:17:43.107445 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-079f589c-f2e6-4d1c-9982-647d4c10a29c tempest-AttachVolumeShelveTestJSON-1952389738 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:17:43.131717 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-079f589c-f2e6-4d1c-9982-647d4c10a29c tempest-AttachVolumeShelveTestJSON-1952389738 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:17:43.154915 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-079f589c-f2e6-4d1c-9982-647d4c10a29c tempest-AttachVolumeShelveTestJSON-1952389738 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:17:43.159232 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-079f589c-f2e6-4d1c-9982-647d4c10a29c tempest-AttachVolumeShelveTestJSON-1952389738 None] Deleted volume successfully. Feb 05 21:17:43.171031 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-079f589c-f2e6-4d1c-9982-647d4c10a29c tempest-AttachVolumeShelveTestJSON-1952389738 None] Lock "b'cinder-e3f89471-88d8-4161-a200-64c691fc183f-delete_volume'" released by "delete_volume" :: held 0.402s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:17:43.956076 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-42e1bf78-4832-4fd6-86d6-eb8ba42a26f2 tempest-AttachVolumeShelveTestJSON-1952389738 None] Lock "b'cinder-b093fb5f-d647-4b97-a068-532afc9faa5b-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:17:43.986553 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-42e1bf78-4832-4fd6-86d6-eb8ba42a26f2 tempest-AttachVolumeShelveTestJSON-1952389738 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:17:44.032094 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-42e1bf78-4832-4fd6-86d6-eb8ba42a26f2 tempest-AttachVolumeShelveTestJSON-1952389738 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:17:44.032527 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-42e1bf78-4832-4fd6-86d6-eb8ba42a26f2 tempest-AttachVolumeShelveTestJSON-1952389738 None] Volume volume-b093fb5f-d647-4b97-a068-532afc9faa5b is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:17:44.037623 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-42e1bf78-4832-4fd6-86d6-eb8ba42a26f2 tempest-AttachVolumeShelveTestJSON-1952389738 None] deleting rbd volume volume-b093fb5f-d647-4b97-a068-532afc9faa5b {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:17:44.228924 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-42e1bf78-4832-4fd6-86d6-eb8ba42a26f2 tempest-AttachVolumeShelveTestJSON-1952389738 None] Created reservations ['ff7d3bbd-36c7-4274-bc0e-819272b1d167', '695f8515-c98d-41ce-bc22-c923403c1792', '194718b6-a084-4074-95d5-b990c3793bcb', 'be5126ec-d7f6-4879-b4aa-6befc31b6c15'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:17:44.268019 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-42e1bf78-4832-4fd6-86d6-eb8ba42a26f2 tempest-AttachVolumeShelveTestJSON-1952389738 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:17:44.290069 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-42e1bf78-4832-4fd6-86d6-eb8ba42a26f2 tempest-AttachVolumeShelveTestJSON-1952389738 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:17:44.312394 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-42e1bf78-4832-4fd6-86d6-eb8ba42a26f2 tempest-AttachVolumeShelveTestJSON-1952389738 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:17:44.317237 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-42e1bf78-4832-4fd6-86d6-eb8ba42a26f2 tempest-AttachVolumeShelveTestJSON-1952389738 None] Deleted volume successfully. Feb 05 21:17:44.327903 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-42e1bf78-4832-4fd6-86d6-eb8ba42a26f2 tempest-AttachVolumeShelveTestJSON-1952389738 None] Lock "b'cinder-b093fb5f-d647-4b97-a068-532afc9faa5b-delete_volume'" released by "delete_volume" :: held 0.372s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:17:52.700968 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:17:52.701690 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:17:52.728695 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:17:52.761776 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:18:02.901817 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c8b5b3c-7767-4349-bb5a-68a420932964 tempest-AttachVolumeNegativeTest-607117153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:18:02.907034 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-6c8b5b3c-7767-4349-bb5a-68a420932964 tempest-AttachVolumeNegativeTest-607117153 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:18:02.907854 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-6c8b5b3c-7767-4349-bb5a-68a420932964 tempest-AttachVolumeNegativeTest-607117153 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:18:02.931546 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6c8b5b3c-7767-4349-bb5a-68a420932964 tempest-AttachVolumeNegativeTest-607117153 None] Flow 'volume_create_manager' (bc75c2f5-4a6b-4f41-94ce-6a16cd804d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:18:02.941801 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6c8b5b3c-7767-4349-bb5a-68a420932964 tempest-AttachVolumeNegativeTest-607117153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94574991-2c9a-4607-9899-9c366235cf8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:18:02.948795 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-6c8b5b3c-7767-4349-bb5a-68a420932964 tempest-AttachVolumeNegativeTest-607117153 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:18:02.964899 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6c8b5b3c-7767-4349-bb5a-68a420932964 tempest-AttachVolumeNegativeTest-607117153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94574991-2c9a-4607-9899-9c366235cf8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1731788205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=28da735b-c9b9-4bf9-9971-3c7a790a0dd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e1134701b2d45d7878177ad9dc5d45c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:18:03Z,use_quota=True,user_id='de2d340184fb41a0a5274f98eb5ab359',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:18:02.972341 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6c8b5b3c-7767-4349-bb5a-68a420932964 tempest-AttachVolumeNegativeTest-607117153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a57dcd34-cda4-4128-8965-28cbb54f7c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:18:02.976789 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6c8b5b3c-7767-4349-bb5a-68a420932964 tempest-AttachVolumeNegativeTest-607117153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a57dcd34-cda4-4128-8965-28cbb54f7c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:18:02.982038 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6c8b5b3c-7767-4349-bb5a-68a420932964 tempest-AttachVolumeNegativeTest-607117153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3332df8-7b22-4ed1-8120-fbae64a71f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:18:02.986885 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6c8b5b3c-7767-4349-bb5a-68a420932964 tempest-AttachVolumeNegativeTest-607117153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3332df8-7b22-4ed1-8120-fbae64a71f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28da735b-c9b9-4bf9-9971-3c7a790a0dd3', 'volume_name': 'volume-28da735b-c9b9-4bf9-9971-3c7a790a0dd3', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:18:02.991921 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6c8b5b3c-7767-4349-bb5a-68a420932964 tempest-AttachVolumeNegativeTest-607117153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e128a9cf-b3ac-440d-b40e-ebe07f8c4be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:18:02.997428 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6c8b5b3c-7767-4349-bb5a-68a420932964 tempest-AttachVolumeNegativeTest-607117153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e128a9cf-b3ac-440d-b40e-ebe07f8c4be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:18:03.004752 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6c8b5b3c-7767-4349-bb5a-68a420932964 tempest-AttachVolumeNegativeTest-607117153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc281b55-7fad-4199-bd88-8027f50b2dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:18:03.006033 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-6c8b5b3c-7767-4349-bb5a-68a420932964 tempest-AttachVolumeNegativeTest-607117153 None] Volume 28da735b-c9b9-4bf9-9971-3c7a790a0dd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28da735b-c9b9-4bf9-9971-3c7a790a0dd3', 'volume_size': 1} Feb 05 21:18:03.006529 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c8b5b3c-7767-4349-bb5a-68a420932964 tempest-AttachVolumeNegativeTest-607117153 None] creating volume 'volume-28da735b-c9b9-4bf9-9971-3c7a790a0dd3' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:18:03.007944 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c8b5b3c-7767-4349-bb5a-68a420932964 tempest-AttachVolumeNegativeTest-607117153 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:18:03.078979 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c8b5b3c-7767-4349-bb5a-68a420932964 tempest-AttachVolumeNegativeTest-607117153 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:18:03.079357 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c8b5b3c-7767-4349-bb5a-68a420932964 tempest-AttachVolumeNegativeTest-607117153 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:18:03.083369 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6c8b5b3c-7767-4349-bb5a-68a420932964 tempest-AttachVolumeNegativeTest-607117153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc281b55-7fad-4199-bd88-8027f50b2dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28da735b-c9b9-4bf9-9971-3c7a790a0dd3', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:18:03.090830 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6c8b5b3c-7767-4349-bb5a-68a420932964 tempest-AttachVolumeNegativeTest-607117153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (299ff211-01f5-436d-9160-60fbf7b3cab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:18:03.105170 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-6c8b5b3c-7767-4349-bb5a-68a420932964 tempest-AttachVolumeNegativeTest-607117153 None] Volume volume-28da735b-c9b9-4bf9-9971-3c7a790a0dd3 (28da735b-c9b9-4bf9-9971-3c7a790a0dd3): created successfully Feb 05 21:18:03.115757 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6c8b5b3c-7767-4349-bb5a-68a420932964 tempest-AttachVolumeNegativeTest-607117153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (299ff211-01f5-436d-9160-60fbf7b3cab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:18:03.127539 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6c8b5b3c-7767-4349-bb5a-68a420932964 tempest-AttachVolumeNegativeTest-607117153 None] Flow 'volume_create_manager' (bc75c2f5-4a6b-4f41-94ce-6a16cd804d79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:18:03.137729 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-6c8b5b3c-7767-4349-bb5a-68a420932964 tempest-AttachVolumeNegativeTest-607117153 None] Created volume successfully. Feb 05 21:18:04.502653 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-c37aa4d5-2452-453b-8250-6c925d6aebd3 req-b589eb04-5dc1-4cd6-9e9d-81e2c0d11349 tempest-AttachVolumeNegativeTest-607117153 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 21:18:05.376625 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-c37aa4d5-2452-453b-8250-6c925d6aebd3 req-b589eb04-5dc1-4cd6-9e9d-81e2c0d11349 tempest-AttachVolumeNegativeTest-607117153 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.873s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 21:18:05.378133 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-c37aa4d5-2452-453b-8250-6c925d6aebd3 req-b589eb04-5dc1-4cd6-9e9d-81e2c0d11349 tempest-AttachVolumeNegativeTest-607117153 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-28da735b-c9b9-4bf9-9971-3c7a790a0dd3', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': '28da735b-c9b9-4bf9-9971-3c7a790a0dd3', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 21:18:05.415653 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-c37aa4d5-2452-453b-8250-6c925d6aebd3 req-b589eb04-5dc1-4cd6-9e9d-81e2c0d11349 tempest-AttachVolumeNegativeTest-607117153 None] Connection info returned from driver {'name': 'volumes/volume-28da735b-c9b9-4bf9-9971-3c7a790a0dd3', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '28da735b-c9b9-4bf9-9971-3c7a790a0dd3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '57586ab0-41ac-4e3f-9032-95537ee57b88'} {{(pid=122683) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 05 21:18:05.492185 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-c37aa4d5-2452-453b-8250-6c925d6aebd3 req-b589eb04-5dc1-4cd6-9e9d-81e2c0d11349 tempest-AttachVolumeNegativeTest-607117153 None] attachment_update completed successfully. Feb 05 21:18:21.296757 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-38473e24-2849-4f2d-b842-b1506009b09e req-a42c20c6-64d6-4d6d-a45f-40806dea2c60 tempest-AttachVolumeNegativeTest-607117153 None] Terminate volume connection completed successfully. Feb 05 21:18:21.301019 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-38473e24-2849-4f2d-b842-b1506009b09e req-a42c20c6-64d6-4d6d-a45f-40806dea2c60 tempest-AttachVolumeNegativeTest-607117153 None] Deleting attachment 57586ab0-41ac-4e3f-9032-95537ee57b88. {{(pid=122683) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 05 21:18:32.545246 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-758fd1c4-2a3f-4e6e-ab7b-48d6d20a097c tempest-AttachVolumeNegativeTest-607117153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:18:32.549133 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-758fd1c4-2a3f-4e6e-ab7b-48d6d20a097c tempest-AttachVolumeNegativeTest-607117153 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:18:32.549631 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-758fd1c4-2a3f-4e6e-ab7b-48d6d20a097c tempest-AttachVolumeNegativeTest-607117153 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:18:32.570473 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-758fd1c4-2a3f-4e6e-ab7b-48d6d20a097c tempest-AttachVolumeNegativeTest-607117153 None] Flow 'volume_create_manager' (a6d22709-4243-4dc4-8824-1b7561a2ea21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:18:32.577392 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-758fd1c4-2a3f-4e6e-ab7b-48d6d20a097c tempest-AttachVolumeNegativeTest-607117153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed246278-ba9d-4634-8638-3eb4f97178d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:18:32.583836 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-758fd1c4-2a3f-4e6e-ab7b-48d6d20a097c tempest-AttachVolumeNegativeTest-607117153 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:18:32.598023 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-758fd1c4-2a3f-4e6e-ab7b-48d6d20a097c tempest-AttachVolumeNegativeTest-607117153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed246278-ba9d-4634-8638-3eb4f97178d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-116277376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=99114e74-70a9-42fc-bf0f-59d69206427d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e1134701b2d45d7878177ad9dc5d45c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:18:33Z,use_quota=True,user_id='de2d340184fb41a0a5274f98eb5ab359',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:18:32.603579 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-758fd1c4-2a3f-4e6e-ab7b-48d6d20a097c tempest-AttachVolumeNegativeTest-607117153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c0f8e31-ee46-493d-a95c-5b883bd4fcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:18:32.608745 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-758fd1c4-2a3f-4e6e-ab7b-48d6d20a097c tempest-AttachVolumeNegativeTest-607117153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c0f8e31-ee46-493d-a95c-5b883bd4fcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:18:32.614304 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-758fd1c4-2a3f-4e6e-ab7b-48d6d20a097c tempest-AttachVolumeNegativeTest-607117153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a712bc95-56e5-4001-8d6c-55ab12ad1d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:18:32.618836 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-758fd1c4-2a3f-4e6e-ab7b-48d6d20a097c tempest-AttachVolumeNegativeTest-607117153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a712bc95-56e5-4001-8d6c-55ab12ad1d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99114e74-70a9-42fc-bf0f-59d69206427d', 'volume_name': 'volume-99114e74-70a9-42fc-bf0f-59d69206427d', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:18:32.624436 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-758fd1c4-2a3f-4e6e-ab7b-48d6d20a097c tempest-AttachVolumeNegativeTest-607117153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (898c59fa-569a-45db-bb3d-51b663563dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:18:32.628513 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-758fd1c4-2a3f-4e6e-ab7b-48d6d20a097c tempest-AttachVolumeNegativeTest-607117153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (898c59fa-569a-45db-bb3d-51b663563dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:18:32.633300 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-758fd1c4-2a3f-4e6e-ab7b-48d6d20a097c tempest-AttachVolumeNegativeTest-607117153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b1b4417-8738-4e7d-a810-1d160294003a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:18:32.634404 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-758fd1c4-2a3f-4e6e-ab7b-48d6d20a097c tempest-AttachVolumeNegativeTest-607117153 None] Volume 99114e74-70a9-42fc-bf0f-59d69206427d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99114e74-70a9-42fc-bf0f-59d69206427d', 'volume_size': 1} Feb 05 21:18:32.634811 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-758fd1c4-2a3f-4e6e-ab7b-48d6d20a097c tempest-AttachVolumeNegativeTest-607117153 None] creating volume 'volume-99114e74-70a9-42fc-bf0f-59d69206427d' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:18:32.635915 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-758fd1c4-2a3f-4e6e-ab7b-48d6d20a097c tempest-AttachVolumeNegativeTest-607117153 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:18:32.686459 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-758fd1c4-2a3f-4e6e-ab7b-48d6d20a097c tempest-AttachVolumeNegativeTest-607117153 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:18:32.686843 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-758fd1c4-2a3f-4e6e-ab7b-48d6d20a097c tempest-AttachVolumeNegativeTest-607117153 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:18:32.690594 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-758fd1c4-2a3f-4e6e-ab7b-48d6d20a097c tempest-AttachVolumeNegativeTest-607117153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b1b4417-8738-4e7d-a810-1d160294003a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99114e74-70a9-42fc-bf0f-59d69206427d', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:18:32.695368 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-758fd1c4-2a3f-4e6e-ab7b-48d6d20a097c tempest-AttachVolumeNegativeTest-607117153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d75d4ca-205e-4f0a-a9a6-0c32cf7d99d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:18:32.704109 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-758fd1c4-2a3f-4e6e-ab7b-48d6d20a097c tempest-AttachVolumeNegativeTest-607117153 None] Volume volume-99114e74-70a9-42fc-bf0f-59d69206427d (99114e74-70a9-42fc-bf0f-59d69206427d): created successfully Feb 05 21:18:32.707723 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-758fd1c4-2a3f-4e6e-ab7b-48d6d20a097c tempest-AttachVolumeNegativeTest-607117153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d75d4ca-205e-4f0a-a9a6-0c32cf7d99d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:18:32.713284 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-758fd1c4-2a3f-4e6e-ab7b-48d6d20a097c tempest-AttachVolumeNegativeTest-607117153 None] Flow 'volume_create_manager' (a6d22709-4243-4dc4-8824-1b7561a2ea21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:18:32.720358 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-758fd1c4-2a3f-4e6e-ab7b-48d6d20a097c tempest-AttachVolumeNegativeTest-607117153 None] Created volume successfully. Feb 05 21:18:33.926183 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-56085838-e2b0-4256-a697-33c91c92f910 req-1f3f8c48-36a7-4f65-b5d3-0de3c900cb58 tempest-AttachVolumeNegativeTest-607117153 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 21:18:34.556793 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-56085838-e2b0-4256-a697-33c91c92f910 req-1f3f8c48-36a7-4f65-b5d3-0de3c900cb58 tempest-AttachVolumeNegativeTest-607117153 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.630s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 21:18:34.557648 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-56085838-e2b0-4256-a697-33c91c92f910 req-1f3f8c48-36a7-4f65-b5d3-0de3c900cb58 tempest-AttachVolumeNegativeTest-607117153 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-99114e74-70a9-42fc-bf0f-59d69206427d', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': '99114e74-70a9-42fc-bf0f-59d69206427d', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 21:18:34.579838 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-56085838-e2b0-4256-a697-33c91c92f910 req-1f3f8c48-36a7-4f65-b5d3-0de3c900cb58 tempest-AttachVolumeNegativeTest-607117153 None] Connection info returned from driver {'name': 'volumes/volume-99114e74-70a9-42fc-bf0f-59d69206427d', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '99114e74-70a9-42fc-bf0f-59d69206427d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'cb8b3026-790a-4dc0-8549-fee642719c84'} {{(pid=122683) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 05 21:18:34.623813 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-56085838-e2b0-4256-a697-33c91c92f910 req-1f3f8c48-36a7-4f65-b5d3-0de3c900cb58 tempest-AttachVolumeNegativeTest-607117153 None] attachment_update completed successfully. Feb 05 21:18:36.946795 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-85e8ae99-439d-4a32-acab-88850c75f01f req-00a90592-9fa8-405a-b4c2-8095616d33fd tempest-AttachVolumeNegativeTest-607117153 None] Terminate volume connection completed successfully. Feb 05 21:18:36.947385 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-85e8ae99-439d-4a32-acab-88850c75f01f req-00a90592-9fa8-405a-b4c2-8095616d33fd tempest-AttachVolumeNegativeTest-607117153 None] Deleting attachment cb8b3026-790a-4dc0-8549-fee642719c84. {{(pid=122683) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 05 21:18:48.892733 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea3b33a3-2593-4aee-9fd3-90885dbab112 tempest-AttachVolumeNegativeTest-607117153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:18:48.897233 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-ea3b33a3-2593-4aee-9fd3-90885dbab112 tempest-AttachVolumeNegativeTest-607117153 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:18:48.897730 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-ea3b33a3-2593-4aee-9fd3-90885dbab112 tempest-AttachVolumeNegativeTest-607117153 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:18:48.918127 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ea3b33a3-2593-4aee-9fd3-90885dbab112 tempest-AttachVolumeNegativeTest-607117153 None] Flow 'volume_create_manager' (a40a6cd2-74b1-4701-b471-1ebd2b780acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:18:48.925449 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ea3b33a3-2593-4aee-9fd3-90885dbab112 tempest-AttachVolumeNegativeTest-607117153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ab41f67-fe47-4c9e-92f5-eadef4bc6ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:18:48.934400 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-ea3b33a3-2593-4aee-9fd3-90885dbab112 tempest-AttachVolumeNegativeTest-607117153 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:18:48.948254 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ea3b33a3-2593-4aee-9fd3-90885dbab112 tempest-AttachVolumeNegativeTest-607117153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ab41f67-fe47-4c9e-92f5-eadef4bc6ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-658585487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b5888887-4d89-469b-955d-fd94e0d5bf1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e1134701b2d45d7878177ad9dc5d45c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:18:49Z,use_quota=True,user_id='de2d340184fb41a0a5274f98eb5ab359',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:18:48.954360 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ea3b33a3-2593-4aee-9fd3-90885dbab112 tempest-AttachVolumeNegativeTest-607117153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7512cbc4-4bed-4887-bea7-7c4c2b131b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:18:48.958552 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ea3b33a3-2593-4aee-9fd3-90885dbab112 tempest-AttachVolumeNegativeTest-607117153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7512cbc4-4bed-4887-bea7-7c4c2b131b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:18:48.963724 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ea3b33a3-2593-4aee-9fd3-90885dbab112 tempest-AttachVolumeNegativeTest-607117153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (729f6279-fdd8-4d37-aded-58d2a6ff5edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:18:48.968806 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ea3b33a3-2593-4aee-9fd3-90885dbab112 tempest-AttachVolumeNegativeTest-607117153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (729f6279-fdd8-4d37-aded-58d2a6ff5edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5888887-4d89-469b-955d-fd94e0d5bf1d', 'volume_name': 'volume-b5888887-4d89-469b-955d-fd94e0d5bf1d', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:18:48.973860 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ea3b33a3-2593-4aee-9fd3-90885dbab112 tempest-AttachVolumeNegativeTest-607117153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d5e2a3b-ada4-4661-8446-7f3177000888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:18:48.977899 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ea3b33a3-2593-4aee-9fd3-90885dbab112 tempest-AttachVolumeNegativeTest-607117153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d5e2a3b-ada4-4661-8446-7f3177000888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:18:48.982699 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ea3b33a3-2593-4aee-9fd3-90885dbab112 tempest-AttachVolumeNegativeTest-607117153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdb5ab4a-94f2-4dab-a219-3bd4b9bcfe4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:18:48.984005 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-ea3b33a3-2593-4aee-9fd3-90885dbab112 tempest-AttachVolumeNegativeTest-607117153 None] Volume b5888887-4d89-469b-955d-fd94e0d5bf1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5888887-4d89-469b-955d-fd94e0d5bf1d', 'volume_size': 1} Feb 05 21:18:48.984406 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ea3b33a3-2593-4aee-9fd3-90885dbab112 tempest-AttachVolumeNegativeTest-607117153 None] creating volume 'volume-b5888887-4d89-469b-955d-fd94e0d5bf1d' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:18:48.985497 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ea3b33a3-2593-4aee-9fd3-90885dbab112 tempest-AttachVolumeNegativeTest-607117153 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:18:49.036890 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ea3b33a3-2593-4aee-9fd3-90885dbab112 tempest-AttachVolumeNegativeTest-607117153 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:18:49.037276 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ea3b33a3-2593-4aee-9fd3-90885dbab112 tempest-AttachVolumeNegativeTest-607117153 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:18:49.041269 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ea3b33a3-2593-4aee-9fd3-90885dbab112 tempest-AttachVolumeNegativeTest-607117153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdb5ab4a-94f2-4dab-a219-3bd4b9bcfe4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5888887-4d89-469b-955d-fd94e0d5bf1d', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:18:49.046047 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ea3b33a3-2593-4aee-9fd3-90885dbab112 tempest-AttachVolumeNegativeTest-607117153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57d30885-b463-45ae-b50f-90c7c6d896c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:18:49.054959 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-ea3b33a3-2593-4aee-9fd3-90885dbab112 tempest-AttachVolumeNegativeTest-607117153 None] Volume volume-b5888887-4d89-469b-955d-fd94e0d5bf1d (b5888887-4d89-469b-955d-fd94e0d5bf1d): created successfully Feb 05 21:18:49.058507 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ea3b33a3-2593-4aee-9fd3-90885dbab112 tempest-AttachVolumeNegativeTest-607117153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57d30885-b463-45ae-b50f-90c7c6d896c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:18:49.064188 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-ea3b33a3-2593-4aee-9fd3-90885dbab112 tempest-AttachVolumeNegativeTest-607117153 None] Flow 'volume_create_manager' (a40a6cd2-74b1-4701-b471-1ebd2b780acf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:18:49.071420 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-ea3b33a3-2593-4aee-9fd3-90885dbab112 tempest-AttachVolumeNegativeTest-607117153 None] Created volume successfully. Feb 05 21:18:50.292526 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-b474f703-22c8-45ed-aa53-cf9b15f57b11 req-a7b3f02a-8780-4466-9a0d-bafbb2800ef0 tempest-AttachVolumeNegativeTest-607117153 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 21:18:50.942527 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-b474f703-22c8-45ed-aa53-cf9b15f57b11 req-a7b3f02a-8780-4466-9a0d-bafbb2800ef0 tempest-AttachVolumeNegativeTest-607117153 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.650s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 21:18:50.943379 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-b474f703-22c8-45ed-aa53-cf9b15f57b11 req-a7b3f02a-8780-4466-9a0d-bafbb2800ef0 tempest-AttachVolumeNegativeTest-607117153 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b5888887-4d89-469b-955d-fd94e0d5bf1d', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': 'b5888887-4d89-469b-955d-fd94e0d5bf1d', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 21:18:50.966602 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-b474f703-22c8-45ed-aa53-cf9b15f57b11 req-a7b3f02a-8780-4466-9a0d-bafbb2800ef0 tempest-AttachVolumeNegativeTest-607117153 None] Connection info returned from driver {'name': 'volumes/volume-b5888887-4d89-469b-955d-fd94e0d5bf1d', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'b5888887-4d89-469b-955d-fd94e0d5bf1d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'dd42bd3d-2c42-4f90-a051-9f98c5c200d4'} {{(pid=122683) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 05 21:18:51.010587 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-b474f703-22c8-45ed-aa53-cf9b15f57b11 req-a7b3f02a-8780-4466-9a0d-bafbb2800ef0 tempest-AttachVolumeNegativeTest-607117153 None] attachment_update completed successfully. Feb 05 21:18:52.697928 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:18:52.699054 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:18:52.723235 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:18:52.749348 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:18:54.370064 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-5c8096cb-5afd-41b6-884c-bbcc26616df8 req-da48661f-6064-49b6-98ed-3ffa60931e8c tempest-AttachVolumeNegativeTest-607117153 None] Terminate volume connection completed successfully. Feb 05 21:18:54.370689 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-5c8096cb-5afd-41b6-884c-bbcc26616df8 req-da48661f-6064-49b6-98ed-3ffa60931e8c tempest-AttachVolumeNegativeTest-607117153 None] Deleting attachment dd42bd3d-2c42-4f90-a051-9f98c5c200d4. {{(pid=122683) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 05 21:18:54.868428 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-5844067e-0cc2-4da6-8e4e-b4074dceb616 tempest-AttachVolumeNegativeTest-607117153 None] Lock "b'cinder-b5888887-4d89-469b-955d-fd94e0d5bf1d-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:18:54.899790 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5844067e-0cc2-4da6-8e4e-b4074dceb616 tempest-AttachVolumeNegativeTest-607117153 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:18:54.939138 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5844067e-0cc2-4da6-8e4e-b4074dceb616 tempest-AttachVolumeNegativeTest-607117153 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:18:54.939593 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5844067e-0cc2-4da6-8e4e-b4074dceb616 tempest-AttachVolumeNegativeTest-607117153 None] Volume volume-b5888887-4d89-469b-955d-fd94e0d5bf1d is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:18:54.945097 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5844067e-0cc2-4da6-8e4e-b4074dceb616 tempest-AttachVolumeNegativeTest-607117153 None] deleting rbd volume volume-b5888887-4d89-469b-955d-fd94e0d5bf1d {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:18:55.138911 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-5844067e-0cc2-4da6-8e4e-b4074dceb616 tempest-AttachVolumeNegativeTest-607117153 None] Created reservations ['493b3efc-cabe-46d4-a72e-5b8910e2a0bb', '021855f9-e91a-4c28-bbde-1d868a733a43', '23739cb4-ddc3-490f-af10-33f1593d414b', '13817aa2-42ff-497d-9bf8-30d28ca83ead'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:18:55.178235 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5844067e-0cc2-4da6-8e4e-b4074dceb616 tempest-AttachVolumeNegativeTest-607117153 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:18:55.201503 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5844067e-0cc2-4da6-8e4e-b4074dceb616 tempest-AttachVolumeNegativeTest-607117153 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:18:55.226263 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-5844067e-0cc2-4da6-8e4e-b4074dceb616 tempest-AttachVolumeNegativeTest-607117153 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:18:55.230354 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-5844067e-0cc2-4da6-8e4e-b4074dceb616 tempest-AttachVolumeNegativeTest-607117153 None] Deleted volume successfully. Feb 05 21:18:55.253843 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-5844067e-0cc2-4da6-8e4e-b4074dceb616 tempest-AttachVolumeNegativeTest-607117153 None] Lock "b'cinder-b5888887-4d89-469b-955d-fd94e0d5bf1d-delete_volume'" released by "delete_volume" :: held 0.385s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:18:59.590634 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-ef6a47ec-3336-4716-b45c-2c365eae8876 tempest-AttachVolumeNegativeTest-607117153 None] Lock "b'cinder-99114e74-70a9-42fc-bf0f-59d69206427d-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:18:59.620753 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ef6a47ec-3336-4716-b45c-2c365eae8876 tempest-AttachVolumeNegativeTest-607117153 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:18:59.657177 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ef6a47ec-3336-4716-b45c-2c365eae8876 tempest-AttachVolumeNegativeTest-607117153 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:18:59.657605 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ef6a47ec-3336-4716-b45c-2c365eae8876 tempest-AttachVolumeNegativeTest-607117153 None] Volume volume-99114e74-70a9-42fc-bf0f-59d69206427d is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:18:59.662768 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ef6a47ec-3336-4716-b45c-2c365eae8876 tempest-AttachVolumeNegativeTest-607117153 None] deleting rbd volume volume-99114e74-70a9-42fc-bf0f-59d69206427d {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:18:59.851159 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-ef6a47ec-3336-4716-b45c-2c365eae8876 tempest-AttachVolumeNegativeTest-607117153 None] Created reservations ['eda94808-6aa5-43af-8334-2302b99f468e', '7b75376e-c4ef-42d8-9cf9-10687f5ce778', '6649a7ed-f3e5-413f-839b-395b6addd4d4', '593f6ae4-edf1-475e-abbf-fe5ef688ce4c'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:18:59.890395 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ef6a47ec-3336-4716-b45c-2c365eae8876 tempest-AttachVolumeNegativeTest-607117153 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:18:59.912954 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-ef6a47ec-3336-4716-b45c-2c365eae8876 tempest-AttachVolumeNegativeTest-607117153 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:18:59.941204 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-ef6a47ec-3336-4716-b45c-2c365eae8876 tempest-AttachVolumeNegativeTest-607117153 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:18:59.946506 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-ef6a47ec-3336-4716-b45c-2c365eae8876 tempest-AttachVolumeNegativeTest-607117153 None] Deleted volume successfully. Feb 05 21:18:59.958539 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-ef6a47ec-3336-4716-b45c-2c365eae8876 tempest-AttachVolumeNegativeTest-607117153 None] Lock "b'cinder-99114e74-70a9-42fc-bf0f-59d69206427d-delete_volume'" released by "delete_volume" :: held 0.368s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:19:07.908332 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-e6ae5eec-f689-47ab-91ad-c2d6c6f6154d tempest-AttachVolumeNegativeTest-607117153 None] Lock "b'cinder-28da735b-c9b9-4bf9-9971-3c7a790a0dd3-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:19:07.942869 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e6ae5eec-f689-47ab-91ad-c2d6c6f6154d tempest-AttachVolumeNegativeTest-607117153 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:19:07.981014 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e6ae5eec-f689-47ab-91ad-c2d6c6f6154d tempest-AttachVolumeNegativeTest-607117153 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:19:07.981442 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e6ae5eec-f689-47ab-91ad-c2d6c6f6154d tempest-AttachVolumeNegativeTest-607117153 None] Volume volume-28da735b-c9b9-4bf9-9971-3c7a790a0dd3 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:19:07.985853 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e6ae5eec-f689-47ab-91ad-c2d6c6f6154d tempest-AttachVolumeNegativeTest-607117153 None] deleting rbd volume volume-28da735b-c9b9-4bf9-9971-3c7a790a0dd3 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:19:08.189844 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-e6ae5eec-f689-47ab-91ad-c2d6c6f6154d tempest-AttachVolumeNegativeTest-607117153 None] Created reservations ['f1e4a1a1-0f81-4ab6-a9c8-f132410ec34c', '63c2ab89-4d25-4243-af0a-4ffa7b9f8fcb', 'daa7d253-ca2f-439d-8b2f-0292760ac246', 'aa6b31ff-997f-4d5d-9754-a8ac5db21f8b'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:19:08.227808 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e6ae5eec-f689-47ab-91ad-c2d6c6f6154d tempest-AttachVolumeNegativeTest-607117153 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:19:08.249637 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-e6ae5eec-f689-47ab-91ad-c2d6c6f6154d tempest-AttachVolumeNegativeTest-607117153 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:19:08.280264 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-e6ae5eec-f689-47ab-91ad-c2d6c6f6154d tempest-AttachVolumeNegativeTest-607117153 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:19:08.285628 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-e6ae5eec-f689-47ab-91ad-c2d6c6f6154d tempest-AttachVolumeNegativeTest-607117153 None] Deleted volume successfully. Feb 05 21:19:08.296585 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-e6ae5eec-f689-47ab-91ad-c2d6c6f6154d tempest-AttachVolumeNegativeTest-607117153 None] Lock "b'cinder-28da735b-c9b9-4bf9-9971-3c7a790a0dd3-delete_volume'" released by "delete_volume" :: held 0.388s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:19:52.697740 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:19:52.698434 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:19:52.722119 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:19:52.761643 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:20:52.700202 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:20:52.701397 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:20:52.733507 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:20:52.780078 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:21:36.887394 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d846e66-08cc-4455-ae58-81723d8ab38c tempest-VolumesSnapshotNegativeTestJSON-792152070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:21:36.891729 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-6d846e66-08cc-4455-ae58-81723d8ab38c tempest-VolumesSnapshotNegativeTestJSON-792152070 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:21:36.892206 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-6d846e66-08cc-4455-ae58-81723d8ab38c tempest-VolumesSnapshotNegativeTestJSON-792152070 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:21:36.912266 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6d846e66-08cc-4455-ae58-81723d8ab38c tempest-VolumesSnapshotNegativeTestJSON-792152070 None] Flow 'volume_create_manager' (47ea2fb8-ad9c-44e3-9527-2034518e63e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:21:36.918939 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6d846e66-08cc-4455-ae58-81723d8ab38c tempest-VolumesSnapshotNegativeTestJSON-792152070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3513554d-e356-42b0-9d19-d692f2d2174b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:21:36.925673 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-6d846e66-08cc-4455-ae58-81723d8ab38c tempest-VolumesSnapshotNegativeTestJSON-792152070 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:21:36.941184 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6d846e66-08cc-4455-ae58-81723d8ab38c tempest-VolumesSnapshotNegativeTestJSON-792152070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3513554d-e356-42b0-9d19-d692f2d2174b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-663054836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=533f5ec7-02cf-4ecf-ad40-8f51ec3251c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='848ee2e60b9246889b60ef64db768013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:21:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:21:37Z,use_quota=True,user_id='1e91868b40474a74bb209a9fd6213b90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:21:36.946664 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6d846e66-08cc-4455-ae58-81723d8ab38c tempest-VolumesSnapshotNegativeTestJSON-792152070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c234e5-25b9-416c-b6b2-dba06e2ef78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:21:36.950814 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6d846e66-08cc-4455-ae58-81723d8ab38c tempest-VolumesSnapshotNegativeTestJSON-792152070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c234e5-25b9-416c-b6b2-dba06e2ef78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:21:36.956906 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6d846e66-08cc-4455-ae58-81723d8ab38c tempest-VolumesSnapshotNegativeTestJSON-792152070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9098f7f7-86af-4d56-827f-6748fb781fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:21:36.961080 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6d846e66-08cc-4455-ae58-81723d8ab38c tempest-VolumesSnapshotNegativeTestJSON-792152070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9098f7f7-86af-4d56-827f-6748fb781fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '533f5ec7-02cf-4ecf-ad40-8f51ec3251c8', 'volume_name': 'volume-533f5ec7-02cf-4ecf-ad40-8f51ec3251c8', 'volume_size': 2}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:21:36.966012 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6d846e66-08cc-4455-ae58-81723d8ab38c tempest-VolumesSnapshotNegativeTestJSON-792152070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9db2f74e-fd7f-4f76-9d30-b096ff572879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:21:36.970556 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6d846e66-08cc-4455-ae58-81723d8ab38c tempest-VolumesSnapshotNegativeTestJSON-792152070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9db2f74e-fd7f-4f76-9d30-b096ff572879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:21:36.975274 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6d846e66-08cc-4455-ae58-81723d8ab38c tempest-VolumesSnapshotNegativeTestJSON-792152070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56587552-dad8-4be0-8b97-c9973c629dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:21:36.976341 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-6d846e66-08cc-4455-ae58-81723d8ab38c tempest-VolumesSnapshotNegativeTestJSON-792152070 None] Volume 533f5ec7-02cf-4ecf-ad40-8f51ec3251c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-533f5ec7-02cf-4ecf-ad40-8f51ec3251c8', 'volume_size': 2} Feb 05 21:21:36.976733 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6d846e66-08cc-4455-ae58-81723d8ab38c tempest-VolumesSnapshotNegativeTestJSON-792152070 None] creating volume 'volume-533f5ec7-02cf-4ecf-ad40-8f51ec3251c8' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:21:36.977690 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6d846e66-08cc-4455-ae58-81723d8ab38c tempest-VolumesSnapshotNegativeTestJSON-792152070 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:21:37.026105 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6d846e66-08cc-4455-ae58-81723d8ab38c tempest-VolumesSnapshotNegativeTestJSON-792152070 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:21:37.026515 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6d846e66-08cc-4455-ae58-81723d8ab38c tempest-VolumesSnapshotNegativeTestJSON-792152070 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:21:37.030221 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6d846e66-08cc-4455-ae58-81723d8ab38c tempest-VolumesSnapshotNegativeTestJSON-792152070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56587552-dad8-4be0-8b97-c9973c629dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-533f5ec7-02cf-4ecf-ad40-8f51ec3251c8', 'volume_size': 2}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:21:37.035232 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6d846e66-08cc-4455-ae58-81723d8ab38c tempest-VolumesSnapshotNegativeTestJSON-792152070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1a79d0f-f7e5-4ceb-8de7-7030872aeb32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:21:37.044179 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-6d846e66-08cc-4455-ae58-81723d8ab38c tempest-VolumesSnapshotNegativeTestJSON-792152070 None] Volume volume-533f5ec7-02cf-4ecf-ad40-8f51ec3251c8 (533f5ec7-02cf-4ecf-ad40-8f51ec3251c8): created successfully Feb 05 21:21:37.048172 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6d846e66-08cc-4455-ae58-81723d8ab38c tempest-VolumesSnapshotNegativeTestJSON-792152070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1a79d0f-f7e5-4ceb-8de7-7030872aeb32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:21:37.053677 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-6d846e66-08cc-4455-ae58-81723d8ab38c tempest-VolumesSnapshotNegativeTestJSON-792152070 None] Flow 'volume_create_manager' (47ea2fb8-ad9c-44e3-9527-2034518e63e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:21:37.060899 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-6d846e66-08cc-4455-ae58-81723d8ab38c tempest-VolumesSnapshotNegativeTestJSON-792152070 None] Created volume successfully. Feb 05 21:21:38.066550 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3b3015d2-d769-475a-a029-18509f5f7b94 tempest-VolumesSnapshotNegativeTestJSON-792152070 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:21:38.483473 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-3b3015d2-d769-475a-a029-18509f5f7b94 tempest-VolumesSnapshotNegativeTestJSON-792152070 None] Create snapshot completed successfully Feb 05 21:21:39.184654 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-c0894893-1673-45cc-8bb3-05708c97f453 tempest-VolumesSnapshotNegativeTestJSON-792152070 None] Lock "b'cinder-98964425-f04f-43f2-9b95-2809a2328ef8-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.008s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:21:39.186126 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c0894893-1673-45cc-8bb3-05708c97f453 tempest-VolumesSnapshotNegativeTestJSON-792152070 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:21:39.537773 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-c0894893-1673-45cc-8bb3-05708c97f453 tempest-VolumesSnapshotNegativeTestJSON-792152070 None] Created reservations ['432e7ad3-fcbc-4360-b4b3-20e5f8d4ea2b', 'ae3e13e3-7d33-48a5-8d8e-4d08e31492d7', 'e60bcfb3-3a5b-48a1-a6bf-4049a3e49573', '82cdaa4f-6671-4b48-9769-583b0b38ac37'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:21:39.570622 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-c0894893-1673-45cc-8bb3-05708c97f453 tempest-VolumesSnapshotNegativeTestJSON-792152070 None] Delete snapshot completed successfully. Feb 05 21:21:39.575026 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-c0894893-1673-45cc-8bb3-05708c97f453 tempest-VolumesSnapshotNegativeTestJSON-792152070 None] Lock "b'cinder-98964425-f04f-43f2-9b95-2809a2328ef8-delete_snapshot'" released by "delete_snapshot" :: held 0.390s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:21:40.277505 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-c14c1764-2086-4bad-be02-e94fc3c51413 tempest-VolumesSnapshotNegativeTestJSON-792152070 None] Lock "b'cinder-533f5ec7-02cf-4ecf-ad40-8f51ec3251c8-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:21:40.310428 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c14c1764-2086-4bad-be02-e94fc3c51413 tempest-VolumesSnapshotNegativeTestJSON-792152070 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:21:40.346708 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c14c1764-2086-4bad-be02-e94fc3c51413 tempest-VolumesSnapshotNegativeTestJSON-792152070 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:21:40.347235 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c14c1764-2086-4bad-be02-e94fc3c51413 tempest-VolumesSnapshotNegativeTestJSON-792152070 None] Volume volume-533f5ec7-02cf-4ecf-ad40-8f51ec3251c8 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:21:40.351998 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c14c1764-2086-4bad-be02-e94fc3c51413 tempest-VolumesSnapshotNegativeTestJSON-792152070 None] deleting rbd volume volume-533f5ec7-02cf-4ecf-ad40-8f51ec3251c8 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:21:40.551443 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-c14c1764-2086-4bad-be02-e94fc3c51413 tempest-VolumesSnapshotNegativeTestJSON-792152070 None] Created reservations ['a3463183-f227-47f0-ac5f-66a80d0bd708', '4c1d4b2d-b98f-4407-9451-2ca570be60f3', '8c75ee1c-edf6-4cb6-a95a-a7b19d6c38ba', '646148ca-6429-4fef-9216-7599c9c42a4b'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:21:40.590303 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c14c1764-2086-4bad-be02-e94fc3c51413 tempest-VolumesSnapshotNegativeTestJSON-792152070 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:21:40.611539 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-c14c1764-2086-4bad-be02-e94fc3c51413 tempest-VolumesSnapshotNegativeTestJSON-792152070 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:21:40.635465 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-c14c1764-2086-4bad-be02-e94fc3c51413 tempest-VolumesSnapshotNegativeTestJSON-792152070 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:21:40.639753 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-c14c1764-2086-4bad-be02-e94fc3c51413 tempest-VolumesSnapshotNegativeTestJSON-792152070 None] Deleted volume successfully. Feb 05 21:21:40.652247 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-c14c1764-2086-4bad-be02-e94fc3c51413 tempest-VolumesSnapshotNegativeTestJSON-792152070 None] Lock "b'cinder-533f5ec7-02cf-4ecf-ad40-8f51ec3251c8-delete_volume'" released by "delete_volume" :: held 0.375s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:21:52.706190 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:21:52.707533 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:21:52.742823 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:21:52.783525 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:22:52.704637 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:22:52.706703 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:22:52.728789 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:22:52.752378 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:23:52.707347 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:23:52.708070 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:23:52.729511 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:23:52.751284 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:24:52.711221 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:24:52.712002 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:24:52.733739 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:24:52.756637 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:25:52.716483 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:25:52.717168 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:25:52.743132 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:25:52.780507 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:26:52.716390 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:26:52.717052 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:26:52.738908 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:26:52.760218 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:27:52.716217 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:27:52.717278 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:27:52.738797 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:27:52.761228 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:28:52.716359 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:28:52.717083 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:28:52.743500 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:28:52.776503 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:29:52.713360 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:29:52.714005 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:29:52.736134 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:29:52.758482 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:30:52.713509 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:30:52.714166 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:30:52.735071 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:30:52.761217 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:31:52.710304 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:31:52.710913 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:31:52.738889 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:31:52.778073 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:32:06.100285 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-596eb209-5214-4a00-8a7d-aa0b8ffe9d0a tempest-TestVolumeBackupRestore-1373251088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:32:06.103658 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-596eb209-5214-4a00-8a7d-aa0b8ffe9d0a tempest-TestVolumeBackupRestore-1373251088 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:32:06.104105 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-596eb209-5214-4a00-8a7d-aa0b8ffe9d0a tempest-TestVolumeBackupRestore-1373251088 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:32:06.124913 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-596eb209-5214-4a00-8a7d-aa0b8ffe9d0a tempest-TestVolumeBackupRestore-1373251088 None] Flow 'volume_create_manager' (5fb05c40-8343-4248-b4eb-84d0b2fa647a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:32:06.131569 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-596eb209-5214-4a00-8a7d-aa0b8ffe9d0a tempest-TestVolumeBackupRestore-1373251088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5762ad0e-8d23-4b23-bbc5-40c38364e029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:32:06.138241 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-596eb209-5214-4a00-8a7d-aa0b8ffe9d0a tempest-TestVolumeBackupRestore-1373251088 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:32:06.154821 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-596eb209-5214-4a00-8a7d-aa0b8ffe9d0a tempest-TestVolumeBackupRestore-1373251088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5762ad0e-8d23-4b23-bbc5-40c38364e029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-1536439458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=894fa68e-2bf7-4768-ac8b-021977d33c46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='457bdfbbba5b4e69a1bf1577ce565fc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:32:06Z,use_quota=True,user_id='dd304cad36bd4b3188051c354d575206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:32:06.161768 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-596eb209-5214-4a00-8a7d-aa0b8ffe9d0a tempest-TestVolumeBackupRestore-1373251088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c838080d-448f-4143-81b5-e3a529e641f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:32:06.165992 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-596eb209-5214-4a00-8a7d-aa0b8ffe9d0a tempest-TestVolumeBackupRestore-1373251088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c838080d-448f-4143-81b5-e3a529e641f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:32:06.171529 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-596eb209-5214-4a00-8a7d-aa0b8ffe9d0a tempest-TestVolumeBackupRestore-1373251088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b111fc19-feef-4f77-95b6-28984a770535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:32:06.251939 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-596eb209-5214-4a00-8a7d-aa0b8ffe9d0a tempest-TestVolumeBackupRestore-1373251088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b111fc19-feef-4f77-95b6-28984a770535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '894fa68e-2bf7-4768-ac8b-021977d33c46', 'volume_name': 'volume-894fa68e-2bf7-4768-ac8b-021977d33c46', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:32:06.257056 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-596eb209-5214-4a00-8a7d-aa0b8ffe9d0a tempest-TestVolumeBackupRestore-1373251088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (978e8124-aa03-482d-b441-dcaaa9345c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:32:06.261157 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-596eb209-5214-4a00-8a7d-aa0b8ffe9d0a tempest-TestVolumeBackupRestore-1373251088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (978e8124-aa03-482d-b441-dcaaa9345c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:32:06.265941 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-596eb209-5214-4a00-8a7d-aa0b8ffe9d0a tempest-TestVolumeBackupRestore-1373251088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b43a391-b7a8-4475-8d8a-bf5ab6e4e8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:32:06.267139 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-596eb209-5214-4a00-8a7d-aa0b8ffe9d0a tempest-TestVolumeBackupRestore-1373251088 None] Volume 894fa68e-2bf7-4768-ac8b-021977d33c46: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-894fa68e-2bf7-4768-ac8b-021977d33c46', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 05 21:32:06.267697 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-596eb209-5214-4a00-8a7d-aa0b8ffe9d0a tempest-TestVolumeBackupRestore-1373251088 None] Cloning 894fa68e-2bf7-4768-ac8b-021977d33c46 from image e66a3a3b-d2f9-4d5d-8021-a6001dff419f at location (None, None). {{(pid=122683) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 05 21:32:06.276462 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-596eb209-5214-4a00-8a7d-aa0b8ffe9d0a tempest-TestVolumeBackupRestore-1373251088 None] Lock "b'cinder-e66a3a3b-d2f9-4d5d-8021-a6001dff419f'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:32:06.289254 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-596eb209-5214-4a00-8a7d-aa0b8ffe9d0a tempest-TestVolumeBackupRestore-1373251088 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'volume_id': '311ef4be-45fd-4167-a3ad-6251d56550a7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57), 'last_used': datetime.datetime(2022, 2, 5, 21, 32, 6, 280720)}. {{(pid=122683) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 05 21:32:06.289694 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-596eb209-5214-4a00-8a7d-aa0b8ffe9d0a tempest-TestVolumeBackupRestore-1373251088 None] Image-volume cache entry image_update_at = 2022-02-05 20:37:57+00:00, requested image updated_at = 2022-02-05 20:37:57+00:00. {{(pid=122683) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 05 21:32:06.290099 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-596eb209-5214-4a00-8a7d-aa0b8ffe9d0a tempest-TestVolumeBackupRestore-1373251088 None] Found cache entry for image = e66a3a3b-d2f9-4d5d-8021-a6001dff419f on host ncdv-master-1@ceph#ceph. {{(pid=122683) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Feb 05 21:32:06.294458 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-596eb209-5214-4a00-8a7d-aa0b8ffe9d0a tempest-TestVolumeBackupRestore-1373251088 None] Lock "b'cinder-e66a3a3b-d2f9-4d5d-8021-a6001dff419f'" released by "_prepare_image_cache_entry" :: held 0.018s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:32:06.295403 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-596eb209-5214-4a00-8a7d-aa0b8ffe9d0a tempest-TestVolumeBackupRestore-1373251088 None] Attempting to retrieve cache entry for image = e66a3a3b-d2f9-4d5d-8021-a6001dff419f on host ncdv-master-1@ceph#ceph. {{(pid=122683) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 05 21:32:06.301786 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-596eb209-5214-4a00-8a7d-aa0b8ffe9d0a tempest-TestVolumeBackupRestore-1373251088 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'volume_id': '311ef4be-45fd-4167-a3ad-6251d56550a7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57), 'last_used': datetime.datetime(2022, 2, 5, 21, 32, 6, 299522)}. {{(pid=122683) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 05 21:32:06.302228 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-596eb209-5214-4a00-8a7d-aa0b8ffe9d0a tempest-TestVolumeBackupRestore-1373251088 None] Image-volume cache entry image_update_at = 2022-02-05 20:37:57+00:00, requested image updated_at = 2022-02-05 20:37:57+00:00. {{(pid=122683) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 05 21:32:06.302690 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-596eb209-5214-4a00-8a7d-aa0b8ffe9d0a tempest-TestVolumeBackupRestore-1373251088 None] Creating from source image-volume 311ef4be-45fd-4167-a3ad-6251d56550a7 {{(pid=122683) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Feb 05 21:32:06.313944 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-596eb209-5214-4a00-8a7d-aa0b8ffe9d0a tempest-TestVolumeBackupRestore-1373251088 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:32:06.364471 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-596eb209-5214-4a00-8a7d-aa0b8ffe9d0a tempest-TestVolumeBackupRestore-1373251088 None] creating snapshot='volume-894fa68e-2bf7-4768-ac8b-021977d33c46.clone_snap' {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 05 21:32:06.860582 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-596eb209-5214-4a00-8a7d-aa0b8ffe9d0a tempest-TestVolumeBackupRestore-1373251088 None] cloning 'volume-311ef4be-45fd-4167-a3ad-6251d56550a7@volume-894fa68e-2bf7-4768-ac8b-021977d33c46.clone_snap' to 'volume-894fa68e-2bf7-4768-ac8b-021977d33c46' {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 05 21:32:06.996141 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-596eb209-5214-4a00-8a7d-aa0b8ffe9d0a tempest-TestVolumeBackupRestore-1373251088 None] Volume volume-35445a36-a76c-48db-a9c5-3b58646c1e7b.deleted is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:32:06.997237 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-596eb209-5214-4a00-8a7d-aa0b8ffe9d0a tempest-TestVolumeBackupRestore-1373251088 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:32:06.997597 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-596eb209-5214-4a00-8a7d-aa0b8ffe9d0a tempest-TestVolumeBackupRestore-1373251088 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:32:07.020121 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-596eb209-5214-4a00-8a7d-aa0b8ffe9d0a tempest-TestVolumeBackupRestore-1373251088 None] clone created successfully {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 05 21:32:07.020737 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.volume_utils [None req-596eb209-5214-4a00-8a7d-aa0b8ffe9d0a tempest-TestVolumeBackupRestore-1373251088 None] Marking volume 894fa68e-2bf7-4768-ac8b-021977d33c46 as bootable. {{(pid=122683) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Feb 05 21:32:07.030108 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-596eb209-5214-4a00-8a7d-aa0b8ffe9d0a tempest-TestVolumeBackupRestore-1373251088 None] Copying metadata from image e66a3a3b-d2f9-4d5d-8021-a6001dff419f to 894fa68e-2bf7-4768-ac8b-021977d33c46. {{(pid=122683) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 05 21:32:07.030589 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-596eb209-5214-4a00-8a7d-aa0b8ffe9d0a tempest-TestVolumeBackupRestore-1373251088 None] Creating volume glance metadata for volume 894fa68e-2bf7-4768-ac8b-021977d33c46 backed by image e66a3a3b-d2f9-4d5d-8021-a6001dff419f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=122683) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 05 21:32:07.088426 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-596eb209-5214-4a00-8a7d-aa0b8ffe9d0a tempest-TestVolumeBackupRestore-1373251088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b43a391-b7a8-4475-8d8a-bf5ab6e4e8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-894fa68e-2bf7-4768-ac8b-021977d33c46', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:32:07.095540 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-596eb209-5214-4a00-8a7d-aa0b8ffe9d0a tempest-TestVolumeBackupRestore-1373251088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c14c6c7-dec2-4080-977e-ff445cdea68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:32:07.107025 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-596eb209-5214-4a00-8a7d-aa0b8ffe9d0a tempest-TestVolumeBackupRestore-1373251088 None] Volume volume-894fa68e-2bf7-4768-ac8b-021977d33c46 (894fa68e-2bf7-4768-ac8b-021977d33c46): created successfully Feb 05 21:32:07.111458 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-596eb209-5214-4a00-8a7d-aa0b8ffe9d0a tempest-TestVolumeBackupRestore-1373251088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c14c6c7-dec2-4080-977e-ff445cdea68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:32:07.117237 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-596eb209-5214-4a00-8a7d-aa0b8ffe9d0a tempest-TestVolumeBackupRestore-1373251088 None] Flow 'volume_create_manager' (5fb05c40-8343-4248-b4eb-84d0b2fa647a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:32:07.125336 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-596eb209-5214-4a00-8a7d-aa0b8ffe9d0a tempest-TestVolumeBackupRestore-1373251088 None] Created volume successfully. Feb 05 21:32:08.441222 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-2b943691-d019-41f8-a802-e19a756aed02 tempest-TestVolumeBackupRestore-1373251088 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-02-05T21:32:08Z,data_timestamp=2022-02-05T21:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=a0679c23-44a4-4396-9299-89991fb4b729,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='457bdfbbba5b4e69a1bf1577ce565fc9',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='dd304cad36bd4b3188051c354d575206',volume_id=894fa68e-2bf7-4768-ac8b-021977d33c46) Feb 05 21:32:08.442059 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.backup.rpcapi [None req-2b943691-d019-41f8-a802-e19a756aed02 tempest-TestVolumeBackupRestore-1373251088 None] continue_backup in rpcapi backup_id a0679c23-44a4-4396-9299-89991fb4b729 {{(pid=122683) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Feb 05 21:32:08.602162 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [None req-2b943691-d019-41f8-a802-e19a756aed02 tempest-TestVolumeBackupRestore-1373251088 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 21:32:09.284041 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [None req-2b943691-d019-41f8-a802-e19a756aed02 tempest-TestVolumeBackupRestore-1373251088 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.681s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 21:32:09.285064 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-2b943691-d019-41f8-a802-e19a756aed02 tempest-TestVolumeBackupRestore-1373251088 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-894fa68e-2bf7-4768-ac8b-021977d33c46', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': '894fa68e-2bf7-4768-ac8b-021977d33c46', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 21:32:09.301499 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-2b943691-d019-41f8-a802-e19a756aed02 tempest-TestVolumeBackupRestore-1373251088 None] Initialize volume connection completed successfully. Feb 05 21:32:14.712723 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-2b943691-d019-41f8-a802-e19a756aed02 tempest-TestVolumeBackupRestore-1373251088 None] Terminate volume connection completed successfully. Feb 05 21:32:14.731160 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-2b943691-d019-41f8-a802-e19a756aed02 tempest-TestVolumeBackupRestore-1373251088 None] Remove volume export completed successfully. Feb 05 21:32:15.937705 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-dacab71f-cd86-46da-af62-410a104acd64 tempest-TestVolumeBackupRestore-1373251088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:32:15.941761 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-dacab71f-cd86-46da-af62-410a104acd64 tempest-TestVolumeBackupRestore-1373251088 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:32:15.942018 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-dacab71f-cd86-46da-af62-410a104acd64 tempest-TestVolumeBackupRestore-1373251088 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:32:15.962215 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-dacab71f-cd86-46da-af62-410a104acd64 tempest-TestVolumeBackupRestore-1373251088 None] Flow 'volume_create_manager' (49207bf7-c55b-4e4e-81fb-667ff2873b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:32:15.968935 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-dacab71f-cd86-46da-af62-410a104acd64 tempest-TestVolumeBackupRestore-1373251088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daca0980-6794-45bb-981b-5931c1769ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:32:15.976139 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-dacab71f-cd86-46da-af62-410a104acd64 tempest-TestVolumeBackupRestore-1373251088 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:32:15.990285 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-dacab71f-cd86-46da-af62-410a104acd64 tempest-TestVolumeBackupRestore-1373251088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daca0980-6794-45bb-981b-5931c1769ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:32:16Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_a0679c23-44a4-4396-9299-89991fb4b729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=23710495-8762-4ece-a46a-b17509d91aa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='457bdfbbba5b4e69a1bf1577ce565fc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:32:16Z,use_quota=True,user_id='dd304cad36bd4b3188051c354d575206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:32:15.995812 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-dacab71f-cd86-46da-af62-410a104acd64 tempest-TestVolumeBackupRestore-1373251088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5f579ad-f67e-4503-881f-992c6e7b4ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:32:16.000017 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-dacab71f-cd86-46da-af62-410a104acd64 tempest-TestVolumeBackupRestore-1373251088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5f579ad-f67e-4503-881f-992c6e7b4ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:32:16.005898 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-dacab71f-cd86-46da-af62-410a104acd64 tempest-TestVolumeBackupRestore-1373251088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f8c21c3-0ad4-43af-89ee-0fd5b592a7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:32:16.010158 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-dacab71f-cd86-46da-af62-410a104acd64 tempest-TestVolumeBackupRestore-1373251088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f8c21c3-0ad4-43af-89ee-0fd5b592a7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23710495-8762-4ece-a46a-b17509d91aa5', 'volume_name': 'volume-23710495-8762-4ece-a46a-b17509d91aa5', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:32:16.015242 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-dacab71f-cd86-46da-af62-410a104acd64 tempest-TestVolumeBackupRestore-1373251088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (461867a5-4a3e-4c8d-b1af-844a609e2bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:32:16.019871 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-dacab71f-cd86-46da-af62-410a104acd64 tempest-TestVolumeBackupRestore-1373251088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (461867a5-4a3e-4c8d-b1af-844a609e2bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:32:16.024687 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-dacab71f-cd86-46da-af62-410a104acd64 tempest-TestVolumeBackupRestore-1373251088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3553ff6-4b40-4e6d-ad62-4da000a40452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:32:16.025780 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-dacab71f-cd86-46da-af62-410a104acd64 tempest-TestVolumeBackupRestore-1373251088 None] Volume 23710495-8762-4ece-a46a-b17509d91aa5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23710495-8762-4ece-a46a-b17509d91aa5', 'volume_size': 1} Feb 05 21:32:16.026183 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-dacab71f-cd86-46da-af62-410a104acd64 tempest-TestVolumeBackupRestore-1373251088 None] creating volume 'volume-23710495-8762-4ece-a46a-b17509d91aa5' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:32:16.027316 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-dacab71f-cd86-46da-af62-410a104acd64 tempest-TestVolumeBackupRestore-1373251088 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:32:16.078114 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-dacab71f-cd86-46da-af62-410a104acd64 tempest-TestVolumeBackupRestore-1373251088 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:32:16.078494 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-dacab71f-cd86-46da-af62-410a104acd64 tempest-TestVolumeBackupRestore-1373251088 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:32:16.082862 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-dacab71f-cd86-46da-af62-410a104acd64 tempest-TestVolumeBackupRestore-1373251088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3553ff6-4b40-4e6d-ad62-4da000a40452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23710495-8762-4ece-a46a-b17509d91aa5', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:32:16.087620 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-dacab71f-cd86-46da-af62-410a104acd64 tempest-TestVolumeBackupRestore-1373251088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df7b5df4-98b9-4cf2-8daa-2833fbcb4447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:32:16.097287 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-dacab71f-cd86-46da-af62-410a104acd64 tempest-TestVolumeBackupRestore-1373251088 None] Volume volume-23710495-8762-4ece-a46a-b17509d91aa5 (23710495-8762-4ece-a46a-b17509d91aa5): created successfully Feb 05 21:32:16.100989 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-dacab71f-cd86-46da-af62-410a104acd64 tempest-TestVolumeBackupRestore-1373251088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df7b5df4-98b9-4cf2-8daa-2833fbcb4447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:32:16.107937 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-dacab71f-cd86-46da-af62-410a104acd64 tempest-TestVolumeBackupRestore-1373251088 None] Flow 'volume_create_manager' (49207bf7-c55b-4e4e-81fb-667ff2873b01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:32:16.116215 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-dacab71f-cd86-46da-af62-410a104acd64 tempest-TestVolumeBackupRestore-1373251088 None] Created volume successfully. Feb 05 21:32:16.997578 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [None req-dacab71f-cd86-46da-af62-410a104acd64 tempest-TestVolumeBackupRestore-1373251088 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 21:32:17.627308 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [None req-dacab71f-cd86-46da-af62-410a104acd64 tempest-TestVolumeBackupRestore-1373251088 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.629s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 21:32:17.628400 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-dacab71f-cd86-46da-af62-410a104acd64 tempest-TestVolumeBackupRestore-1373251088 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-23710495-8762-4ece-a46a-b17509d91aa5', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': '23710495-8762-4ece-a46a-b17509d91aa5', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 21:32:17.644322 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-dacab71f-cd86-46da-af62-410a104acd64 tempest-TestVolumeBackupRestore-1373251088 None] Initialize volume connection completed successfully. Feb 05 21:32:21.181438 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-dacab71f-cd86-46da-af62-410a104acd64 tempest-TestVolumeBackupRestore-1373251088 None] Terminate volume connection completed successfully. Feb 05 21:32:21.198268 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-dacab71f-cd86-46da-af62-410a104acd64 tempest-TestVolumeBackupRestore-1373251088 None] Remove volume export completed successfully. Feb 05 21:32:25.497372 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-64c40af5-c975-45a0-97d3-6ba37f8063c1 req-0156f2c9-e60c-4f73-b4ff-bf76c9fb777c tempest-TestVolumeBackupRestore-1373251088 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 21:32:26.186957 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-64c40af5-c975-45a0-97d3-6ba37f8063c1 req-0156f2c9-e60c-4f73-b4ff-bf76c9fb777c tempest-TestVolumeBackupRestore-1373251088 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.689s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 21:32:26.187768 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-64c40af5-c975-45a0-97d3-6ba37f8063c1 req-0156f2c9-e60c-4f73-b4ff-bf76c9fb777c tempest-TestVolumeBackupRestore-1373251088 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-23710495-8762-4ece-a46a-b17509d91aa5', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': '23710495-8762-4ece-a46a-b17509d91aa5', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 21:32:26.210590 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-64c40af5-c975-45a0-97d3-6ba37f8063c1 req-0156f2c9-e60c-4f73-b4ff-bf76c9fb777c tempest-TestVolumeBackupRestore-1373251088 None] Connection info returned from driver {'name': 'volumes/volume-23710495-8762-4ece-a46a-b17509d91aa5', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '23710495-8762-4ece-a46a-b17509d91aa5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'e3d33f81-598e-4481-9dc7-829bb9099285'} {{(pid=122683) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 05 21:32:26.260332 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-64c40af5-c975-45a0-97d3-6ba37f8063c1 req-0156f2c9-e60c-4f73-b4ff-bf76c9fb777c tempest-TestVolumeBackupRestore-1373251088 None] attachment_update completed successfully. Feb 05 21:32:52.708864 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:32:52.710105 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:32:52.741087 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:32:52.764446 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:33:24.514283 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-9691dfeb-0dc1-49f6-bf46-8496e4c7a49d req-ec5590e7-5be2-4904-b189-e3ca88065a4d tempest-TestVolumeBackupRestore-1373251088 None] Terminate volume connection completed successfully. Feb 05 21:33:24.514924 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-9691dfeb-0dc1-49f6-bf46-8496e4c7a49d req-ec5590e7-5be2-4904-b189-e3ca88065a4d tempest-TestVolumeBackupRestore-1373251088 None] Deleting attachment e3d33f81-598e-4481-9dc7-829bb9099285. {{(pid=122683) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 05 21:33:26.014573 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-3dcfdafa-da60-4a1c-823e-96012b0ad2d8 tempest-TestVolumeBackupRestore-1373251088 None] Lock "b'cinder-23710495-8762-4ece-a46a-b17509d91aa5-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:33:26.045568 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3dcfdafa-da60-4a1c-823e-96012b0ad2d8 tempest-TestVolumeBackupRestore-1373251088 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:33:26.891014 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3dcfdafa-da60-4a1c-823e-96012b0ad2d8 tempest-TestVolumeBackupRestore-1373251088 None] Volume volume-23710495-8762-4ece-a46a-b17509d91aa5 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:33:26.913997 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3dcfdafa-da60-4a1c-823e-96012b0ad2d8 tempest-TestVolumeBackupRestore-1373251088 None] deleting rbd volume volume-23710495-8762-4ece-a46a-b17509d91aa5 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:33:26.927723 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-6d8d1a4f-49b0-4894-9243-51f28ffcaa82 tempest-TestVolumeBackupRestore-1373251088 None] Lock "b'cinder-894fa68e-2bf7-4768-ac8b-021977d33c46-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:33:26.962749 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6d8d1a4f-49b0-4894-9243-51f28ffcaa82 tempest-TestVolumeBackupRestore-1373251088 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:33:27.907910 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6d8d1a4f-49b0-4894-9243-51f28ffcaa82 tempest-TestVolumeBackupRestore-1373251088 None] deleting rbd volume volume-894fa68e-2bf7-4768-ac8b-021977d33c46 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:33:27.953019 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-3dcfdafa-da60-4a1c-823e-96012b0ad2d8 tempest-TestVolumeBackupRestore-1373251088 None] Created reservations ['1a8479d2-a26b-45aa-ace7-955e5656a1f3', 'fdc5a481-4ff2-48dd-8ca7-3368fa58fa3b', '7cddf898-70a9-4036-814c-86717f4004d0', 'd7aa75f9-2006-40ed-986a-8e8c385e4a26'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:33:27.999827 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3dcfdafa-da60-4a1c-823e-96012b0ad2d8 tempest-TestVolumeBackupRestore-1373251088 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:33:28.028356 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3dcfdafa-da60-4a1c-823e-96012b0ad2d8 tempest-TestVolumeBackupRestore-1373251088 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:33:28.054732 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-3dcfdafa-da60-4a1c-823e-96012b0ad2d8 tempest-TestVolumeBackupRestore-1373251088 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:33:28.058842 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-3dcfdafa-da60-4a1c-823e-96012b0ad2d8 tempest-TestVolumeBackupRestore-1373251088 None] Deleted volume successfully. Feb 05 21:33:28.072287 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-3dcfdafa-da60-4a1c-823e-96012b0ad2d8 tempest-TestVolumeBackupRestore-1373251088 None] Lock "b'cinder-23710495-8762-4ece-a46a-b17509d91aa5-delete_volume'" released by "delete_volume" :: held 2.058s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:33:28.117598 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6d8d1a4f-49b0-4894-9243-51f28ffcaa82 tempest-TestVolumeBackupRestore-1373251088 None] volume is a clone so cleaning references {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 05 21:33:28.150181 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6d8d1a4f-49b0-4894-9243-51f28ffcaa82 tempest-TestVolumeBackupRestore-1373251088 None] deleting parent snapshot volume-894fa68e-2bf7-4768-ac8b-021977d33c46.clone_snap {{(pid=122683) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 05 21:33:28.963340 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-6d8d1a4f-49b0-4894-9243-51f28ffcaa82 tempest-TestVolumeBackupRestore-1373251088 None] Created reservations ['b6cc3f9c-3caf-406a-810a-336e0cbd9353', '4f245cc1-fa56-4343-824d-bb4a04a65f7a', '60657c8b-7d24-42d2-bb81-9b60b1c3f4b3', '607373b7-33cb-41d8-9906-e72bade9277b'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:33:29.004168 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6d8d1a4f-49b0-4894-9243-51f28ffcaa82 tempest-TestVolumeBackupRestore-1373251088 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:33:29.025694 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6d8d1a4f-49b0-4894-9243-51f28ffcaa82 tempest-TestVolumeBackupRestore-1373251088 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:33:29.048408 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6d8d1a4f-49b0-4894-9243-51f28ffcaa82 tempest-TestVolumeBackupRestore-1373251088 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:33:29.053228 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-6d8d1a4f-49b0-4894-9243-51f28ffcaa82 tempest-TestVolumeBackupRestore-1373251088 None] Deleted volume successfully. Feb 05 21:33:29.064655 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-6d8d1a4f-49b0-4894-9243-51f28ffcaa82 tempest-TestVolumeBackupRestore-1373251088 None] Lock "b'cinder-894fa68e-2bf7-4768-ac8b-021977d33c46-delete_volume'" released by "delete_volume" :: held 2.137s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:33:52.709984 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:33:52.710678 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:33:52.740638 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:33:52.765474 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:34:52.711213 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:34:52.712659 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:34:52.741559 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:34:52.774433 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:35:52.710117 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:35:52.710824 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:35:52.756964 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:35:52.796832 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:36:52.711534 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:36:52.712227 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:36:52.733477 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:36:52.756253 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:37:52.710974 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:37:52.711854 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:37:52.735053 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:37:52.756587 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:38:52.712229 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:38:52.712948 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:38:52.737967 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:38:52.761743 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:39:29.377073 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7f84585-b31b-4ce3-85b6-97c625e58b0c tempest-ServerActionsTestJSON-1039652783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:39:29.381420 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-b7f84585-b31b-4ce3-85b6-97c625e58b0c tempest-ServerActionsTestJSON-1039652783 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:39:29.381936 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-b7f84585-b31b-4ce3-85b6-97c625e58b0c tempest-ServerActionsTestJSON-1039652783 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:39:29.403960 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b7f84585-b31b-4ce3-85b6-97c625e58b0c tempest-ServerActionsTestJSON-1039652783 None] Flow 'volume_create_manager' (98974161-8336-43e2-bc41-adc04eb5560a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:39:29.410796 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b7f84585-b31b-4ce3-85b6-97c625e58b0c tempest-ServerActionsTestJSON-1039652783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c108c092-b527-4e90-ae34-a8278aee239f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:39:29.417387 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-b7f84585-b31b-4ce3-85b6-97c625e58b0c tempest-ServerActionsTestJSON-1039652783 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:39:29.432421 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b7f84585-b31b-4ce3-85b6-97c625e58b0c tempest-ServerActionsTestJSON-1039652783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c108c092-b527-4e90-ae34-a8278aee239f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-807790740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2403df7b-e13b-43c6-8117-e04cf56576b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da51ac8e46d54f059d8d5252e292443f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:39:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:39:29Z,use_quota=True,user_id='34b96f38e6154fdd8f26bab904e53ac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:39:29.437968 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b7f84585-b31b-4ce3-85b6-97c625e58b0c tempest-ServerActionsTestJSON-1039652783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3047c8e-8b90-4685-a426-e12c41b8b0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:39:29.442808 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b7f84585-b31b-4ce3-85b6-97c625e58b0c tempest-ServerActionsTestJSON-1039652783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3047c8e-8b90-4685-a426-e12c41b8b0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:39:29.448161 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b7f84585-b31b-4ce3-85b6-97c625e58b0c tempest-ServerActionsTestJSON-1039652783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c52a7e88-f5d9-4aa4-96b4-4b37d65cdb6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:39:29.452477 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b7f84585-b31b-4ce3-85b6-97c625e58b0c tempest-ServerActionsTestJSON-1039652783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c52a7e88-f5d9-4aa4-96b4-4b37d65cdb6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2403df7b-e13b-43c6-8117-e04cf56576b6', 'volume_name': 'volume-2403df7b-e13b-43c6-8117-e04cf56576b6', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:39:29.458493 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b7f84585-b31b-4ce3-85b6-97c625e58b0c tempest-ServerActionsTestJSON-1039652783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c83d64f7-e4b8-4f04-9931-3c87f25dca99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:39:29.462602 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b7f84585-b31b-4ce3-85b6-97c625e58b0c tempest-ServerActionsTestJSON-1039652783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c83d64f7-e4b8-4f04-9931-3c87f25dca99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:39:29.467457 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b7f84585-b31b-4ce3-85b6-97c625e58b0c tempest-ServerActionsTestJSON-1039652783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed99adce-034b-488d-b314-bbcfb4849ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:39:29.468558 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-b7f84585-b31b-4ce3-85b6-97c625e58b0c tempest-ServerActionsTestJSON-1039652783 None] Volume 2403df7b-e13b-43c6-8117-e04cf56576b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2403df7b-e13b-43c6-8117-e04cf56576b6', 'volume_size': 1} Feb 05 21:39:29.468959 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-b7f84585-b31b-4ce3-85b6-97c625e58b0c tempest-ServerActionsTestJSON-1039652783 None] creating volume 'volume-2403df7b-e13b-43c6-8117-e04cf56576b6' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:39:29.469965 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-b7f84585-b31b-4ce3-85b6-97c625e58b0c tempest-ServerActionsTestJSON-1039652783 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:39:29.517007 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-b7f84585-b31b-4ce3-85b6-97c625e58b0c tempest-ServerActionsTestJSON-1039652783 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:39:29.517383 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-b7f84585-b31b-4ce3-85b6-97c625e58b0c tempest-ServerActionsTestJSON-1039652783 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:39:29.521272 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b7f84585-b31b-4ce3-85b6-97c625e58b0c tempest-ServerActionsTestJSON-1039652783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed99adce-034b-488d-b314-bbcfb4849ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2403df7b-e13b-43c6-8117-e04cf56576b6', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:39:29.525978 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b7f84585-b31b-4ce3-85b6-97c625e58b0c tempest-ServerActionsTestJSON-1039652783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b35d1a55-1b3f-413e-af10-9a728d8a416d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:39:29.534687 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-b7f84585-b31b-4ce3-85b6-97c625e58b0c tempest-ServerActionsTestJSON-1039652783 None] Volume volume-2403df7b-e13b-43c6-8117-e04cf56576b6 (2403df7b-e13b-43c6-8117-e04cf56576b6): created successfully Feb 05 21:39:29.538460 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b7f84585-b31b-4ce3-85b6-97c625e58b0c tempest-ServerActionsTestJSON-1039652783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b35d1a55-1b3f-413e-af10-9a728d8a416d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:39:29.543973 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-b7f84585-b31b-4ce3-85b6-97c625e58b0c tempest-ServerActionsTestJSON-1039652783 None] Flow 'volume_create_manager' (98974161-8336-43e2-bc41-adc04eb5560a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:39:29.551314 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-b7f84585-b31b-4ce3-85b6-97c625e58b0c tempest-ServerActionsTestJSON-1039652783 None] Created volume successfully. Feb 05 21:39:31.019752 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-9ed7e863-a8d4-4705-9231-da5f4bb825cb req-c7374cc9-2ae0-4499-a5bd-32019294ecec tempest-ServerActionsTestJSON-1039652783 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 21:39:31.655696 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-9ed7e863-a8d4-4705-9231-da5f4bb825cb req-c7374cc9-2ae0-4499-a5bd-32019294ecec tempest-ServerActionsTestJSON-1039652783 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.636s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 21:39:31.656516 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-9ed7e863-a8d4-4705-9231-da5f4bb825cb req-c7374cc9-2ae0-4499-a5bd-32019294ecec tempest-ServerActionsTestJSON-1039652783 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2403df7b-e13b-43c6-8117-e04cf56576b6', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': '2403df7b-e13b-43c6-8117-e04cf56576b6', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 21:39:31.679906 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-9ed7e863-a8d4-4705-9231-da5f4bb825cb req-c7374cc9-2ae0-4499-a5bd-32019294ecec tempest-ServerActionsTestJSON-1039652783 None] Connection info returned from driver {'name': 'volumes/volume-2403df7b-e13b-43c6-8117-e04cf56576b6', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2403df7b-e13b-43c6-8117-e04cf56576b6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b224fb01-97e2-47b8-9529-8c271c8f6343'} {{(pid=122683) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 05 21:39:31.725338 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-9ed7e863-a8d4-4705-9231-da5f4bb825cb req-c7374cc9-2ae0-4499-a5bd-32019294ecec tempest-ServerActionsTestJSON-1039652783 None] attachment_update completed successfully. Feb 05 21:39:52.717625 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:39:52.719269 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:39:52.746917 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:39:52.770067 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:39:57.448727 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-eca7719a-42ae-4d98-983b-d3cb94e69d0c req-095b9c2b-eb6f-4672-b32e-795759b37622 tempest-ServerActionsTestJSON-1039652783 None] Terminate volume connection completed successfully. Feb 05 21:39:57.449434 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-eca7719a-42ae-4d98-983b-d3cb94e69d0c req-095b9c2b-eb6f-4672-b32e-795759b37622 tempest-ServerActionsTestJSON-1039652783 None] Deleting attachment b224fb01-97e2-47b8-9529-8c271c8f6343. {{(pid=122683) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 05 21:39:59.305038 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-eca7719a-42ae-4d98-983b-d3cb94e69d0c req-a0274323-ae70-426b-b0c5-41b0e6893c4f tempest-ServerActionsTestJSON-1039652783 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 21:39:59.945500 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-eca7719a-42ae-4d98-983b-d3cb94e69d0c req-a0274323-ae70-426b-b0c5-41b0e6893c4f tempest-ServerActionsTestJSON-1039652783 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.640s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 21:39:59.946253 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-eca7719a-42ae-4d98-983b-d3cb94e69d0c req-a0274323-ae70-426b-b0c5-41b0e6893c4f tempest-ServerActionsTestJSON-1039652783 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2403df7b-e13b-43c6-8117-e04cf56576b6', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': '2403df7b-e13b-43c6-8117-e04cf56576b6', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 21:39:59.967908 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-eca7719a-42ae-4d98-983b-d3cb94e69d0c req-a0274323-ae70-426b-b0c5-41b0e6893c4f tempest-ServerActionsTestJSON-1039652783 None] Connection info returned from driver {'name': 'volumes/volume-2403df7b-e13b-43c6-8117-e04cf56576b6', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2403df7b-e13b-43c6-8117-e04cf56576b6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '23cb85b2-9a41-4d7d-baf8-9011a434f1ad'} {{(pid=122683) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 05 21:40:00.015331 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-eca7719a-42ae-4d98-983b-d3cb94e69d0c req-a0274323-ae70-426b-b0c5-41b0e6893c4f tempest-ServerActionsTestJSON-1039652783 None] attachment_update completed successfully. Feb 05 21:40:06.538846 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-90f2a42d-4249-40a4-a09b-95d1e2509dfa req-ceb190ee-f7d8-45e1-b820-7994ae71dc02 tempest-ServerActionsTestJSON-1039652783 None] Terminate volume connection completed successfully. Feb 05 21:40:06.540025 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-90f2a42d-4249-40a4-a09b-95d1e2509dfa req-ceb190ee-f7d8-45e1-b820-7994ae71dc02 tempest-ServerActionsTestJSON-1039652783 None] Deleting attachment 23cb85b2-9a41-4d7d-baf8-9011a434f1ad. {{(pid=122683) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 05 21:40:08.741388 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-90f2a42d-4249-40a4-a09b-95d1e2509dfa req-c500f82a-a9dc-4c7c-b053-f3c24ff88a86 tempest-ServerActionsTestJSON-1039652783 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 21:40:09.374918 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-90f2a42d-4249-40a4-a09b-95d1e2509dfa req-c500f82a-a9dc-4c7c-b053-f3c24ff88a86 tempest-ServerActionsTestJSON-1039652783 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.633s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 21:40:09.375686 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-90f2a42d-4249-40a4-a09b-95d1e2509dfa req-c500f82a-a9dc-4c7c-b053-f3c24ff88a86 tempest-ServerActionsTestJSON-1039652783 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2403df7b-e13b-43c6-8117-e04cf56576b6', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': '2403df7b-e13b-43c6-8117-e04cf56576b6', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 21:40:09.396624 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-90f2a42d-4249-40a4-a09b-95d1e2509dfa req-c500f82a-a9dc-4c7c-b053-f3c24ff88a86 tempest-ServerActionsTestJSON-1039652783 None] Connection info returned from driver {'name': 'volumes/volume-2403df7b-e13b-43c6-8117-e04cf56576b6', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2403df7b-e13b-43c6-8117-e04cf56576b6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '732fc3cf-3843-44c5-a0f9-91386af61215'} {{(pid=122683) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 05 21:40:09.441506 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-90f2a42d-4249-40a4-a09b-95d1e2509dfa req-c500f82a-a9dc-4c7c-b053-f3c24ff88a86 tempest-ServerActionsTestJSON-1039652783 None] attachment_update completed successfully. Feb 05 21:40:17.115562 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-1dfc019e-ea71-4550-bc37-15de49d3ae2b req-fcb2d6b6-16c0-4f94-80cd-1dbfb429fe20 tempest-ServerActionsTestJSON-1039652783 None] Terminate volume connection completed successfully. Feb 05 21:40:17.116248 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-1dfc019e-ea71-4550-bc37-15de49d3ae2b req-fcb2d6b6-16c0-4f94-80cd-1dbfb429fe20 tempest-ServerActionsTestJSON-1039652783 None] Deleting attachment 732fc3cf-3843-44c5-a0f9-91386af61215. {{(pid=122683) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 05 21:40:18.063572 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-3efe0244-12fb-4c80-9781-8efa4a44337c tempest-ServerActionsTestJSON-1039652783 None] Lock "b'cinder-2403df7b-e13b-43c6-8117-e04cf56576b6-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:40:18.103305 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3efe0244-12fb-4c80-9781-8efa4a44337c tempest-ServerActionsTestJSON-1039652783 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:40:18.142275 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3efe0244-12fb-4c80-9781-8efa4a44337c tempest-ServerActionsTestJSON-1039652783 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:40:18.142963 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3efe0244-12fb-4c80-9781-8efa4a44337c tempest-ServerActionsTestJSON-1039652783 None] Volume volume-2403df7b-e13b-43c6-8117-e04cf56576b6 is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:40:18.147993 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3efe0244-12fb-4c80-9781-8efa4a44337c tempest-ServerActionsTestJSON-1039652783 None] deleting rbd volume volume-2403df7b-e13b-43c6-8117-e04cf56576b6 {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:40:18.334037 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-3efe0244-12fb-4c80-9781-8efa4a44337c tempest-ServerActionsTestJSON-1039652783 None] Created reservations ['b1861a1e-1f53-40ba-b6fb-febca67babf5', 'c62d6f68-a4e0-49f3-8765-9f8e4908629f', '64a5dd1b-47cd-43a0-98a8-1c6e96de100e', '1423ee49-0b29-464c-aeb2-99660deb380f'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:40:18.373593 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3efe0244-12fb-4c80-9781-8efa4a44337c tempest-ServerActionsTestJSON-1039652783 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:40:18.396233 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-3efe0244-12fb-4c80-9781-8efa4a44337c tempest-ServerActionsTestJSON-1039652783 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:40:18.420094 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-3efe0244-12fb-4c80-9781-8efa4a44337c tempest-ServerActionsTestJSON-1039652783 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:40:18.425336 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-3efe0244-12fb-4c80-9781-8efa4a44337c tempest-ServerActionsTestJSON-1039652783 None] Deleted volume successfully. Feb 05 21:40:18.436405 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-3efe0244-12fb-4c80-9781-8efa4a44337c tempest-ServerActionsTestJSON-1039652783 None] Lock "b'cinder-2403df7b-e13b-43c6-8117-e04cf56576b6-delete_volume'" released by "delete_volume" :: held 0.373s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:40:52.715891 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:40:52.716652 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:40:52.740908 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:40:52.763994 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:41:52.719828 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:41:52.720580 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:41:52.743354 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:41:52.765866 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:41:55.619442 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-eac8506a-5c53-4263-aaa7-40830bb4a381 tempest-TestMinimumBasicScenario-1819785942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 21:41:55.623093 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-eac8506a-5c53-4263-aaa7-40830bb4a381 tempest-TestMinimumBasicScenario-1819785942 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 21:41:55.623573 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-eac8506a-5c53-4263-aaa7-40830bb4a381 tempest-TestMinimumBasicScenario-1819785942 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 21:41:55.643693 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-eac8506a-5c53-4263-aaa7-40830bb4a381 tempest-TestMinimumBasicScenario-1819785942 None] Flow 'volume_create_manager' (7ad7c601-a6c1-4005-bcfa-fb8f4ccb1c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:41:55.650302 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-eac8506a-5c53-4263-aaa7-40830bb4a381 tempest-TestMinimumBasicScenario-1819785942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (977dd3db-48b4-4542-84b0-285876648759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:41:55.657150 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-eac8506a-5c53-4263-aaa7-40830bb4a381 tempest-TestMinimumBasicScenario-1819785942 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 21:41:55.671413 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-eac8506a-5c53-4263-aaa7-40830bb4a381 tempest-TestMinimumBasicScenario-1819785942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (977dd3db-48b4-4542-84b0-285876648759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T21:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-27865245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8bb997fa-5243-4de8-9ef1-21132ae1cd5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c3f47ed255445f5b7a2c3d296cd76e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T21:41:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T21:41:56Z,use_quota=True,user_id='df3b8046b37e4b6da334e0472af63204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:41:55.676852 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-eac8506a-5c53-4263-aaa7-40830bb4a381 tempest-TestMinimumBasicScenario-1819785942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2717bfd-d29b-4d69-9886-405c95084e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:41:55.681565 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-eac8506a-5c53-4263-aaa7-40830bb4a381 tempest-TestMinimumBasicScenario-1819785942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2717bfd-d29b-4d69-9886-405c95084e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:41:55.686761 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-eac8506a-5c53-4263-aaa7-40830bb4a381 tempest-TestMinimumBasicScenario-1819785942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cace5c08-bf26-4327-8c9e-b8fb14207674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:41:55.690918 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-eac8506a-5c53-4263-aaa7-40830bb4a381 tempest-TestMinimumBasicScenario-1819785942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cace5c08-bf26-4327-8c9e-b8fb14207674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bb997fa-5243-4de8-9ef1-21132ae1cd5c', 'volume_name': 'volume-8bb997fa-5243-4de8-9ef1-21132ae1cd5c', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:41:55.696446 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-eac8506a-5c53-4263-aaa7-40830bb4a381 tempest-TestMinimumBasicScenario-1819785942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71cbb60a-7cb0-42bc-af11-ddbf1cfb05c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:41:55.700442 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-eac8506a-5c53-4263-aaa7-40830bb4a381 tempest-TestMinimumBasicScenario-1819785942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71cbb60a-7cb0-42bc-af11-ddbf1cfb05c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:41:55.705159 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-eac8506a-5c53-4263-aaa7-40830bb4a381 tempest-TestMinimumBasicScenario-1819785942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57f64826-29a8-45d8-8a83-70850d6deb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:41:55.706226 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-eac8506a-5c53-4263-aaa7-40830bb4a381 tempest-TestMinimumBasicScenario-1819785942 None] Volume 8bb997fa-5243-4de8-9ef1-21132ae1cd5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bb997fa-5243-4de8-9ef1-21132ae1cd5c', 'volume_size': 1} Feb 05 21:41:55.706645 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-eac8506a-5c53-4263-aaa7-40830bb4a381 tempest-TestMinimumBasicScenario-1819785942 None] creating volume 'volume-8bb997fa-5243-4de8-9ef1-21132ae1cd5c' {{(pid=122683) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 05 21:41:55.707609 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-eac8506a-5c53-4263-aaa7-40830bb4a381 tempest-TestMinimumBasicScenario-1819785942 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:41:55.754639 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-eac8506a-5c53-4263-aaa7-40830bb4a381 tempest-TestMinimumBasicScenario-1819785942 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 21:41:55.755031 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-eac8506a-5c53-4263-aaa7-40830bb4a381 tempest-TestMinimumBasicScenario-1819785942 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 21:41:55.759344 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-eac8506a-5c53-4263-aaa7-40830bb4a381 tempest-TestMinimumBasicScenario-1819785942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57f64826-29a8-45d8-8a83-70850d6deb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bb997fa-5243-4de8-9ef1-21132ae1cd5c', 'volume_size': 1}' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:41:55.763995 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-eac8506a-5c53-4263-aaa7-40830bb4a381 tempest-TestMinimumBasicScenario-1819785942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25cd8f51-951e-4b44-be38-270e5382cd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 21:41:55.773069 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-eac8506a-5c53-4263-aaa7-40830bb4a381 tempest-TestMinimumBasicScenario-1819785942 None] Volume volume-8bb997fa-5243-4de8-9ef1-21132ae1cd5c (8bb997fa-5243-4de8-9ef1-21132ae1cd5c): created successfully Feb 05 21:41:55.776582 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-eac8506a-5c53-4263-aaa7-40830bb4a381 tempest-TestMinimumBasicScenario-1819785942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25cd8f51-951e-4b44-be38-270e5382cd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 21:41:55.782174 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-eac8506a-5c53-4263-aaa7-40830bb4a381 tempest-TestMinimumBasicScenario-1819785942 None] Flow 'volume_create_manager' (7ad7c601-a6c1-4005-bcfa-fb8f4ccb1c9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 21:41:55.789145 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-eac8506a-5c53-4263-aaa7-40830bb4a381 tempest-TestMinimumBasicScenario-1819785942 None] Created volume successfully. Feb 05 21:41:57.156306 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-8a26e21e-4b42-45c8-826a-a2e98cd73351 req-5d68bcfb-82d3-4b63-86b7-945d999427b2 tempest-TestMinimumBasicScenario-1819785942 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 21:41:57.843935 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-8a26e21e-4b42-45c8-826a-a2e98cd73351 req-5d68bcfb-82d3-4b63-86b7-945d999427b2 tempest-TestMinimumBasicScenario-1819785942 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.687s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 21:41:57.844772 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-8a26e21e-4b42-45c8-826a-a2e98cd73351 req-5d68bcfb-82d3-4b63-86b7-945d999427b2 tempest-TestMinimumBasicScenario-1819785942 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-8bb997fa-5243-4de8-9ef1-21132ae1cd5c', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': '8bb997fa-5243-4de8-9ef1-21132ae1cd5c', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 21:41:57.867740 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-8a26e21e-4b42-45c8-826a-a2e98cd73351 req-5d68bcfb-82d3-4b63-86b7-945d999427b2 tempest-TestMinimumBasicScenario-1819785942 None] Connection info returned from driver {'name': 'volumes/volume-8bb997fa-5243-4de8-9ef1-21132ae1cd5c', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '8bb997fa-5243-4de8-9ef1-21132ae1cd5c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'dcc61042-b4d0-4888-b0eb-b1b5f055a884'} {{(pid=122683) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 05 21:41:57.910625 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-8a26e21e-4b42-45c8-826a-a2e98cd73351 req-5d68bcfb-82d3-4b63-86b7-945d999427b2 tempest-TestMinimumBasicScenario-1819785942 None] attachment_update completed successfully. Feb 05 21:42:52.720658 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:42:52.721703 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:42:52.747252 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:42:52.769272 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:43:52.724530 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:43:52.725260 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:43:52.750542 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:43:52.775480 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:44:15.183288 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-27a0dc37-a46f-4503-bdf2-864ffb405002 req-b8347293-3ee7-468d-9ca3-eadea612e4f0 tempest-TestMinimumBasicScenario-1819785942 None] Terminate volume connection completed successfully. Feb 05 21:44:15.184588 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-27a0dc37-a46f-4503-bdf2-864ffb405002 req-b8347293-3ee7-468d-9ca3-eadea612e4f0 tempest-TestMinimumBasicScenario-1819785942 None] Deleting attachment dcc61042-b4d0-4888-b0eb-b1b5f055a884. {{(pid=122683) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 05 21:44:15.891589 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-2e5323b2-46b3-44bd-b2b2-d828a69e0a23 tempest-TestMinimumBasicScenario-1819785942 None] Lock "b'cinder-8bb997fa-5243-4de8-9ef1-21132ae1cd5c-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 21:44:15.922178 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-2e5323b2-46b3-44bd-b2b2-d828a69e0a23 tempest-TestMinimumBasicScenario-1819785942 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:44:15.962933 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-2e5323b2-46b3-44bd-b2b2-d828a69e0a23 tempest-TestMinimumBasicScenario-1819785942 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 21:44:15.963445 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-2e5323b2-46b3-44bd-b2b2-d828a69e0a23 tempest-TestMinimumBasicScenario-1819785942 None] Volume volume-8bb997fa-5243-4de8-9ef1-21132ae1cd5c is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 21:44:15.968009 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-2e5323b2-46b3-44bd-b2b2-d828a69e0a23 tempest-TestMinimumBasicScenario-1819785942 None] deleting rbd volume volume-8bb997fa-5243-4de8-9ef1-21132ae1cd5c {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 21:44:16.152914 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [None req-2e5323b2-46b3-44bd-b2b2-d828a69e0a23 tempest-TestMinimumBasicScenario-1819785942 None] Created reservations ['2a11ac93-7d66-4a88-a4fb-d072810496ef', '34fec964-bf95-4d2f-a7af-44b6d012dd88', '63c1c892-b2ce-4e90-8ba6-250ae08a29fb', '227dcfa8-51ad-491e-96e0-d8540d09a0ee'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 21:44:16.194276 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-2e5323b2-46b3-44bd-b2b2-d828a69e0a23 tempest-TestMinimumBasicScenario-1819785942 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:44:16.221108 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-2e5323b2-46b3-44bd-b2b2-d828a69e0a23 tempest-TestMinimumBasicScenario-1819785942 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:44:16.243589 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-2e5323b2-46b3-44bd-b2b2-d828a69e0a23 tempest-TestMinimumBasicScenario-1819785942 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:44:16.249043 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-2e5323b2-46b3-44bd-b2b2-d828a69e0a23 tempest-TestMinimumBasicScenario-1819785942 None] Deleted volume successfully. Feb 05 21:44:16.260477 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-2e5323b2-46b3-44bd-b2b2-d828a69e0a23 tempest-TestMinimumBasicScenario-1819785942 None] Lock "b'cinder-8bb997fa-5243-4de8-9ef1-21132ae1cd5c-delete_volume'" released by "delete_volume" :: held 0.369s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 21:44:52.720809 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:44:52.721490 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:44:52.750102 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:44:52.773155 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:45:52.718687 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:45:52.719393 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:45:52.742960 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:45:52.768930 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:46:52.723861 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:46:52.724615 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:46:52.755947 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:46:52.780527 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:47:52.726155 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:47:52.726925 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:47:52.755592 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:47:52.785476 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:48:52.730736 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:48:52.731378 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:48:52.798598 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:48:52.856317 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:49:52.731977 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:49:52.732704 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:49:52.768326 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:49:52.791733 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:50:52.736878 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:50:52.737987 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:50:52.762974 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:50:52.790677 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:51:52.735751 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:51:52.736459 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:51:52.758497 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:51:52.786103 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:52:52.732337 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:52:52.733057 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:52:52.754628 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:52:52.776886 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:53:52.731741 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:53:52.732444 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:53:52.778578 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:53:52.833241 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:54:52.730902 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:54:52.731628 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:54:52.753220 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:54:52.775776 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:55:52.730810 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:55:52.731496 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:55:52.755083 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:55:52.789450 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:56:52.735091 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:56:52.735816 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:56:52.757217 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:56:52.778896 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:57:52.733406 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:57:52.734154 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:57:52.755020 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:57:52.777788 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:58:52.734906 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:58:52.735572 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:58:52.757219 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:58:52.779872 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 21:59:52.735554 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 21:59:52.736235 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:59:52.757878 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 21:59:52.780549 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 22:00:52.735798 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 22:00:52.736502 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 22:00:52.759597 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 22:00:52.783354 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 22:00:59.392641 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dea68c3-ff2b-4cf7-b6cb-ab4f4197f229 tempest-TestShelveInstance-1115483581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 05 22:00:59.396236 ncdv-master-1 cinder-volume[122683]: WARNING stevedore.named [None req-5dea68c3-ff2b-4cf7-b6cb-ab4f4197f229 tempest-TestShelveInstance-1115483581 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 05 22:00:59.396730 ncdv-master-1 cinder-volume[122683]: WARNING castellan.key_manager [None req-5dea68c3-ff2b-4cf7-b6cb-ab4f4197f229 tempest-TestShelveInstance-1115483581 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 05 22:00:59.418550 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5dea68c3-ff2b-4cf7-b6cb-ab4f4197f229 tempest-TestShelveInstance-1115483581 None] Flow 'volume_create_manager' (43616d53-bd27-4f2b-b3ac-7b79c2184daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 22:00:59.425861 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5dea68c3-ff2b-4cf7-b6cb-ab4f4197f229 tempest-TestShelveInstance-1115483581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b99ba88-2658-441f-9733-e352df264fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 22:00:59.433638 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_db.sqlalchemy.engines [None req-5dea68c3-ff2b-4cf7-b6cb-ab4f4197f229 tempest-TestShelveInstance-1115483581 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 05 22:00:59.448489 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5dea68c3-ff2b-4cf7-b6cb-ab4f4197f229 tempest-TestShelveInstance-1115483581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b99ba88-2658-441f-9733-e352df264fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-05T22:00:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-708981085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d6273173-cb77-4954-be8b-a719a58a0e1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27fa8d1f73e84db099a940e9001e4fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-05T22:00:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-05T22:00:59Z,use_quota=True,user_id='164219338d49449294d81a0993428e33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd918ba1-430e-470e-856c-c1338a4b69f9),volume_type_id=bd918ba1-430e-470e-856c-c1338a4b69f9)' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 22:00:59.454931 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5dea68c3-ff2b-4cf7-b6cb-ab4f4197f229 tempest-TestShelveInstance-1115483581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93afe3e9-ad59-4264-816e-c34cdeecfe16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 22:00:59.459189 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5dea68c3-ff2b-4cf7-b6cb-ab4f4197f229 tempest-TestShelveInstance-1115483581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93afe3e9-ad59-4264-816e-c34cdeecfe16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 22:00:59.464482 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5dea68c3-ff2b-4cf7-b6cb-ab4f4197f229 tempest-TestShelveInstance-1115483581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f0ae4c-d102-40fc-8101-eb8f9d942be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 22:00:59.542812 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5dea68c3-ff2b-4cf7-b6cb-ab4f4197f229 tempest-TestShelveInstance-1115483581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f0ae4c-d102-40fc-8101-eb8f9d942be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd6273173-cb77-4954-be8b-a719a58a0e1c', 'volume_name': 'volume-d6273173-cb77-4954-be8b-a719a58a0e1c', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 22:00:59.548719 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5dea68c3-ff2b-4cf7-b6cb-ab4f4197f229 tempest-TestShelveInstance-1115483581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dc2f19b-83c1-441b-970f-6f0ac035ae70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 22:00:59.552807 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5dea68c3-ff2b-4cf7-b6cb-ab4f4197f229 tempest-TestShelveInstance-1115483581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dc2f19b-83c1-441b-970f-6f0ac035ae70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 22:00:59.557619 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5dea68c3-ff2b-4cf7-b6cb-ab4f4197f229 tempest-TestShelveInstance-1115483581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2faa7f8-9557-426b-a3b7-bff1da2d43be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 22:00:59.558743 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-5dea68c3-ff2b-4cf7-b6cb-ab4f4197f229 tempest-TestShelveInstance-1115483581 None] Volume d6273173-cb77-4954-be8b-a719a58a0e1c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d6273173-cb77-4954-be8b-a719a58a0e1c', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 05 22:00:59.559301 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dea68c3-ff2b-4cf7-b6cb-ab4f4197f229 tempest-TestShelveInstance-1115483581 None] Cloning d6273173-cb77-4954-be8b-a719a58a0e1c from image e66a3a3b-d2f9-4d5d-8021-a6001dff419f at location (None, None). {{(pid=122683) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 05 22:00:59.568437 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-5dea68c3-ff2b-4cf7-b6cb-ab4f4197f229 tempest-TestShelveInstance-1115483581 None] Lock "b'cinder-e66a3a3b-d2f9-4d5d-8021-a6001dff419f'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 22:00:59.577960 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-5dea68c3-ff2b-4cf7-b6cb-ab4f4197f229 tempest-TestShelveInstance-1115483581 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'volume_id': '311ef4be-45fd-4167-a3ad-6251d56550a7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57), 'last_used': datetime.datetime(2022, 2, 5, 22, 0, 59, 572819)}. {{(pid=122683) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 05 22:00:59.579135 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-5dea68c3-ff2b-4cf7-b6cb-ab4f4197f229 tempest-TestShelveInstance-1115483581 None] Image-volume cache entry image_update_at = 2022-02-05 20:37:57+00:00, requested image updated_at = 2022-02-05 20:37:57+00:00. {{(pid=122683) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 05 22:00:59.579600 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dea68c3-ff2b-4cf7-b6cb-ab4f4197f229 tempest-TestShelveInstance-1115483581 None] Found cache entry for image = e66a3a3b-d2f9-4d5d-8021-a6001dff419f on host ncdv-master-1@ceph#ceph. {{(pid=122683) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Feb 05 22:00:59.583563 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [None req-5dea68c3-ff2b-4cf7-b6cb-ab4f4197f229 tempest-TestShelveInstance-1115483581 None] Lock "b'cinder-e66a3a3b-d2f9-4d5d-8021-a6001dff419f'" released by "_prepare_image_cache_entry" :: held 0.015s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 22:00:59.584485 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dea68c3-ff2b-4cf7-b6cb-ab4f4197f229 tempest-TestShelveInstance-1115483581 None] Attempting to retrieve cache entry for image = e66a3a3b-d2f9-4d5d-8021-a6001dff419f on host ncdv-master-1@ceph#ceph. {{(pid=122683) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 05 22:00:59.589741 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-5dea68c3-ff2b-4cf7-b6cb-ab4f4197f229 tempest-TestShelveInstance-1115483581 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'volume_id': '311ef4be-45fd-4167-a3ad-6251d56550a7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57), 'last_used': datetime.datetime(2022, 2, 5, 22, 0, 59, 587596)}. {{(pid=122683) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 05 22:00:59.590159 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.image.cache [None req-5dea68c3-ff2b-4cf7-b6cb-ab4f4197f229 tempest-TestShelveInstance-1115483581 None] Image-volume cache entry image_update_at = 2022-02-05 20:37:57+00:00, requested image updated_at = 2022-02-05 20:37:57+00:00. {{(pid=122683) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 05 22:00:59.590593 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dea68c3-ff2b-4cf7-b6cb-ab4f4197f229 tempest-TestShelveInstance-1115483581 None] Creating from source image-volume 311ef4be-45fd-4167-a3ad-6251d56550a7 {{(pid=122683) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Feb 05 22:00:59.602416 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5dea68c3-ff2b-4cf7-b6cb-ab4f4197f229 tempest-TestShelveInstance-1115483581 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 22:00:59.657673 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5dea68c3-ff2b-4cf7-b6cb-ab4f4197f229 tempest-TestShelveInstance-1115483581 None] creating snapshot='volume-d6273173-cb77-4954-be8b-a719a58a0e1c.clone_snap' {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 05 22:01:00.228469 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5dea68c3-ff2b-4cf7-b6cb-ab4f4197f229 tempest-TestShelveInstance-1115483581 None] cloning 'volume-311ef4be-45fd-4167-a3ad-6251d56550a7@volume-d6273173-cb77-4954-be8b-a719a58a0e1c.clone_snap' to 'volume-d6273173-cb77-4954-be8b-a719a58a0e1c' {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 05 22:01:00.359725 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5dea68c3-ff2b-4cf7-b6cb-ab4f4197f229 tempest-TestShelveInstance-1115483581 None] Volume volume-35445a36-a76c-48db-a9c5-3b58646c1e7b.deleted is not a clone. {{(pid=122683) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 05 22:01:00.362203 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5dea68c3-ff2b-4cf7-b6cb-ab4f4197f229 tempest-TestShelveInstance-1115483581 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 05 22:01:00.362961 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5dea68c3-ff2b-4cf7-b6cb-ab4f4197f229 tempest-TestShelveInstance-1115483581 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122683) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 05 22:01:00.394880 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-5dea68c3-ff2b-4cf7-b6cb-ab4f4197f229 tempest-TestShelveInstance-1115483581 None] clone created successfully {{(pid=122683) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 05 22:01:00.395496 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.volume_utils [None req-5dea68c3-ff2b-4cf7-b6cb-ab4f4197f229 tempest-TestShelveInstance-1115483581 None] Marking volume d6273173-cb77-4954-be8b-a719a58a0e1c as bootable. {{(pid=122683) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Feb 05 22:01:00.403420 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dea68c3-ff2b-4cf7-b6cb-ab4f4197f229 tempest-TestShelveInstance-1115483581 None] Copying metadata from image e66a3a3b-d2f9-4d5d-8021-a6001dff419f to d6273173-cb77-4954-be8b-a719a58a0e1c. {{(pid=122683) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 05 22:01:00.403969 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dea68c3-ff2b-4cf7-b6cb-ab4f4197f229 tempest-TestShelveInstance-1115483581 None] Creating volume glance metadata for volume d6273173-cb77-4954-be8b-a719a58a0e1c backed by image e66a3a3b-d2f9-4d5d-8021-a6001dff419f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=122683) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 05 22:01:00.452721 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5dea68c3-ff2b-4cf7-b6cb-ab4f4197f229 tempest-TestShelveInstance-1115483581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2faa7f8-9557-426b-a3b7-bff1da2d43be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6273173-cb77-4954-be8b-a719a58a0e1c', 'volume_size': 1, 'image_id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efa2ce1f9d964d0ea058742655cf0107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e66a3a3b-d2f9-4d5d-8021-a6001dff419f', 'created_at': datetime.datetime(2022, 2, 5, 20, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 5, 20, 37, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e66a3a3b-d2f9-4d5d-8021-a6001dff419f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 22:01:00.458073 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5dea68c3-ff2b-4cf7-b6cb-ab4f4197f229 tempest-TestShelveInstance-1115483581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49b541e0-8474-428b-9866-4573ec4df159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 05 22:01:00.465819 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.flows.manager.create_volume [None req-5dea68c3-ff2b-4cf7-b6cb-ab4f4197f229 tempest-TestShelveInstance-1115483581 None] Volume volume-d6273173-cb77-4954-be8b-a719a58a0e1c (d6273173-cb77-4954-be8b-a719a58a0e1c): created successfully Feb 05 22:01:00.470298 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5dea68c3-ff2b-4cf7-b6cb-ab4f4197f229 tempest-TestShelveInstance-1115483581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49b541e0-8474-428b-9866-4573ec4df159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122683) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 05 22:01:00.476036 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [None req-5dea68c3-ff2b-4cf7-b6cb-ab4f4197f229 tempest-TestShelveInstance-1115483581 None] Flow 'volume_create_manager' (43616d53-bd27-4f2b-b3ac-7b79c2184daf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122683) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 05 22:01:00.483556 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [None req-5dea68c3-ff2b-4cf7-b6cb-ab4f4197f229 tempest-TestShelveInstance-1115483581 None] Created volume successfully. Feb 05 22:01:06.290917 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-dbdcd93e-6f59-4f1c-862c-0cf3d33e7c08 req-322a67c1-605b-4c45-91b7-17b6eb7aa668 tempest-TestShelveInstance-1115483581 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 22:01:06.958098 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-dbdcd93e-6f59-4f1c-862c-0cf3d33e7c08 req-322a67c1-605b-4c45-91b7-17b6eb7aa668 tempest-TestShelveInstance-1115483581 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.667s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 22:01:06.959012 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-dbdcd93e-6f59-4f1c-862c-0cf3d33e7c08 req-322a67c1-605b-4c45-91b7-17b6eb7aa668 tempest-TestShelveInstance-1115483581 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d6273173-cb77-4954-be8b-a719a58a0e1c', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': 'd6273173-cb77-4954-be8b-a719a58a0e1c', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 22:01:06.981677 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-dbdcd93e-6f59-4f1c-862c-0cf3d33e7c08 req-322a67c1-605b-4c45-91b7-17b6eb7aa668 tempest-TestShelveInstance-1115483581 None] Connection info returned from driver {'name': 'volumes/volume-d6273173-cb77-4954-be8b-a719a58a0e1c', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd6273173-cb77-4954-be8b-a719a58a0e1c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0b299bfc-f912-4ac2-b59f-519e0ef05725'} {{(pid=122683) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 05 22:01:07.028570 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-dbdcd93e-6f59-4f1c-862c-0cf3d33e7c08 req-322a67c1-605b-4c45-91b7-17b6eb7aa668 tempest-TestShelveInstance-1115483581 None] attachment_update completed successfully. Feb 05 22:01:52.738348 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 22:01:52.739405 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 22:01:52.762715 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 22:01:52.785969 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 22:02:52.741454 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 22:02:52.742188 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 22:02:52.763266 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 22:02:52.785272 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 22:03:35.394784 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-8c117879-6c3e-4aa4-ba09-fd1238d7c384 req-785b0095-3644-4bec-9d75-15617d60a4da tempest-TestShelveInstance-1115483581 None] Terminate volume connection completed successfully. Feb 05 22:03:35.395439 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-8c117879-6c3e-4aa4-ba09-fd1238d7c384 req-785b0095-3644-4bec-9d75-15617d60a4da tempest-TestShelveInstance-1115483581 None] Deleting attachment 0b299bfc-f912-4ac2-b59f-519e0ef05725. {{(pid=122683) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 05 22:03:36.988455 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-4b916eda-56b2-4cae-ae75-3564134351e4 req-7799225f-5be9-410d-ba5c-1aee75fc5696 tempest-TestShelveInstance-1115483581 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 05 22:03:37.625314 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_concurrency.processutils [req-4b916eda-56b2-4cae-ae75-3564134351e4 req-7799225f-5be9-410d-ba5c-1aee75fc5696 tempest-TestShelveInstance-1115483581 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.636s {{(pid=122683) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 05 22:03:37.626198 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-4b916eda-56b2-4cae-ae75-3564134351e4 req-7799225f-5be9-410d-ba5c-1aee75fc5696 tempest-TestShelveInstance-1115483581 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d6273173-cb77-4954-be8b-a719a58a0e1c', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5b2f70e9-748a-4334-b20d-2ef0f056e5f4', 'volume_id': 'd6273173-cb77-4954-be8b-a719a58a0e1c', 'discard': True}} {{(pid=122683) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 05 22:03:37.648525 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-4b916eda-56b2-4cae-ae75-3564134351e4 req-7799225f-5be9-410d-ba5c-1aee75fc5696 tempest-TestShelveInstance-1115483581 None] Connection info returned from driver {'name': 'volumes/volume-d6273173-cb77-4954-be8b-a719a58a0e1c', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd6273173-cb77-4954-be8b-a719a58a0e1c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '6bbecccf-08d7-4b5d-bd01-96f1e288f927'} {{(pid=122683) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 05 22:03:37.694822 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-4b916eda-56b2-4cae-ae75-3564134351e4 req-7799225f-5be9-410d-ba5c-1aee75fc5696 tempest-TestShelveInstance-1115483581 None] attachment_update completed successfully. Feb 05 22:03:52.741077 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 22:03:52.742068 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 22:03:52.766011 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 22:03:52.788134 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 22:04:52.743077 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 22:04:52.743793 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 22:04:52.765994 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 22:04:52.788473 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 22:05:12.797859 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-1f11b977-a217-488b-9172-30fd0b770334 req-a4165378-d037-4a25-8c89-01a66ee99112 tempest-TestShelveInstance-1115483581 None] Terminate volume connection completed successfully. Feb 05 22:05:12.798580 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.manager [req-1f11b977-a217-488b-9172-30fd0b770334 req-a4165378-d037-4a25-8c89-01a66ee99112 tempest-TestShelveInstance-1115483581 None] Deleting attachment 6bbecccf-08d7-4b5d-bd01-96f1e288f927. {{(pid=122683) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 05 22:05:12.916901 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [req-1f11b977-a217-488b-9172-30fd0b770334 req-c9200029-e781-4e03-b421-946e85a76c8c tempest-TestShelveInstance-1115483581 None] Lock "b'cinder-d6273173-cb77-4954-be8b-a719a58a0e1c-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 05 22:05:12.963521 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-1f11b977-a217-488b-9172-30fd0b770334 req-c9200029-e781-4e03-b421-946e85a76c8c tempest-TestShelveInstance-1115483581 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 22:05:13.053751 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-1f11b977-a217-488b-9172-30fd0b770334 req-c9200029-e781-4e03-b421-946e85a76c8c tempest-TestShelveInstance-1115483581 None] volume has no backup snaps {{(pid=122683) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 05 22:05:13.064149 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-1f11b977-a217-488b-9172-30fd0b770334 req-c9200029-e781-4e03-b421-946e85a76c8c tempest-TestShelveInstance-1115483581 None] deleting rbd volume volume-d6273173-cb77-4954-be8b-a719a58a0e1c {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 05 22:05:13.313816 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-1f11b977-a217-488b-9172-30fd0b770334 req-c9200029-e781-4e03-b421-946e85a76c8c tempest-TestShelveInstance-1115483581 None] volume is a clone so cleaning references {{(pid=122683) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 05 22:05:13.353959 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-1f11b977-a217-488b-9172-30fd0b770334 req-c9200029-e781-4e03-b421-946e85a76c8c tempest-TestShelveInstance-1115483581 None] deleting parent snapshot volume-d6273173-cb77-4954-be8b-a719a58a0e1c.clone_snap {{(pid=122683) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 05 22:05:13.476434 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.quota [req-1f11b977-a217-488b-9172-30fd0b770334 req-c9200029-e781-4e03-b421-946e85a76c8c tempest-TestShelveInstance-1115483581 None] Created reservations ['b887be65-80ca-4753-9d27-d0538c232f15', '1583476e-4c78-4456-ab81-ca3938338de3', '688c0088-b0b9-4766-89ee-90d6a8e3ab5d', '348d1525-8ac1-4047-b0fb-a52c7e7306c4'] {{(pid=122683) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 05 22:05:13.516807 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-1f11b977-a217-488b-9172-30fd0b770334 req-c9200029-e781-4e03-b421-946e85a76c8c tempest-TestShelveInstance-1115483581 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 22:05:13.539248 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [req-1f11b977-a217-488b-9172-30fd0b770334 req-c9200029-e781-4e03-b421-946e85a76c8c tempest-TestShelveInstance-1115483581 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 22:05:13.562694 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [req-1f11b977-a217-488b-9172-30fd0b770334 req-c9200029-e781-4e03-b421-946e85a76c8c tempest-TestShelveInstance-1115483581 None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 22:05:13.567756 ncdv-master-1 cinder-volume[122683]: INFO cinder.volume.manager [req-1f11b977-a217-488b-9172-30fd0b770334 req-c9200029-e781-4e03-b421-946e85a76c8c tempest-TestShelveInstance-1115483581 None] Deleted volume successfully. Feb 05 22:05:13.578616 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.coordination [req-1f11b977-a217-488b-9172-30fd0b770334 req-c9200029-e781-4e03-b421-946e85a76c8c tempest-TestShelveInstance-1115483581 None] Lock "b'cinder-d6273173-cb77-4954-be8b-a719a58a0e1c-delete_volume'" released by "delete_volume" :: held 0.662s {{(pid=122683) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 05 22:05:52.743390 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 22:05:52.744091 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 22:05:52.767036 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 22:05:52.788461 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 22:06:52.744420 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 22:06:52.745156 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 22:06:52.766309 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 22:06:52.788516 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 22:07:52.743602 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 22:07:52.744285 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 22:07:52.774927 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 22:07:52.805998 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 22:08:52.741694 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 22:08:52.742496 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 22:08:52.769508 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 22:08:52.792775 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 22:09:52.737643 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 22:09:52.738370 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 22:09:52.760290 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 22:09:52.783866 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 22:10:52.739346 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 22:10:52.740103 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 22:10:52.768523 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 22:10:52.793921 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 22:11:52.739975 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 22:11:52.741143 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 22:11:52.762642 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 22:11:52.785310 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 22:13:52.740443 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 22:13:52.741172 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 22:13:52.762808 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 22:13:52.785201 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 22:14:52.740622 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 22:14:52.741331 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 22:14:52.762784 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 22:14:52.785727 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 22:15:52.740245 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 22:15:52.740987 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 22:15:52.761752 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 22:15:52.784413 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 22:16:52.740487 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 22:16:52.741245 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 22:16:52.762426 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 22:16:52.784774 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 22:17:52.740156 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 22:17:52.740878 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 22:17:52.766263 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 22:17:52.787621 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 05 22:18:52.743044 ncdv-master-1 cinder-volume[122683]: DEBUG oslo_service.periodic_task [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122683) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 05 22:18:52.743769 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 22:18:52.764695 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.volume.drivers.rbd [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122683) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 05 22:18:52.791492 ncdv-master-1 cinder-volume[122683]: DEBUG cinder.manager [None req-6c0b4c7c-4509-43a4-9d39-fcb26f5a1354 None None] Notifying Schedulers of capabilities ... {{(pid=122683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}